Izolo u-Ant Ling uvule ngokusemthethweni ikhodi yemodeli entsha yesizukulwane se-hybrid inference, i-Ling-3.0-flash, egxile ekuminyaneni okuphezulu kobuhlakani, ekuvaleni komjikelezo we-Agent kusukela ekuqaleni kuya ekugcineni, nasekusetshenzisweni ngezinga elikhulu ngezindleko eziphansi.
Namuhla uHuawei umemezele ngokusemthethweni ukuthi i-Ascend isiqede ngokuhambisana no-0 Day imodeli i-Ling-3.0-flash yakwa-Ant Ling. Ngesikhathi sokuyihlanganisa, yethule okokuqala uhlaka lokuhlela ama-operator i-CANN PyPTO, olunganciphisa isikhathi sokulethwa kwama-operator ayinkimbinkimbi ahlanganisiwe, luqede kahle ukufakwa kwama-operator, lulungise ukusebenza kohlaka lwe-inference, futhi luvule ngesikhathi esifanayo iphrojekthi ephelele yokuyifaka.
Lokhu kuhambisana kusekela ngokuphelele imikhiqizo yochungechunge lwe-Ascend A2 ne-A3, kuhambisana nohlelo olusemthethweni olujwayelekile lokuyifaka. Abathuthukisi bangasebenzisa isithombe esisemthethweni ukuze baqalise ngokushesha isevisi ye-inference (izidingo zehadiwe yimikhiqizo yochungechunge lwe-Ascend A2: amakhadi angu-8; imikhiqizo yochungechunge lwe-Ascend A3: amakhadi angu-4).
Uhlaka lokuhlela i-CANN PyPTO lwakhiwe phezu kwe-PTO ISA (isethi yemiyalelo ebonakalayo), lwakha indlela yokuhlela ye-Tile. Abathuthukisi bachaza ngokunembile umqondo wokubala besebenzisa ama-API ezinga le-Tensor, kanti uhlaka luqedela ngokuzenzakalelayo yonke inqubo yokuhlela ukuhlukaniswa, ukuthuthwa kwedatha nokukhiqizwa kwekhodi.
Ngaphezu kwalokho, i-CANNBot PyPTO Agent yakhe uhlaka lwama-agent amaningi, ihlukanisa yonke inqubo yokuthuthukiswa kwama-operator ibe yizigaba ezingu-7 (Stage) futhi iyithuthukise ngokuzenzakalelayo. Isigaba ngasinye senziwa ngokubambisana ama-sub-agent anemithwalo ecacile. Konke ukuhlela kuphethwe yi-orchestrator ehlanganisiwe i-pypto-op-orchestrator, kanti ama-sub-agent ashintshisana ngolwazi ngokusebenzisa indlela yememori nezimo ezifundeka yimishini, ukuze kuqinisekiswe ukudluliswa komongo ngaphandle kwegebe.
Inqubo yonke iqala ngokufakwa kwesidingo se-operator ngolimi lwemvelo, idlule ekukhiqizweni, ekuqinisekisweni nasekulungisweni okuzenzakalelayo, kuze kukhiqizwe i-operator engafakwa ebhodini, enembayo efinyelela ezingeni elidingekayo futhi esilungiselelwe ukusebenza. Akudingeki ukungenelela komuntu ekudlulisweni phakathi kwezigaba. Lokhu kuhamba komsebenzi akuthuthukisi kuphela kakhulu ulwazi lokuhlela ama-operator, kodwa futhi kunciphisa kakhulu isikhathi sokulethwa kwama-operator. Umqondo wesigaba ngasinye umi kanje:
