Qwen-CUA – I-Computer Use Agent yomdabu eyethulwe yi-Alibaba Qwen nabanye Uyasebenza

I-Qwen-CUA iyi-Computer Use Agent yomdabu eyethulwe ngokubambisana yiqembu le-Qwen ne-XLang Lab. Isekelwe ekwakhiweni kwe-Mixture-of-Experts engu-397B-A17B, ibona isimo sesixhumi esibonakalayo ngezithombe zesikrini kuphela, ngaphandle kokuncika esihlahleni se-DOM noma kumethadatha yokufinyeleleka, bese ilawula iziphequluli, izinhlelo zamadeskithophu nezobuchwepheshe ngemicimbi yekhibhodi negundane. Ku-OSWorld-Verified ithole amaphuzu angu-86.2, kanti inguqulo enkulu i-Qwen-CUA-Max inamapharamitha angaphezu kwesigidintathu futhi ifinyelela ku-87.6.

Ukubona okusekelwe ezithombeni kuphela: Iqonda isimo sesixhumi esibonakalayo ngezithombe zesikrini kuphela, ngaphandle kokuncika esakhiweni se-HTML noma kumethadatha yokufinyeleleka, okwandisa ukuhambisana kwezinkundla ezahlukene.
Ukulingisa okungokwemvelo kokufaka: Ikhipha ngokuqondile imicimbi yekhibhodi negundane, futhi ingenza imisebenzi ezipheqululini, ezinhlelweni zamadeskithophu nasezinhlelweni zobuchwepheshe.
Isisekelo sokwakhiwa kwe-MoE: Isekelwe kumodeli ye-Mixture-of-Experts engu-397B-A17B, elinganisa ukusebenza nezindleko zokucabanga; inguqulo ye-Max inamapharamitha angaphezu kwesigidintathu futhi ithuthukisa ukusebenza.
Umbiko wezobuchwepheshe ovulekile: I-GitHub ishicilele umbiko wezobuchwepheshe kanye ne-Demo eyinkomba, okwenza kube lula ngabacwaningi ukuphinda benze imiphumela futhi bathuthukise phezu kwayo.

Ukwakhiwa kwesisekelo: Isekelwe ekwakhiweni kwe-Mixture-of-Experts ye-Qwen3.5-397B-A17B, enamapharamitha angu-397B, kanti i-forward pass ngayinye ivula angu-17B kuphela. Lokhu kugcina amandla okuchaza aphezulu kuyilapho kulawulwa izindleko zokucabanga.
Indlela yokunaka exubile: Isebenzisa ukunaka okuqondile kwe-GatedDeltaNet kanye ne-Gated Full Attention ngokushintshana ngesilinganiso esingu-75:25, yehlise ubunkimbinkimbi bokubala bokulandelana okude busuka ku-O(n²) bube cishe umugqa, futhi ikhulise umthamo we-256K context izikhathi ezingu-19 uma iqhathaniswa nokwakhiwa kwendabuko.
Ukuqondisa ochwepheshe: Ungqimba ngalunye lunochwepheshe abangu-512 abaqondiswa ngokunemba. Kusetshenziswa ukukhetha kwe-Top-10 nokwenziwa kabusha kwesisindo ukuze kuvulwe ochwepheshe, kuhambisana nochwepheshe owodwa owabiwe kanye ne-sigmoid gating elungisa ngokuzenzakalelayo umnikelo wolwazi olujwayelekile, kugwenywe ukulahleka kolwazi.
Ukubona okusekelwe ezithombeni kuphela: Ibona isimo sesixhumi esibonakalayo ngezithombe zesikrini kuphela, futhi ayinciki nhlobo esihlahleni se-HTML DOM, kumethadatha yokufinyeleleka noma kuma-API esistimu yokusebenza, ngaleyo ndlela ikwazi ukubona ngokujwayelekile noma yiluphi uhlelo lwe-GUI ezinkundleni ezahlukene.
Ukufaka ikhodi nokubeka indawo kwezithombe: Izuz inherit kusakhiwo se-ViT sochungechunge lwe-Qwen-VL esisekela okufakwayo okunokulungiswa okuguquguqukayo, bese ihlanganisa ne-MRoPE multimodal rotary position encoding ukuze ifake ikhodi yolwazi lwezikhathi, ukuphakama nobubanzi ngesikhathi esisodwa, ithole ngokunembile izixhumanisi zezinto zesixhumi esibonakalayo.

Vakashela indawo yokugcina: Vakashela i-GitHub bese usesha i-xlang-ai/Qwen-CUA ukuze ungene ekhasini eliyinhloko lephrojekthi.
Funda umbiko wezobuchwepheshe: Dawuniloda futhi ufunde umbiko wezobuchwepheshe okuphrojekthi ukuze uqonde ukwakhiwa kwemodeli nemininingwane yokuqeqeshwa.
Sebenzisa i-Demo eyinkomba: Lungisa imvelo ngokwe-README, bese usebenzisa i-Demo eyinkomba esemthethweni ukuze uzizwele imisebenzi ezenzakalelayo eshayelwa izithombe zesikrini.
Xhuma imvelo yakho: Xhuma imodeli emvelweni yedeskithophu noma yesiphequluli yasendaweni noma esefwini, bese wenza imisebenzi ngomjikelezo ovaliwe wokufaka izithombe zesikrini nokukhipha imicimbi yekhibhodi negundane.

Amaphuzu aphezulu ezivivinyo: Ifinyelela ku-86.2 ku-OSWorld-Verified, kanti inguqulo ye-Max ifinyelela ku-87.6, okuyizinga elihamba phambili kuma-CUA omthombo ovulekile.
I-CUA yomdabu ngempela: Ngokungafani nezixazululo ezincike kuma-API noma ezihlanganisa ama-Agent amaningi, i-Qwen-CUA iyimodeli yokubona-isenzo eqeqeshwe ukuphela-kuya-ekupheleni, enokuzinza okuphezulu.
Ukuhambisana kwezinkundla ezahlukene: Ayinqunyelwe uhlelo lokusebenza noma uhlobo lohlelo; noma iyiphi isofthiwe enesixhumi esibonakalayo esiyingcaca ingalawulwa.
I-ecosystem yomthombo ovulekile: Isebenzisa ilayisensi ye-Apache 2.0, futhi umbiko wezobuchwepheshe ne-Demo sekushicilelwe ukuze umphakathi ukwandise ngokukhululekile.

Indawo yokugcina ye-GitHub: https://github.com/xlang-ai/Qwen-CUA
Iphepha lobuchwepheshe: https://github.com/xlang-ai/Qwen-CUA/blob/main/paper/Qwen-CUA.pdf

Ukuhlolwa kwesoftware okuzenzakalelayo: Ihlonza izinto zesixhumi esibonakalayo ngezithombe zesikrini futhi yenze imisebenzi efana nokuchofoza, ukufaka nokuskrola, iqede ukuhlolwa kokubuyela emuva kwe-UI ezinkundleni ezahlukene ngaphandle kokubhala imibhalo ethile.
Ukuzenzakalela kwezinqubo ze-RPA: Ithatha indawo yomsebenzi wezandla ekufakeni idatha, ekwenzeni imibiko, ekusebenziseni i-ERP nakweminye imisebenzi ephindaphindwayo yehhovisi edeskithophu, ngaphandle kokushintsha izinhlelo ze-IT ezikhona zebhizinisi.
Amathuluzi osizo lokufinyeleleka: Ihlonza ngokuzenzakalelayo izinto zesixhumi esibonakalayo kubasebenzisi abangaboni noma asebekhulile futhi ibenzele imisebenzi enembayo, yehlise umkhawulo wokusebenzisa isoftware yobuchwepheshe.
Ukulawula isoftware yocwaningo neyobuchwepheshe: Ilawula ngokuzenzakalelayo isoftware yobuchwepheshe efana ne-MATLAB ne-SPSS engenazo izixhumi ze-API, yenze ngobuningi imisebenzi ethatha isikhathi efana nokucubungula idatha yokuhlola nokukhiqiza amashadi.
Izinsizakalo zokusingatha ama-Agent efwini: Ifakwa emvelweni yedeskithophu esefwini ukuze yenze ubusuku nemini imisebenzi yangemuva efana nokuhlola amawebhusayithi, ukuqoqwa kwedatha kanye nokudawuniloda imibiko ehleliwe.