SenseNova U1.5-Lite-Preview – Imodeli ye-multimodal elula, evulekile yakwa-SenseTime Uyasebenza

I-SenseNova U1.5-Lite-Preview inguqulo yokubuka kuqala yemodeli ye-multimodal elula, ehlanganisiwe ngokwemvelo, evulekile yakwa-SenseTime. Isekelwe ekwakhiweni kwe-NEO-Unify futhi, ngamapharamitha angu-8B-MoT kuphela, ihlanganisa ukuqonda okubukwayo, ukucabanga, ukwakha nokuhlela. Imodeli isekela ngokwemvelo ukwakha izithombe ze-4K, inikeza ukuthungwa okuncane okunemininingwane, ukubukeka komhlaba wangempela, ukwakha umbhalo wesiShayina nesiNgisi kanye nezakhiwo eziyinkimbinkimbi, futhi yenzelwe ukulandela ngokunembile ulimi lwemvelo olude kakhulu nemiyalelo yokudala okubukwayo ehlelekile. I-Prompt Enhance Skill ehambisanayo yehlisa ubunzima bokudala okuyinkimbinkimbi.

Ukwakha kwe-4K ngokwemvelo: Sekela ukwakha izithombe ezinokulungiswa okuphezulu kakhulu kusukela ekuqaleni kuze kube sekupheleni; imininingwane ihlala icacile ngisho nalapho isithombe sikhuliswa.
Ukubukeka okubukwayo okunemininingwane: Veza ukuthungwa kwezinto okungokoqobo, amazinga okukhanya nesithunzi kanye nemininingwane yezindawo ezincane.
Ukwakha umbhalo wesiShayina nesiNgisi: Nikeza ngokunembile umbhalo wesiShayina nesiNgisi kanye nokuhlelwa kwawo ngaphakathi kwezakhiwo eziyinkimbinkimbi.
Ukuhlela nokuphindaphinda izithombe: Sekela ukuhlela okuqhubekayo nokuphindaphindwayo kwezithombe ngokusekelwe emiyalelweni yolimi lwemvelo.
I-Prompt Enhance Skill: Yandisa ngokuzenzakalelayo izidingo ezimfishane zibe uhlelo oluphelele lokudala, yehlise ubunzima bokubhala imiyalelo.

Landela i-WeChat bese uphendula ngokuthi “开源” ukuze ujoyine iqembu lokuxhumana lamaphrojekthi e-AI avulekile
Ukwakhiwa okuhlanganisiwe kwe-NEO-Unify: Imodeli eyodwa ihlanganisa ulimi, incazelo ebonakalayo nokwakha kwamaphikseli, ukuze iqonde, icabange, yakhe futhi ihlele ngendlela ehlanganisiwe yemvelo.
Ukwakhiwa okulula kwe-8B-MoT: Kusetshenziswa ukwakhiwa kwe-hybrid token okunamapharamitha ayizigidi eziyizinkulungwane ezingu-8 kuphela. Lokhu kugcina imodeli ilula ngenkathi kwandisa imingcele yamakhono e-multimodal futhi kuqinisekisa ukuthi ukwakhiwa okuhlanganisiwe kunganwetshwa ngokuqhubekayo.
Ukuxhumana kwemvelo phakathi kwamaphikseli nolimi: Imodeli iqeqeshwa kusukela kumaphikseli nolimi ngendlela ephelele kusukela ekuqaleni kuze kube sekupheleni, ifunde ikhono lemvelo lokuguqula incazelo yolimi ibe ukwakheka okubukwayo.
Ukulawula okubukwayo okunomongo omude: Imodeli yenzelwe ukuqonda ulimi lwemvelo olude kakhulu nemiyalelo yokudala ehlelekile, futhi isekele ukusetshenziswa okunembile kwemiyalelo yokubuka enemikhawulo eminingi nezigaba eziningana.

Thola imodeli nemibhalo: Vakashela inqolobane ye-GitHub ukuze ubuke imibhalo yobuchwepheshe nekhodi yokucabanga, noma ulande izisindo zemodeli engu-8B-MoT namafayela okumisa ku-Hugging Face.
Ukufakwa kwemvelo: Lungisa imvelo yokusebenza ngokwemibhalo bese ulayisha izisindo zemodeli ukuze uqedele ukuqalisa imodeli endaweni yangakini noma efwini.
Ukwakha izithombe okuyisisekelo: Faka ngokuqondile incazelo yolimi lwemvelo, esekela isiShayina nesiNgisi, bese imodeli yakha isithombe se-4K ngokwemvelo.
Imiyalelo yokudala eyinkimbinkimbi: Nikeza izidingo eziphelele ezihlanganisa isihloko, ukwakheka, isitayela, umbhalo nemibandela yemikhawulo; imodeli izokwakha ngokwesakhiwo esibonakalayo esicacile.
Usizo lwe-Prompt Enhance: Biza i-Prompt Enhance Skill yokuhlola ukuze yandise ngokuzenzakalelayo umbono omfushane ube uhlelo oluphelele lokudala, bese uwuthumela kumodeli ukuze iwusebenzise.
Ukuhlela izithombe: Layisha isithombe esikhona bese wengeza umyalelo wokuhlela wolimi lwemvelo; imodeli izoqedela ukuhlela okuqhubekayo nokuphindaphindwayo igcina ukuhambisana okuphelele kwesithombe.

Ukuhlanganiswa okulula: Ngamapharamitha angu-8B-MoT kuphela, ihlanganisa ukuqonda, ukwakha nokuhlela, yehlise izindleko zokufakwa.
I-4K ultra-HD: Isekela ngokwemvelo ukwakha ngokulungiswa kwe-4K, igcine imininingwane nokuhambisana ngisho nasezithombeni ezinkulu kakhulu.
Ukulandela imiyalelo okuqinile: Ngisho nangaphandle kokuqeqeshwa okukhethekile kokufometha kwe-Prompt Enhance, isebenzisa ngokuzinzile imiyalelo emide neyinkimbinkimbi yokudala okubukwayo.
Ukubukeka okungokoqobo: Ithuthukisa kakhulu ukuthungwa kwezindawo ezincane, ukukhanya nezithunzi zezinto kanye nokubukeka komhlaba wangempela.
Ukuzinza kombhalo: Ukwakha umbhalo wesiShayina nesiNgisi kanye nokuhlelwa kwezakhiwo eziyinkimbinkimbi kunembe futhi kuzinzile.

Inqolobane ye-GitHub：https://github.com/OpenSenseNova/SenseNova-U1/blob/main/docs/u1.5_preview.md
Inqolobane yemodeli ye-HuggingFace：https://huggingface.co/sensenova/SenseNova-U1.5-8B-MoT-Preview

Ukuklama okubukwayo kwemikhiqizo yezentengiso: Khiqiza ngokushesha amaphosta, ama-infographic nezinto zokukhangisa zomkhiqizo ezinombhalo wesiShayina nesiNgisi onembile, izakhiwo eziyinkimbinkimbi nesitayela esibonakalayo esicacisiwe, ukuze kuhlangatshezwane nezidingo zokudala ezentengiso ezidinga ukulawula okuphezulu.
Imiqulu exoxayo enobubanzi obukhulu: Sebenzisa ukulungiswa kwe-4K ultra-HD ukudala okuqukethwe okuqhubekayo kokuxoxa okunobubanzi obukhulu, njengamatafula omlando nemiqulu yamasiko; imininingwane eminingi yombhalo nezithonjana ihlala icacile futhi izinzile ngemva kokukhuliswa.
Ukuboniswa kwemibono yezakhiwo nemikhiqizo: Khiqiza ukuboniswa kwangaphandle kwezakhiwo okunokubukeka okungokoqobo kakhulu, izithombe zemibono yezindawo zangaphakathi kanye nezithombe zokubonisa imikhiqizo, kuveze ukuthungwa kwezinto okungokoqobo, amazinga okukhanya nezithunzi kanye nomoya wendawo.
Izithombe zabantu nezithombe eziseduze ezisezingeni lokuthwebula: Imodeli ingakha izithombe zabantu, izithombe eziseduze zobuso nemisebenzi enendikimba yabantu enokuthungwa kwesikhumba okunemininingwane, ukukhanya nezithunzi kwemvelo kanye nokubukeka okungokoqobo, futhi isekele ukwakheka okuyinkimbinkimbi nokucaciswa kwesitayela.
Ukudala ubuciko be-retro ne-collage: Imodeli isekela ukudalwa okubukwayo okunesitayela okuhlanganisa izici eziningi, njengama-scrapbook e-retro, amaphosta e-collage namagrafu omlando wemvelo, futhi iveze ngokunembile ukuthungwa kwephepha, izitembu, umbhalo obhalwe ngesandla neminye imininingwane.