HiDream-O1-Video-1.0 Uyasebenza

HiDream-O1-Video-1.0 (efushanisiwe njenge-HD-V1) iyimodeli yokukhiqiza amavidiyo enezindlela eziningi zokufaka, eyakhiwe yi-HiDream.ai. Isekela okokufaka okuyimibhalo, izithombe, amavidiyo nezinye izindlela eziningi, futhi ingakhiqiza ngokuqondile ividiyo engu-1080p yemizuzwana engu-5–20 ngokuchofoza okukodwa. Imodeli igxile ekukhiqizeni okuqondiswa yimithetho yefiziksi nasekuhlanganiseni umsindo nesithombe ngokwemvelo. Ibekwe endaweni yesine emhlabeni jikelele eshadini le- Artificial Analysis lokuguqula izithombe zibe amavidiyo (With Audio), naseyesishiyagalombili esivivinyweni esingaboni se-Arena.ai, okubonisa ukuthi amavidiyo e-AI aseChina aphesheya angene esigabeni esiphambili emhlabeni.

Okokufaka kwezinhlobo eziningi: Isekela umbhalo, izithombe, amavidiyo nezinye izinhlobo eziningi njengemibandela yokukhiqiza.
Ukukhiqizwa kwamavidiyo ekhwalithi ephezulu ngokuqondile: Khiqiza ividiyo yekhwalithi ephezulu engu-1080p, yemizuzwana engu-5–20 ngokuchofoza okukodwa.
Ukuqonda inhloso: Imojuli yokuqonda yezinhlobo eziningi ehamba phambili ihlela okokufaka kolimi olukhulunywayo kube uhlelo lobungcweti oluhlanganisa izithombe zekhamera, abalingiswa, izenzo nemisindo.
Ukukhiqiza okusekelwe emithethweni yemvelo: Amandla adonsela phansi, ukushayisana, inertia neminye imithetho yemvelo kufakwa em логikini yokukhiqiza, ukuze ukuguquka kwesimo nokunyakaza kuhambisane nomhlaba wangempela.
Ukuhlela ubude ngobuhlakani: Ubude bevidiyo bunqunywa ngokuzenzakalelayo ngokusekelwe kumqondo wezenzakalo nesigqi sokulandisa, kunokugcwalisa ngomshini isikhathi esinqunyiwe.
Ukuhlanganiswa komsindo nesithombe: Izimpawu zombhalo, ividiyo nomsindo zifanekiselwa ndawonye, okwenza ukuvumelanisa kwezindebe, imisindo nesithombe kwenzeke ngokwemvelo.
Ukuvumelana kokulandisa nabalingiswa: Kusetshenziswa inqubo yokuhlela kuqala, ukukhiqiza okuhlangene, bese kulungiswa nge-Reward, ukuze kuqinisekiswe ukuhambisana kokulandisa ezithombeni ezinde nokuthi abalingiswa bangaguquki ngokungazelelwe.

Isakhiwo somdabu esihlanganisa zonke izinhlobo zemidiya: I-HD-V1 isebenzisa isakhiwo somdabu esihlanganisa zonke izinhlobo zemidiya, esakhiwe yi-Zhixiang. Kusukela ekuqaleni kokwakhiwa kwaso, sasihloselwe ukumelwa okuhlangene kombhalo, ividiyo nomsindo. Lezi zinto ezintathu zifaniswa ndawonye, zibekwe ngaphansi kwemingcele efanayo futhi ziqondaniswe ngesikhathi esisodwa senqubo yokukhiqiza; ukunyakaza kwesithombe kudonsa isigqi somsindo, izingxoxo nemisindo zithuthukisa imizwa yesigcawu, kanti izimo zombhalo ziba khona kuyo yonke inqubo.
Imojuli yokuqala yokuqonda inhloso yemidiya eminingi: Imodeli iqala ngokuqonda ngokujulile nangokuhleleka okwakhiwe lokho okufakwe umsebenzisi, isebenzisa imodeli yokuqonda imidiya eminingi. Iguqula ulimi lwemvelo olukhulunywayo nolungacacile lube yizinkambu zobungcweti ezifana nobude besigcawu, indawo, abalingiswa abakhona, izenzo nezimpawu zobuso, usayizi nokwakheka kwesithombe, ubude bokugxila kanye nokunyakaza kwekhamera, izingxoxo nomsindo wangemuva. Ukuqonda okujulile kwenza ukuhlela kuzinze; ukuhlela okuzinzile kwenza ukukhiqizwa okuhlangene okulandelayo kungaphambuki kalula, kugweme kusukela emthonjeni ukungaqondi ngokuphelele inhloso, ukweqa okungahambisani phakathi kwezigcawu nokushintshashintsha kwabalingiswa.
Umqondo wokukhiqiza onemithetho yemvelo eyakhelwe ngaphakathi: Indlela izinto eziwa ngayo ngenxa yamandla adonsela phansi, indlela eziphendula ngayo lapho zishayisana, indlela i-inertia eqhubeka ngayo, indlela ukukhanya nezithunzi kuncipha ngayo, kanye nendlela isikhala esigcina ngayo ukuqhubeka.
Inqubo yokukhiqiza enezigaba ezintathu: ukuhlela—ukukhiqiza—ukuqondanisa: I-Zhixiang iphakamisa indlela yobuchwepheshe eqala ngokuhlela, ilandelwe ukukhiqiza okuhlangene, bese iqondaniswa nge-Reward yemidiya eminingi: Imodeli iqala ngokuhlela ukulandisa nesimo sabalingiswa ezingeni lomhlaba wonke; ngesikhathi sokukhiqiza okuhlangene, ibeka imingcele esithombeni, ezenzweni nasencazelweni; bese isebenzisa amasiginali omvuzo wemidiya eminingi ukuze iqondanise ngokuhlanganyela ikhwalithi yesithombe, ukuqhubeka nokuhambisana nemithetho yemvelo, iqinisekise ukuzwana okuphelele phakathi kwabalingiswa, imizwa nezisusa lapho kuthathwa izigcawu ezinde.

Qinisekisa isimo sokuvula: Okwamanje imodeli isesigabeni sokuhlolwa kwangaphakathi futhi ayikakhishwa esidlangalaleni ngokuphelele. Kufanele ufake isicelo sokuthola ithuba lokuyizama kusenesikhathi https://n1y46cmwsp.feishu.cn/share/base/form/shrcnVBeO99NQQWARxNirglcbct。
Skena ikhodi ye-QR bese ugcwalisa ifomu lesicelo: Cindezela isikhathi eside ukuze uskene ikhodi ye-QR, bese uya ekhasini lefomu lesicelo.
Thumela imininingwane yesicelo: Gcwalisa imininingwane yomuntu noma yebhizinisi kanye nezidingo zokusebenzisa ngokwemiyalelo esefomini, bese ulinda ukubuyekezwa okusemthethweni ngemva kokuthumela.
Linda isaziso sokuvulwa kokufinyelela: Ngemva kokugunyazwa, uzothola ilungelo lokuzama imodeli ekuhlolweni kwangaphakathi.
Zama amandla emodeli: Ngemva kokuthola leli lungelo, ungasebenzisa indawo yokufinyelela enikezwe ngokusemthethweni ukufaka umbhalo, izithombe noma amavidiyo, bese ukhiqiza ividiyo enomsindo nesithombe ehlanganisiwe engu-5–20 imizuzwana enokulungiswa okungu-1080p ngokuchofoza okukodwa.

Isakhiwo somdabu samamodalithi amaningi: Imodeli yokuqala yevidiyo embonini eyenza ukumodela okuhlangene kwamasignali ombhalo, evidiyo nawomsindo, ikhiqize isithombe nomsindo kuhlanganiswe ngokwemvelo.
Ukukhiqiza okuqondiswa yimithetho ye-physics: Imithetho efana namandla adonsela phansi, ukushayisana, inertia, ukuncipha kokukhanya nezithunzi, kanye nokuqhubeka kwendawo iyaqondwa ngempela yimodeli futhi ifakwe emgudwini wokukhiqiza. Ukuguquka kwesithombe, impendulo yokunyakaza nemisindo ehambisana nesenzo konke kuhambisana nobudlelwano bangempela bezimbangela nemiphumela.
Ukuqonda okujulile kwezinhloso: Imojuli yokuqonda izinhloso yemultimodal ebekwa ekuqaleni ihlela ngokwesakhiwo okokufaka komsebenzisi okukhulunywa ngolimi oluvamile noma okuyizingcezu, ikuguqulele ohlelweni lobungcweti oluhlanganisa ubude beshot, ukwakheka kwesithombe ngokwebanga lekhamera, ukunyakaza kwekhamera, izenzo nezimo zobuso, izingxoxo nemisindo, ngaleyo ndlela igweme kusukela emthonjeni ukungaqondi ngokuphelele inhloso kanye nokunqamuka kokugeleza kwesigcawu.
Ubude besikhathi buhambisana nokulandisa: Iphula umqondo wendabuko “wokugcwalisa iwindi lesikhathi elinqunyiwe ngokuqukethwe”. Imodeli ihlela ubude besikhathi ngokwayo ngokulandela ukuthuthuka komcimbi kanye nesigqi sokulandisa, igweme ukulinda okungenanjongo noma ukwehlisa ijubane ngemva kokuphothulwa kwesenzo ukuze kugcwaliswe isikhathi.
Ukuhambisana kokulandisa nokungaguquguquki kwabalingiswa: Kusetshenziswa indlela yobuchwepheshe “yokuhlela kuqala, bese kukhiqizwa ngokuhlanganyela, bese kuqhathaniswa ne-multimodal Reward”, kuhlanganiswe ne-Diffusion RL kanye namamodeli e-Reward aqondaniswe nokuqonda komuntu, ukuze kuqinisekiswe ukuthi abalingiswa, imizwa nezisusa zabo kuhlala kuhambisana futhi kungaguquki phakathi kwamashot alandelanayo.

Amavidiyo amafushane okukhangisa nokumaketha: Khiqiza ngqo amavidiyo emikhiqizo anesithombe nomsindo we-1080p, unciphise izindleko zokwengeza izwi ngemuva, kuyilapho ukuboniswa kwezinto okungokoqobo ngokomzimba kulungele ukwethulwa kwemikhiqizo esezingeni eliphezulu.
Ukudala okuqukethwe kwamavidiyo amafushane/ezinkundleni zokuxhumana: Ubude besikhathi obuzivumelanisa no-5–20 seconds buhambisana ngokwemvelo nejubane lamavidiyo amafushane; imiyalelo ebhalwe ngolimi olukhulunywayo ingakhiqiza amavidiyo aphelele anemisindo ehambisanayo nokuvumelanisa ukunyakaza kwezindebe.
Ukuhlolwa kwangaphambili kwefilimu nokuhlelwa kwezigcawu (Previs): Hlela ngokuhlelekile izithombe, ububanzi besigcawu, ukunyakaza kwekhamera nemisindo, usize umqondisi aqinisekise ngokushesha ijubane lendaba nokuba nokwenzeka kwesithombe ngaphambi kokuqoshwa.
Ukuboniswa kwemikhiqizo ye-e-commerce ngokunyakazayo: Faka isithombe somkhiqizo ukuze ukhiqize ividiyo yesimo sokusetshenziswa; ukunyakaza kwento okungokoqobo ngokomzimba nokuvumelaniswa kwemisindo yokusetshenziswa kuthuthukisa izinga lokuguqulwa.
Okuqukethwe kwezemfundo nokuchaza isayensi: Guqula amaphuzu olwazi ahlukahlukene abe yimiboniso eguqukayo enemithetho yomzimba enembile; ukuvumelaniswa kwesithombe nomsindo kwehlisa umkhawulo wokuqonda.