EdenLive Uyasebenza

I-EdenLive iyirenderer yokukhiqiza ngesikhathi sangempela eyethulwe yi-VAST, futhi iwumphumela wesigaba sephrojekthi yayo yemodeli yomhlaba i-Project Eden. I-EdenLive isebenzisa izigcawu ezilula ze-Proxy noma amavidiyo ayisibonelo njengamasignali okulawula, ihlanganise nohlaka lokuqala oluqondiwe kanye nemiyalelo yombhalo, bese ikhiqiza ngokuqhubekayo izigcawu ezingokoqobo noma ezenziwe ngesitayela ngesikhathi sangempela. Nge-RTX 5090 eyodwa, ingafinyelela ku-720P nangaphezulu kuka-24FPS, ngokubambezeleka okungamakhulu ambalwa ama-millisecond kuphela. Umklamo oyinhloko we-EdenLive uhlukanisa ukugcinwa kwesimo somhlaba nokunikezwa kwezithombe; ingakhiqiza izigcawu ezisebenzisanayo ngaphandle kwezimpahla zobuciko eziphelele. Ivulwe ngokuphelele njengomthombo ovulekile, futhi ingasetshenziswa emidlalweni, ekugqwayizeni nasekukhiqizeni idatha yobuhlakani bokwenziwa obusemzimbeni.

Ukunikezwa kokukhiqiza ngesikhathi sangempela: isebenzisa izigcawu ezilula ze-Proxy noma amavidiyo ayisibonelo njengamasignali okulawula, ikhiqize ngokuqhubekayo izigcawu ezinemininingwane noma ezenziwe ngesitayela ngesikhathi sangempela, ngesilinganiso esingaphezu kuka-24 FPS ku-720P.
Ukushintsha noma yisiphi isitayela sokubukeka: nikeza kuphela uhlaka lokuqala oluqondiwe nemiyalelo yombhalo ukuze uguqule isimo esifanayo sibe isitayela sopopayi, umdwebo kawoyela, esingokoqobo nezinye.
Okokufaka okuyisibonelo kwanoma yiluphi uhlobo: isekela opopayi be-2D, izigcawu ze-3D, amavidiyo angempela neminye imithombo njengereferensi yesakhiwo nokunyakaza, ngaphandle kokuncika epayipini elithile lokunikezwa kwezithombe.
Ukukhiqiza kwe-Proxy-to-Fine: ikhiqiza ngokuqondile izigcawu zokugcina ezisezingeni eliphezulu kusakhiwo sendawo esingacacile, ngaphandle kokulungiselela izimpahla zobuciko eziphelele kusengaphambili.
Ukuhlanganiswa kokusebenzisana kwemidlalo: isebenza ngokuhlukanisiwe nohlelo lokusebenzisana olungaphezulu, igcine i-UI yomdlalo nezindlela zokulawula, futhi iqedele uchungechunge lokugcinwa kwesimo kanye nokunikezwa ngesikhathi sangempela.
Imvelo yomthombo ovulekile: ivula izisindo zemodeli, ikhodi yokwenza inference kanye nombiko wezobuchwepheshe, futhi ihlanganisa i-Game Prototype Turbo, engakhiqiza umdlalo we-Proxy odlalekayo ngolimi lwemvelo ngokuchofoza okukodwa.
Ukukhiqiza idatha yobuhlakani bokwenziwa obusemzimbeni: iguqula ukubukeka okubonakalayo ngenkathi igcina imikhondo yokunyakaza yasekuqaleni nesakhiwo sendawo, inikeze ukuqeqeshwa kwamarobhothi idatha ehlukahlukene.

Landela i-WeChat bese uphendula ngokuthi “开源” ukuze ujoyine iqembu lokuxhumana lamaphrojekthi e-AI omthombo ovulekile
Isakhiwo esihlukanisa isimo nokunikezwa kwezithombe: i-EdenLive ihlukanisa ukugcinwa kwesimo somhlaba nokukhiqizwa kokubonwayo: imithetho yomdlalo, izindawo zabalingiswa, ukuhlolwa kokushayisana nezinye izinto zigcinwa futhi zibuyekezwe ngokusobala uhlelo lokusebenzisana olungaphezulu. Imodeli yevidiyo ayisadingi ukuqagela isimo esifihlekile, ngaleyo ndlela igweme ukuqoqeka kwamaphutha njengoba isikhathi sokukhiqiza sikhula, futhi igxile kwikhwalithi yesithombe nesikhathi sangempela.
Indlela yokukhiqiza i-Proxy-to-Fine: imodeli isebenzisa ukwakheka kwendawo, ukunyakaza kwekhamera kanye nokuguquguquka kwezinga elibanzi okuhlinzekwa yisithombe esiyisibonelo se-Proxy njengezimo. Isithombe esiyisibonelo asidingi ukufinyelela ukunemba okuthile kwejometri, kodwa imodeli ingakhiqiza isithombe esiqondiwe esinemininingwane.
Ukulawula ngezimo eziningi: ukukhiqiza kuqhutshwa ngokuhlanganyela izinhlobo ezintathu zokokufaka: ukusakazwa kwevidiyo eyisibonelo kunikeza ulwazi lwesakhiwo nokunyakaza, uhlaka lokuqala oluqondiwe lunquma ukubukeka okujwayelekile nesitayela, kanti imiyalelo yombhalo yengeza isitayela nemininingwane. Lokhu kokuthathu kwenza kube nokulawula okuguquguqukayo okusebenzisa noma iyiphi ireferensi nanoma yisiphi isitayela.
Ukukhiqiza okusakazwayo ngesikhathi sangempela: imodeli isebenzisa inference esakazwayo esikhundleni sokukhiqiza ingxenye ephelele ungaxhunyiwe, yamukela ngokuqhubekayo izithombe eziyisibonelo eziguqukayo futhi ikhiphe imiphumela yokunikezwa ngohlaka ngalunye. Nge-RTX 5090 eyodwa, amapharamitha angu-5B kanye nokucushwa kwe-720P, ifinyelela ngaphezu kuka-24 FPS nokubambezeleka kokuphela kuya kokuphela okungamakhulu ambalwa ama-millisecond, futhi ingakhiqiza ngokuqhubekayo imizuzu eminingana.

Thola ikhodi: klona indawo yokugcina yomthombo ovulekile ku-GitHub https://github.com/VAST-AI-Research/EdenLive.
Landa izisindo: landa izisindo zemodeli ezihambisana nobukhulu obudingekayo ku-Hugging Face https://huggingface.co/VAST-AI/EdenLive.
Lungisa okokufaka kokuqala, isithombe esiyisibonelo: hlinzeka ngesigcawu se-Proxy esenziwe lula noma ukusakazwa kwevidiyo eyisibonelo, okungavela esigcawini se-2D/3D ozakhele sona, ekuphumeni kwenjini yomdlalo noma ekuqopheni isikrini.
Lungisa okokufaka kwesibili, uhlaka lokuqala oluqondiwe: khetha isithombe sokuqala esinquma isitayela nokubukeka okujwayelekile.
Lungisa okokufaka kwesithathu, imiyalelo yombhalo: bhala umbhalo ochaza isitayela nemininingwane.
Qalisa i-inference: biza ikhodi ye-inference; i-EdenLive izonikezela ngesithombe esiyisibonelo ngesikhathi sangempela sibe yisithombe esinemininingwane noma ukusakazwa kwevidiyo ngesitayela esicacisiwe.
Xhuma uhlelo lokusebenzisana: faka ngokuqhubekayo izithombe eziyisibonelo eziguqukayo ezivela enjini engaphezulu kumodeli, ukuze kufezwe uchungechunge oluphelele lokunikezwa kwezimo ezisebenzisanayo ngesikhathi sangempela, njengemidlalo.
Zama i-demo yokuphela kuya kokuphela: sebenzisa i-Game Prototype Turbo yomthombo ovulekile ukuze ukhiqize umdlalo we-Proxy odlalekayo ngolimi lwemvelo, bese uwuxhuma ne-EdenLive ukuze unikezwe ngesikhathi sangempela futhi uqedele lonke uhlelo.

Isikhathi sangempela esiqinile: i-RTX 5090 eyodwa ingakhiqiza ngokuqhubekayo imizuzu eminingi ku-720P nangaphezulu kuka-24FPS, ngokubambezeleka kokuphela kuya kokuphela okungamakhulu ambalwa ama-millisecond kuphela.
Isakhiwo esihlukanisiwe esizinzile: isimo somhlaba sigcinwa ngokusobala uhlelo lokusebenzisana, kanti imodeli yevidiyo igxila ekunikezeni, kugwenywe ukuqoqeka kwamaphutha okubangelwa ukuqagela kwesimo esifihlekile.
Izidingo eziphansi zokokufaka: ireferensi ye-Proxy ayidingi ijometri enemininingwane noma ipayipi elithile lokunikezwa kwezithombe; isakhiwo esingacacile sanele ukukhiqiza isithombe esisezingeni lokugcina.
Ukushintsha izitayela ngokukhululeka: isithombe esifanayo esiyisibonelo singakhiqiza noma yisiphi isitayela, esingokoqobo, sopopayi, somdwebo kawoyela nezinye, ngaphandle kokwakha kabusha izimpahla zesitayela ngasinye.
Ukusekela noma iyiphi ireferensi: isekela opopayi be-2D, izigcawu ze-3D, amavidiyo angempela neminye imithombo, futhi iqedele ukunikezwa kokukhiqiza ngendlela ehlanganisiwe.

Iwebhusayithi yephrojekthi: https://vast-eden.ai/?p=edenlive
Indawo yokugcina ku-GitHub: https://github.com/VAST-AI-Research/EdenLive
Indawo yamamodeli ku-Hugging Face: https://huggingface.co/VAST-AI/EdenLive
Iphepha lobuchwepheshe: https://assets.vast-eden.ai/assets/edenlive/EdenLive-tech-report.pdf

Ukuthuthukiswa kwemidlalo ye-AI: ngokusebenzisa i-EdenLive ukuze kunikezwe izithombe ezisezingeni lokugcina ngesikhathi sangempela, abathuthukisi abazimele bangakha imidlalo ye-3D ngezindleko eziphansi.
Ukulungiselela amafilimu nokugqwayiza: umqondisi usebenzisa izithombe ezilula ukunquma ukwakheka, ukunyakaza kwekhamera nomzila wabalingiswa, bese ekhiqiza ngokuchofoza okukodwa izinguqulo zezitayela ezahlukene, ezinjengezingokoqobo, amakhathuni nemidwebo kawoyela, ukuze anqume ngokushesha isiqondiso sobuciko.
Ukusakaza/ividiyo enesitayela ngesikhathi sangempela: kusetshenziswa ividiyo yomuntu wangempela njengereferensi, ukusebenza komuntu kuguqulwa ngesikhathi sangempela kube yizithombe zopopayi noma ezinye izitayela, ukuze kusetshenziswe kubasakazi abangokoqobo nakukhiqizwa kwamavidiyo amafushane.
Ukukhiqiza idatha yokuqeqesha ubuhlakani bokwenziwa obusemzimbeni: ngokugcina umkhondo wokunyakaza kwerobhothi nesakhiwo sendawo, ukubukeka okubukwayo kuyashintshwa ukuze kukhiqizwe ngokushesha idatha yokulingisa ehlukahlukene yokuqeqesha amarobhothi.
Imfundo esebenzisanayo nolwazi olubonakalayo: izigcawu ze-3D ezenziwe lula zezinhlelo zemfundo nezokubonisa zinikezwa ngesikhathi sangempela zibe izithombe ezisezingeni eliphezulu, okuvumela abasebenzisi ukuthi bathole ulwazi olugxilile nolusebenzisanayo esipheqululini noma kudivayisi elula.