Inqubo yokukhiqiza imidlalo emifushane ye-AI: Amathuluzi aphelele kusukela embhalweni kuya kuvidiyo eqediwe

BigBanana AI Director × Infinite Canvas: Lapho umqondisi wamadrama amafushane ehlangana nekhanvasi engenamkhawulo

Yeqa imingcele yokudala, wakhe ulayini wokukhiqiza wamadrama amafushane e-AI osezingeni lezimboni usebenzisa “ideski lomqondisi + ikhanvasi yokukhiqiza engenamkhawulo”.

I. Amathuluzi amabili, inhloso eyodwa

🎬 BigBanana AI Director — Ideski lomqondisi lamadrama amafushane e-AI

IBigBanana iyinkundla yezinga lezimboni yokukhiqiza opopayi namavidiyo amafushane kusetshenziswa i-AI. Isebenzisa ulayini wokukhiqiza onezigaba ezine othi Script → Asset → Keyframe → Video, ihlukanise ukudalwa kwedrama emfushane kube yizinyathelo zobungcweti ezilawulekayo nezithuthukiseka:

Ifana nesikhungo somqondisi esiqondisa umsebenzi ngobungcweti—wena ulawula indlela yokudala, i-AI yona iphathe imininingwane enzima yokwenza.

🎨 Infinite Canvas — Ikhanvasi yokukhiqiza izithombe/amavidiyo nge-AI

Infinite Canvas iwumhleli wokukhiqiza nge-AI osekelwe kuma-node, ogqugquzelwe umqondo wokuhamba komsebenzi obonakalayo we-ComfyUI. Ihlinzeka ngalokhu:

• Ulayini wokukhiqiza wama-nodeIkhadi lesithombe → umyalo → LLM → ukukhiqiza kwemodeli → i-node yokuphumayo, kuxhunywe ngokukhululeka
• Ukusekela izinjini eziningiComfyUI, ModelScope, RunningHub, Veo, Sora nezinye
• Imodi yekhanvasi ehlakaniphileUkudonsa ngokukhululeka, ukuhlela ngamaqembu, nokubuyela emlandweni
• Ukumboza yonke imidiyaUkukhiqiza izithombe, amavidiyo, umsindo nombhalo endaweni eyodwa
• Ukuphathwa kwempahla yokudalaUmtapo wezinsiza owakhelwe ngaphakathi, ukusesha ngezigaba, nokumakwa nge-AI

Ifana nekhanvasi yobuciko enwebeka ngokungenamkhawulo—i-node ngayinye iyiyunithi yokudala, kanti uma zixhunywa zakha uchungechunge oluphelele lokudala.

II. Isakhiwo sokuhlanganisa: ukuxhumana okungenazihibe kusuka edesikeni lomqondisi kuya kukhanvasi

2.1 Indlela yokuxhumana

IBigBanana isungula ukuxhumana kwezindlela ezimbili ne-Infinite Canvas nge-iframe + postMessage bridge protocol:

┌─────────────────────────────────────────────────────────┐
│  BigBanana AI Director (React App)                      │
│                                                         │
│  ┌─────────────┐    postMessage     ┌────────────────┐  │
│  │ Ideski       │ ◄────────────────► │ Infinite Canvas │  │
│  │ lomqondisi   │  publish-shot     │  (iframe)       │  │
│  │ · Ukukhetha  │ ─────────────────►│ · Yamukela      │  │
│  │   i-storyboard│                   │   imiyalo       │  │
│  │ · Ulwazi      │                   │ · Khiqiza       │  │
│  │   lwesigcawu │                   │   izithombe/    │  │
│  │ · Idatha      │                   │   amavidiyo     │  │
│  │   yabalingiswa│  image-generated  │ · Buyisa        │  │
│  │ · Incazelo    │ ◄─────────────────│   imiphumela    │  │
│  │   yezinsiza   │                   │                 │  │
│  └─────────────┘                    └────────────────┘  │
└─────────────────────────────────────────────────────────┘

2.2 Idatha ethunyelwa kukhanvasi

Uma uchofoza “Thumela kukhanvasi ukuze ukhiqize” edesikeni lomqondisi, wonke umongo olandelayo upakishwa futhi uthunyelwe ngokuzenzakalelayo:

[Isigcawu] Indawo: Ipaki yasekwindla, isikhathi: ukuhwalala, umoya: ofudumele nowothando, incazelo yesigcawu: amaqabunga egolide agcwele indlela
Umlingiswa: Lin Xiao, ukubukeka: owesifazane oneminyaka engu-25, izinwele ezinde ezisabalele emahlombe, ijazi elinsundu ngokukhanyayo, omnene nonolwazi
Umlingiswa: Chen Yu, ukubukeka: owesilisa oneminyaka engu-28, izinwele ezimfishane, ibhantshi eliluhlaza okwesibhakabhaka ngokumnyama, obukekayo nonamandla
Insiza: inkomishi yekhofi, incazelo: inkomishi yekhofi yobumba emhlophe, ephuma umusi
Isenzo: UChen Yu unikeza uLin Xiao ikhofi
Ingxoxo: "Kuyabanda, phuza elishisayo"
Izwi: Kuyabanda, phuza elishisayo

Lokhu kusho ukuthi i-AI ayikhiqizi ingenayo ingqikithi, kodwa idala inomongo ophelele wesigcawu, ukubukeka kwabalingiswa, izinsiza nesakhiwo sendaba.

2.3 Ukubuyiselwa okuzenzakalelayo kwemiphumela

Izithombe/amavidiyo akhiqizwe yi-Infinite Canvas abuyiselwa ngokuzenzakalelayo ku-BigBanana:

• Ukukhiqizwa kwesithombe → kugcwaliswa ngokuzenzakalelayo njenge-keyframe yokuqala ye-storyboard yamanje
• Ukukhiqizwa kwevidiyo → kugcwaliswa ngokuzenzakalelayo njenge-isiqeshana sevidiyo se-storyboard, bese kukhishwa nama-frame okuqala nawokugcina
• Ukuvumelanisa imiphumela eminingi → kusekela ukuvumelanisa kanye kwayo yonke imiphumela ekhiqizwe kukhanvasi

III. Izinzuzo ezisemqoka zokuhlanganisa

3.1 🎯 Kusuka “kumathuluzi ahlukene” kuya “kulayini wokukhiqiza ohlanganisiwe”

Ngaphambi kokuhlanganisa: Bekudingeka wakhe ukuhamba komsebenzi ngesandla ku-ComfyUI → uthumele izithombe → uvule isofthiwe yokuhlela → ungenise izinsiza → uqondanise ama-storyboard → uhlanganise ividiyo yokugcina… Isinyathelo ngasinye sasidinga umsebenzi wezandla, okwandisa amaphutha nezindleko zokuphindaphinda.

Ngemva kokuhlanganisa:

1. Bhala umbhalo ku-BigBanana, i-AI ihlukanise ama-storyboard ngokuzenzakalelayo
2. Setha isigcawu, abalingiswa nezinsiza ze-storyboard ngayinye
3. Chofoza kanye ukuthumela ku-Infinite Canvas ukuze wenze ukuthuthukiswa komyalo + ukukhiqizwa nge-AI
4. Izithombe/amavidiyo akhiqiziwe agcwaliswa ngokuzenzakalelayo kuma-storyboard
5. Buka kuqala, shintsha ukuhleleka, bese uthekelisa umkhiqizo wokugcina emugqeni wesikhathi

Kunciphisa u-80% womsebenzi wokudlulisa phakathi kwezinyathelo.

3.2 👁️ Isiqinisekiso sezinga lezimboni sokungaguquki kwabalingiswa

Ubuhlungu obukhulu bamadrama amafushane e-AI ukungaguquki kwabalingiswa—izici zobuso, izingubo nezinwele zomlingiswa ofanayo kungashintsha kuma-storyboard ahlukene.

Isixazululo se-BigBanana × Infinite Canvas:

• Uhlelo lokusungula ukubukeka komlingiswaSethela umlingiswa ngamunye i-visualPrompt (incazelo yokubukeka) + referenceImage (isithombe esiyinkomba) + turnaround (isithombe sokujikeleza esinama-engeli amaningi)
• Ukufakwa komongo ngokuzenzakalelayoNjalo lapho kuthunyelwa i-storyboard kukhanvasi, incazelo yokubukeka nesithombe esiyinkomba somlingiswa kuyahlanganiswa ngokuzenzakalelayo
• Ukuvalwa kwereferensi ohlangothini lwekhanvasiInfinite Canvas isebenzisa isithombe esiyinkomba njengokufakwayo kwe-ControlNet/IP-Adapter, iqinisekise ukuthi imiphumela ehleliwe iyahambisana nokusethwa komlingiswa
• Okufanayo nasezinsizeniIncazelo nezithombe eziyizinkomba zezinsiza nazo ziyathunyelwa ndawonye, kuqinisekiswe ukubukeka okufanayo kwezinto

3.3 ⚡ Ukuphindaphinda ngokushesha: kusuka “ekulindeni isigamu sehora” kuya “ekulungiseni ngemizuzu emihlanu”

Enqubweni yendabuko yokukhiqiza nge-AI, ukushintsha umyalo owodwa → ukulinda ukukhiqizwa → ukunganeliseki → ukushintsha futhi → ukulinda futhi… Umjikelezo wokuphindaphinda uba mude kakhulu.

Indlela yokuphindaphinda ngemva kokuhlanganisa:

Awanelisekile → Lungisa i-storyboard ku-BigBanana → Thumela futhi kukhanvasi → Khiqiza izinhlobo eziningi ngokuhambisana
              → Khetha inguqulo ehamba phambili → Vumelanisa ngokuzenzakalelayo ku-storyboard → Qhubeka nokulandelayo

Infinite Canvas isekela ukukhiqiza ngobuningi nokuqhathanisa izinhlobo, ngakho ungakhiqiza izinhlobo ezingu-4-8 ngesikhathi esisodwa kukhanvasi, ukhethe ehamba phambili, bese uyivumelanisa ubuyele kuyo.

3.4 🔧 “Imodi ejulile” yabasebenzisi abangochwepheshe

Kubasebenzisi abasezingeni eliphezulu, ukuhlanganisa kuhlinzeka ngezindlela ezimbili zokudala:

Ungashintsha phakathi kwalezi zindlela ezimbili noma nini, ngaphandle kokuvinjelwa yithuluzi.

IV. Izimo zokusetshenziswa zangempela

Isimo sokuqala: Umkhiqizi wamavidiyo amafushane oshicilela nsuku zonke

1. Ekuseni ngenisa uhlaka lombhalo ku-BigBanana, i-AI ihlukanise ama-storyboard angu-8 ngemizuzu engu-10
2. Khetha izifanekiso zezigcawu nabalingiswa ze-storyboard ngayinye
3. Thumela ngobuningi ku-Infinite Canvas, bese ngesikhathi sekhefu lesidlo sasemini ukhiqize wonke ama-keyframe ngokuhambisana
4. Ntambama hlunga imiphumela, ulungise izithombe onganelisekile ngazo
5. Ngokuhwalala thekelisa i-MP4, uyishicilele enkundleni yamavidiyo amafushane

Ingcindezi yokubuyekeza nsuku zonke isuka kokuthi “akunakwenzeka” ibe “iyalawuleka”.

Isimo sesibili: Ukukhiqizwa kwe-anime ngendlela yezimboni

1. Umbhali uqedela ukuhlukaniswa kombhalo nokusungulwa kwabalingiswa ku-BigBanana
2. Iqembu lezobuciko liqedela ukubukeka okuqondile kwabalingiswa e-StageAssets
3. Umdwebi wamabhodi ezigcawu udweba okusalungiswa kwamabhodi ezigcawu etafuleni lomqondisi
4. Ibhodi ngalinye lesigcawu lithunyelwa ku-Infinite Canvas, kusetshenziswa ukugeleza komsebenzi kwe-ComfyUI ukuze kukhiqizwe ngokunemba okuphezulu
5. Umhleli wokuhlanganisa uthola iphakheji yezinto ezihlelwe ngokufanayo, bese eqala ukuhlela ngokuqondile

Ukufana kwabalingiswa + ukusebenza komugqa wokukhiqiza ngokuhambisana = umthamo wokukhiqiza uphindwe kabili.

Isimo sesithathu: Umdali ozimele “oyiqembu lomuntu oyedwa”

Umuntu oyedwa + BigBanana + Infinite Canvas = iqembu eliphelele lokukhiqiza idrama emfushane:

• Umbhali → Ukuhlaziywa kombhalo yi-AI
• Umculi → Ukubukeka kwabalingiswa + ukusethwa kwezindawo
• Umqondisi → Ideski lamabhodi ezigcawu
• Umthwebuli → Injini yokukhiqiza ye-Inifinite Canvas
• Umhleli → Umugqa wesikhathi + ukuthumela ngaphandle

Umthamo wokukhiqiza womuntu oyedwa, umphumela weqembu lonke.

5. Izinhlelo zesikhathi esizayo

Isigaba 1: Osekuqediwe manje ✅

•  Ukuxhumana kwebhuloho le-postMessage phakathi kwe-BigBanana ne-Infinite Canvas
•  Ukushicilelwa ngokuchofoza kanye kwedatha yamabhodi ezigcawu (indawo + umlingiswa + impahla + isenzo + inkhulumomphendvulwano)
•  Ukubuyiselwa ngokuzenzakalelayo kwemiphumela yokukhiqizwa kukhanvasi kumafreyimu abalulekile amabhodi ezigcawu
•  Ukusekelwa kwezindlela ezimbili: izithombe namavidiyo
•  Ukuxhumanisa izithombe eziyizikhombo ohlangothini lwekhanvasi (isithombe sendawo + isithombe somlingiswa + isithombe sempahla)
•  Ukulayishwa ngokwezifiso kwenodi ye-Output (izithombe/amavidiyo angeziwe)
•  Ulimi lokuklama oluhambisana ne-Infinite-Canvas (itimu emnyama eluhlaza okwesibhakabhaka nampunga, amakhona ayindilinga athambile, ukubukeka kwengilazi)

Isigaba 2: Izinhlelo zesikhathi esiseduze 🚧

• Ukukhiqizwa kwamaqoqo amabhodi ezigcawu Khetha amabhodi ezigcawu amaningi, uwathumele kukhanvasi kanye, bese ukhiqiza wonke amafreyimu abalulekile ngokuhambisana
• Izifanekiso zokugeleza komsebenzi ze-ComfyUI Setha kusengaphambili ukugeleza komsebenzi kwe-ComfyUI ku-BigBanana, bese ukufanisa ngokuzenzakalelayo lapho kuthunyelwa amabhodi ezigcawu
• Ukukhiya umlingiswa nge-IP-Adapter Uhlangothi lwekhanvasi luzolayisha ngokuzenzakalelayo isithombe somlingiswa esiyisikhombo njengokufakwayo kwe-IP-Adapter, kuqinisekiswe ukufana okuqinile
• Ukuphathwa komlando wokukhiqiza Ibhodi ngalinye lesigcawu ligcina zonke izinguqulo ezikhiqiziwe, futhi lisekele ukubuyela emuva nokuqhathanisa
• Ukwandiswa kwezikhuthazi ohlangothini lwekhanvasi Sebenzisa amanodi e-LLM ukuze kuthuthukiswe ngokuzenzakalelayo izikhuthazi ezifakwe umsebenzisi

Isigaba 3: Umbono wesikhathi esimaphakathi 🔮

• Ukusebenzisana kwamakh#### canvas amaningi Isibonelo esisodwa se-BigBanana sixhuma izibonelo eziningi ze-Infinite Canvas, okwenza ukukhiqizwa okusabalalisiwe ngokuhambisana kube ngokoqobo
• Ukulawulwa kwekhwalithi nge-AI Imiphumela yokukhiqiza inikwa amaphuzu ngokuzenzakalelayo (ukwakheka, ukufana, ukufaneleka kwesenzo), bese izama futhi ngokuzenzakalelayo uma ingafaneleki
• Ukufakwa kwamafreyimu aphakathi ebalulekile evidiyweni Ngemva kokukhiqizwa kohlaka lokuqala nolokugcina, i-AI igcwalisa ngokuzenzakalelayo amafreyimu oshintsho aphakathi
• Ukukhiqizwa okuvumelanisiwe komsindo nesithombe Izwi nesithombe kukhiqizwa ngesikhathi esisodwa futhi kuqondaniswe ngokuzenzakalelayo
• Ikhanvasi esefwini I-Infinite Canvas ithunyelwa kuseva esefwini ukuze iqembu labelane ngesibonelo esisodwa sekhanvasi

Isigaba 4: Umbono wesikhathi eside 🌟

• Ukusebenzisana ngesikhathi sangempela Abantu abaningi bahlela umbhalo ku-BigBanana ngesikhathi esisodwa, bese bekhiqiza ngokubambisana kukhanvasi eyabelwana ngayo
• Umsizi womqondisi we-AI Izincomo ezihlakaniphile zamabhodi ezigcawu ezisekelwe ku-LLM, ukuhlaziywa kolimi lwamakhamera, nezincomo zokulawula isigqi
• Imboni yedrama emfushane ezenzakalelayo ngokuphelele Faka uhlaka lwendaba → I-AI iqedela ngokuzenzakalelayo umbhalo → ukuklanywa kwabalingiswa → amabhodi ezigcawu → ukukhiqiza → ukuhlela → umculo → ividiyo yokugcina
• Uhlelo oluvulekile lwama-plugin Abathuthukisi bezinkampani zangaphandle bangabhalela i-BigBanana ama-plugin ekhanvasi, izilungiseleli zamamodeli, nezilungiselelo zesitayela

6. Ukuqalisa ngokushesha

Izidingo zemvelo

• Node.js 18+ (ukusebenzisa i-frontend ye-BigBanana)
• Python 3.10+ (ukusebenzisa i-backend ye-Infinite Canvas)
• Okungenani ikhadi elilodwa lemifanekiso le-NVIDIA elisekela i-CUDA (kunconywa inkumbulo yevidiyo engu-8GB+)

Izinyathelo zokuqalisa

# 1. Qalisa i-backend ye-Infinite Canvas
cd Infinite-Canvas
python main.py
# 2. Qalisa iseva yokuthuthukisa ye-frontend ye-BigBanana
cd BigBanana-AI-Director-main
npm install
npm run dev
# 3. Vula isiphequluli uye ku
# BigBanana: http://localhost:5173
# Infinite Canvas: http://127.0.0.1:3000
# 4. Etafuleni lomqondisi le-BigBanana chofoza “Ikhanvasi Infinite Canvas”
# Linda ukuxhumana kwebhuloho le-iframe kuphumelele (isimo sibonise “Iyatholakala”)
# Chofoza “Shicilela kukhanvasi ukuze ukhiqize” noma “Thumela ukuze ukhiqize”

Lungiselela i-Comfyui

Ku-Infinite-Canvas layisha ukugeleza komsebenzi okwenziwe ngokwezifiso kokuguqula umbhalo ube isithombe, isithombe sibe isithombe, kanye nevidiyo eyinkomba ephelele. Uma ungenakho ukugeleza komsebenzi, landela ikhasi bese ushiya umlayezo othi “素材” ukuze uwuthole ngokuzenzakalelayo.

7. Isiphetho

Ukuhlanganiswa kwe-BigBanana AI Director ne-Infinite Canvas akukhona nje ukuxhumanisa amathuluzi amabili, kodwa kuwukuthi kuthuthukiswe indlela yokudala:

 Kusukela “kumuntu osebenzisa ithuluzi” kuya “kumuntu oqondisa uhlelo”.
 Kusukela “ekukhiqizeni okukodwa ngakunye” kuya “ekukhiqizeni komugqa wokusebenza ngokuhambisana”.
 Kusukela “kumdali oyedwa” kuya “eqenjini lomuntu oyedwa”.

Sikholelwa ukuthi i-AI ngeke ithathe indawo yekhono lomdali lokwahlulela nobuhle, kodwa ingathatha indawo yemisebenzi ephindaphindwayo, edla isikhathi, nengadingi ubuciko obuningi. Bhala umbhalo, lungisa abalingiswa, lungisa amabhodi ezigcawu kahle—okusele kukhanvasi.

Ukudala akupheli, nokuthuthukisa akumi. 🚀

BigBanana AI Director × Infinite Canvas — Yenza umugqa wendaba ngamunye ube yikhanvasi enwebeka ngokungenamkhawulo.

Landela i-GC随笔 ukuze uthole ulwazi olwengeziwe oluphambili nge-AI.