Sebenzisa i-CDAF Ukunikeza Ama-Agent e-AI Umongo Wevidiyo Osheshayo, Oqinisekisiwe

Okwenziwa yi-CDAF

I-CDAF, okuyisifinyezo se-Cached Descriptive Asset Files, iyifomethi evulekile ye-sidecar yevidiyo. Igcina incazelo yombhalo osobala enesitembu sesikhathi eduze kwevidiyo isebenzisa igama eliyisisekelo elifanayo. Ngokwesibonelo, sunset-drone.mp4 ihambisana ne-sunset-drone.cdaf.

Inhloso iwukuchaza ividiyo kanye bese uphinde usebenzise leyo ncazelo emisebenzini elandelayo ye-AI. Esikhundleni sokuthumela izithombe ezifanayo kumodeli eqonda amavidiyo kuwo wonke umbuzo, i-agent ingaqinisekisa futhi ifunde ifayela le-CDAF elincane kakhulu.

footage/
sunset-drone.mp4
sunset-drone.cdaf

Ividiyo yokuqala ayiguquki futhi iyaqhubeka nokudlalwa yisoftware ejwayelekile yamavidiyo. I-sidecar ingumbhalo we-UTF-8 oqukethe unhlokweni omncane wemethadatha, olandelwa incazelo ye-Markdown elungiselelwe amamodeli olimi.

Kungani I-sidecar Iphephile Ukuphinda Isetshenziswe

Unhlokweni we-CDAF ugcina i-hashi ye-SHA-256 kanye nosayizi wamabhayithi bevidiyo ngqo. Amathuluzi ahambisana nefomethi asebenzisa la manani ukunquma ukuthi incazelo isasebenza yini. Uma ividiyo ishintsha, i-sidecar iba yisidala futhi akufanele isetshenziswe.

--- CDAF/1.0
video: sunset-drone.mp4
sha256: 4a7d1ed4…
bytes: 48211394
duration: 00:00:31.500
generator: gemini-2.5-flash
created: 2026-08-26T14:03:12Z
---

## Isifinyezo
Isiqeshana se-drone sasemoyeni esithatha imizuzwana engu-31, sibonisa umgwaqo omkhulu osogwini ngesikhathi sokukhanya okusagolide…

## Izigaba
[00:00.0-00:05.2] Isithombe esibanzi sasemoyeni sokwethula indawo…
[00:05.2-00:12.8] I-drone isondela futhi yehla…

## Okubhaliwe
(akukho nkulumo)

## Umbhalo Ovela Esikrinini
(akukho)

## Omaka
drone, aerial, coastal highway, golden hour, sunset

Umzimba unganikeza isifinyezo, izigaba ezinezitembu zesikhathi, okubhaliwe, umbhalo ovela esikrinini, kanye nomaka. Bheka imininingwane ye-CDAF 1.0 yephrojekthi ukuze uthole ifomethi eyimpoqo, izincazelo zokuba sesikhathini, imithetho yokwenza izinguqulo, kanye nohlelo lwezigaba.

Izici Eziyinhloko

• Ukusetshenziswa kabusha okuqinisekisiwe: Imethadatha ye-SHA-256 nosayizi wamabhayithi ixhumanisa i-sidecar nevidiyo ngqo eyichazayo.
• Ifomethi yombhalo efundekayo: Ama-agent angadla, aseshe, futhi asebenzise kabusha izincazelo ngaphandle kokuphinda aqophe ividiyo.
• Izigaba ezinezitembu zesikhathi: Amabanga ezigaba angasekela ukukhethwa kweziqeshana nokwakhiwa kohlu lokusika.
• Ingqikithi engenakho ukuncika: Ukuhlaziya, ukwenza i-serialization, i-hashing, ukuhlola ukuba sesikhathini, kanye nokukhipha izigaba kusebenzisa umtapo ojwayelekile we-Python.
• CLI egxile ekucubunguleni ngamaqoqo: Ithuluzi lomugqa womyalo lingakha ama-sidecar ohla lwemibhalo futhi leqe lawo asevele esesikhathini.
• Amaphrofayela emininingwane eminingi: Ukukhiqiza kusekela okukhiphayo kwe-brief, standard, kanye ne-rich.
• Ikhono le-agent: Ikhono elipakishiwe lifundisa ama-agent okubhala ikhodi ukuthi ahlole ama-sidecar aqinisekisiwe ngaphambi kokuhlaziya ividiyo.
• Ukukhiqiza kwasendaweni ngokuzikhethela: Indawo yokugcina izinto ihlanganisa umhlinzeki we---local wokukhiqiza ngemodeli yasendaweni ngaphandle kokhiye we-API.
• Ukuhlola ngokuzikhethela: I-CDAF ingasebenzisa i-ffprobe ukuthola imethadatha yobude, ukulungiswa, nezinga lamafreyimu, kuyilapho iqhubeka kahle lapho i-ffprobe ingatholakali.

Faka Ikhono Le-agent

Indlela esheshayo yokufundisa i-agent esekelwayo yokubhala ikhodi ukuhamba komsebenzi okuqala nge-sidecar yile:

npx cdaf-skill

Ngokuzenzakalela, lokhu kufaka ikhono ku-~/.claude/skills/cdaf, kwenze litholakale kuwo wonke amaphrojekthi. Ezinye izindlela zokulifaka ezisekelwayo zihlanganisa:

npx cdaf-skill --project
npx cdaf-skill --dir <path>
npx cdaf-skill --print

• --project ifaka ku-./.claude/skills/cdaf yephrojekthi yamanje.
• --dir ifaka enkombeni ekhethiwe.
• --print ibhala ikhono kokuphumayo okujwayelekile ukuze linamathiselwe kolunye uhlaka lwe-agent.

Ukuphinda usebenzise isifaki kuphephile. Ikhono elingashintshanga liyekwa linjalo, kanti ikhono elishintshiwe ligcinwa njengesipele ku-SKILL.md.bak ngaphambi kokushintshwa.

Ngaphambi kokuhlaziya ifayela levidiyo, bheka ifayela le-.cdaf elinegama eliyisisekelo elifanayo. Uma amanani e-bytes kanye ne-sha256 kanhlokweni ehambisana nevidiyo, lifunde esikhundleni sokucubungula ividiyo.

Faka I-CDAF CLI

I-CLI ye-Python idinga i-Python 3.10 noma entsha. I-README yamanje iyifaka ngokuqondile endaweni yokugcina izinto ngoba ukukhishwa kwe-PyPI kusesehlelweni lwesikhathi esizayo.

pip install "cdaf[generate] @ git+https://github.com/UditAkhourii/cdaf.git#subdirectory=cli"

Uma usebenza endaweni yokugcina izinto oyiklone, faka i-CLI enkombeni yendawo ye-cli:

pip install ./cli[generate]

Ukusetshenziswa kokukhiqiza kusebenzisa i-Gemini Files API. Thola ukhiye we-Gemini API ku-Google AI Studio, bese uwubeka endaweni yakho.

macOS ne-Linux

export GEMINI_API_KEY=your-key

Windows PowerShell

$env:GEMINI_API_KEY="your-key"

Izithombe zakho zicutshungulwa kusetshenziswa ukhiye wakho we-API. Imiyalo efunda noma eqinisekisa ama-sidecar akhona kuphela ayidingi ukhiye we-API noma okuncikayo komkhiqizi.

Khiqiza Ama-sidecar

Beka ividiyo eyodwa noma eziningi enkombeni bese usebenzisa i-cdaf generate kuleyo nkomba:

cdaf generate ./footage

I-CDAF ichaza amavidiyo bese idala ama-sidecar anamagama ayisisekelo afanayo. Uma iphinda isebenza, ukukhiqiza kweqa amavidiyo ama-sidecar awo asevele esesikhathini.

Khetha Iphrofayela Yemininingwane

Sebenzisa i---detail ukukhetha eyodwa kumaphrofayela amathathu okukhiqiza abhalwe kumadokhumenti:

cdaf generate ./footage --detail brief
cdaf generate ./footage --detail standard
cdaf generate ./footage --detail rich

Khetha iphrofayela ngokwezinga lomongo ochazayo odingwa yimisebenzi elandelayo. Ungaphinda ukhethe imodeli ye-Gemini ngo---model noma ucele ukukhiqizwa kabusha ngo---force.

cdaf generate ./footage --model <gemini-model>
cdaf generate ./footage --force

Hlola Isimo Somtapo Wezincwadi Wamavidiyo

Sebenzisa umyalo wesimo ukuze uhlukanise ama-sidecar abe FRESH, STALE, noma MISSING:

cdaf status ./footage

• FRESH: I-sidecar ihambisana nevidiyo yamanje.
• STALE: Kukhona i-sidecar, kodwa ubunikazi oburekhodiwe abusahambisani nevidiyo.
• MISSING: Ayikho i-sidecar ye-CDAF ehambisanayo etholakalayo.

Lo myalo awudingi ukhiye we-API noma okuncike kukho ekukhiqizeni, ngakho ufanele ukuhlolwa okulula emitapweni yezimpahla ekhona.

Funda Incazelo Eqinisekisiwe

Sebenzisa cdaf read uma ufuna umzimba we-sidecar we-agent, iskripthi, noma i-prompt:

cdaf read ./footage/sunset-drone.mp4

Umyalo uqinisekisa i-hash ngaphambi kokuphrinta incazelo. Wenqaba ukuphrinta i-sidecar endala, ngaleyo ndlela ugcine umthetho wokusha ngaphakathi kwethuluzi kunokuthembela kuphela emiyalweni ye-agent.

Qinisekisa Ama-Sidecar Ku-automation

Umyalo wokuqinisekisa uphuma ngempumelelo kuphela uma i-sidecar ehambisanayo ihlelwe kahle futhi isasha:

cdaf validate ./footage/clip.mp4

Ngenxa yokuthi umyalo uphuma ngesimo esingu-0 kuphela uma i-sidecar isemthethweni futhi isasha, ungasetshenziswa kumaskripthi noma ekugelezeni komsebenzi kwe-continuous integration. Ukuqinisekisa akudingi ukhiye we-API noma okuncike kukho okukhethekile kokukhiqiza.

Sebenzisa i-CDAF Ku-Python

I-API eyinhloko ye-Python ivumela izinhlelo zokusebenza ukuthi zithole, zilayishe, futhi ziqinisekise i-sidecar ngaphambi kokudlulisela umzimba wayo kumodeli yolimi.

from cdaf import load, check_freshness, sidecar_path_for

video = "footage/sunset-drone.mp4"
sidecar = load(sidecar_path_for(video))

if check_freshness(video, sidecar) == "fresh":
    context_for_llm = sidecar.body

Le phethini iwukuhlanganiswa okubalulekile kwe-CDAF: thola indlela elindelekile ye-sidecar, hlaziya ifayela, qinisekisa ukusha kwayo ngokuqhathanisa nevidiyo, bese usebenzisa sidecar.body kuphela lapho umphumela kungu-fresh.

Umnyombo wephakheji usekela nokwenza i-serialization, ukubalwa kwe-SHA-256 ngezingxenye, kanye nokukhipha amasegmenti. Le misebenzi isebenzisa umtapo wolwazi ojwayelekile kuphela. Ikhodi eqondene nomkhiqizi ilayishwa kuphela lapho kucelwa ukukhiqizwa.

Yakha Ukugeleza Komsebenzi Kwe-Agent Okubeka I-Sidecar Phambili

1. Thola indlela yevidiyo njengengxenye yomsebenzi wokuhlela, wokusesha, noma wokuphendula imibuzo.
2. Bheka ifayela elingu-.cdaf eline-basename efanayo.
3. Hlola ukusha kwe-sidecar uyiqhathanise nevidiyo yamanje.
4. Uma isha, funda umbhalo wayo esikhundleni sokuphinda wenze olunye uhlaziyo lokuqonda ividiyo.
5. Uma indala noma ingekho, yikhiqize kabusha ngaphambi kokuthembela kokuqukethwe kwayo.
6. Sebenzisa isifinyezo, amasegmenti, umbhalo okhulunyiwe, umbhalo osesikrinini, namathegi njengomongo womsebenzi olandelayo.

Ikhono le-agent elipakishiwe liphakamisa ukuhlolwa kosayizi okulula ngesikhathi sokuhlola kanye nokuhlolwa okuphelele kwe-hash ezinqumweni ezibalulekile. Izinhlelo zokusebenza kufanele zisebenzise izinga lokuqinisekisa elifanele umsebenzi, kuyilapho zigcina umthetho oyinhloko wokuthi izincazelo ezindala akumele zithembelwe.

Amathiphu Athuthukile

Sesha Amaqoqo Amavidiyo Njengombhalo

Uma amavidiyo esenama-sidecar, ama-agent namathuluzi omugqa womyalo angasesha amafayela e-.cdaf esikhundleni sokuvula yonke ividiyo. Amathegi nezincazelo zingenza izicelo ezifana nokuthi izithombe zokushona kwelanga ogwini ezingenabantu zibe wukubuyisa umbhalo emtatsheni wezimpahla.

Guqula Amasegmenti Abe Izinqumo Zokuhlela

Imigqa enezitembu zesikhathi efana no-[00:05.2-00:12.8] inikeza ububanzi abahleli bezinhlelo abangabuguqula bube iziqeshana noma ukulandelana. I-README iveza ngokuqondile i-Remotion, i-HyperFrames, namathuluzi e-prompt-to-edit njengokugeleza komsebenzi okungazuza kulesi sakhiwo.

Phinda Usebenzise Isikhathi Sombhalo Okhulunyiwe

Uma kukhona inkulumo, isigaba se-Transcript siqondanisa ingxoxo nomugqa wesikhathi. Ukugeleza komsebenzi wokuhlela kungaphinda kusebenzise lolo lwazi kumazwibela nasekuvumelaniseni umsindo, esikhundleni sokwenza olunye uhlaziyo lokuqonda.

Sebenzisa Imethadatha Ye-ffprobe Ongayikhetha

Uma i-ffprobe ikhona, ingxenye ye-CDAF yokuhlola ingaqoqa imethadatha yobude, ukulungiswa, namafreyimu ngomzuzwana. Injini iyaqhubeka kahle uma i-ffprobe ingekho, ngakho lokhu kuhlanganiswa kokuzikhethela akuvimbi imisebenzi eyisisekelo ye-sidecar.

Cabangela Ukukhiqiza Kwasendaweni

Inqolobane ihlanganisa umhlinzeki wasendaweni otholakala ngo---local. Yenzelwe ukukhiqiza ngemodeli yasendaweni lapho kungafanele kusetshenziswe ukhiye we-API. Bheka ukuqaliswa komhlinzeki wasendaweni enqolobaneni ukuze uthole ukusethwa kwemodeli yasendaweni okusekelwa njengamanje.

Gcina Ama-Backend Ehlukene Nefomethi

I-CDAF ngokwayo ayincikile kumodeli. I-Gemini ingumhlinzeki wokukhiqiza okukude ofakiwe, kuyilapho amanye ama-backend amamodeli evidiyo nolimi engasebenza ngaphansi kohlobo olufanayo lwe-Sidecar. Amanye ama-backend e-Claude, GPT, nama-VLM asendaweni afakwe ku-roadmap futhi akumele kucatshangwe ukuthi ayatholakala okwamanje.

Phinda Ukhiqize I-Benchmark

Inqolobane ihlanganisa i-benchmark enenhloso ekhiqiza amavidiyo kusuka kumaresiphi abhalwe kusengaphambili isebenzisa i-ffmpeg. Qalisa izigaba zayo ngokulandelana:

python benchmarks/bench.py make
python benchmarks/bench.py run
python benchmarks/bench.py report

Isinyathelo sokuqala sidinga i-ffmpeg, esesibili sidinga GEMINI_API_KEY, kanti isinyathelo sokugcina sibhala benchmarks/RESULTS.md. Ekuhlolweni okubikiwe kwemibuzo engu-20, izimpendulo ze-sidecar zithole izimpendulo eziyi-20 kwezingama-20 ezilungile uma ziqhathaniswa neziyi-19 kwezingama-20 zevidiyo eqondile, kuyilapho kusetshenziswa amathokheni e-prompt aphakathi nendawo angu-303 esikhundleni sika-3,066 embuzweni ngamunye. Lena imiphumela ye-benchmark evela ku-repository futhi ingahluka kuye ngezithombe zevidiyo, amamodeli, ama-prompt, nezindawo zokusebenza.

Imikhawulo Yamanje Nohlelo Lwentuthuko

I-README iveza izinto ezimbalwa njengomsebenzi wesikhathi esizayo kunokuba zibe ukusebenza kwamanje: ukukhishwa ku-PyPI, iseva ye-MCP, i-converter esingathwa, ama-generator backend engeziwe, i-port yenjini ye-Node noma ye-TypeScript, ukunwetshwa kwe-benchmark ngezithombe zemvelo, nama-sidecar asayiniwe. Sebenzisa ukufakwa kwe-Python okusekelwe ku-Git kanye ne-CLI ekhona namuhla, kunokuba ucabange ukuthi lezo zingxenye zohlelo lwentuthuko sezitholakala.

Isiphetho

I-CDAF iguqula ukuhlaziywa kwevidiyo okuphindaphindwayo kube inqubo yokuqinisekisa nokufunda. Khiqiza i-sidecar kanye, uyigcine eduze kwevidiyo yomthombo, uyiqinisekise njalo lapho i-asset isetshenziswa, bese unikeza ama-agent asezingeni elilandelayo umzimba wayo. Ama-hash efomethi avimbela ukusetshenziswa kabusha ngephutha ngemva kokuhlela, kanti izifinyezo zayo, izitembu zesikhathi, imibhalo ebhaliwe, umbhalo, namathegi kwenza imitapo yolwazi yamavidiyo kube lula ukuyicinga nokuyenza izenzele.

I-CDAF iyatholakala ngaphansi kwe-MIT License. Ikhodi yomthombo, imininingwane yefomethi, izibonelo, imininingwane ye-benchmark, kanye ne-agent skill kuyatholakala ku-CDAF GitHub repository.