Eleven Realtime Uyasebenza

I-Eleven Realtime iwuchungechunge lwamamodeli e-ejenti yezwi ahlanganisiwe olwenziwe yi-ElevenLabs, oluhlanganisa izinguqulo ezimbili: i-v1 Mini ne-v1 Max. I-Eleven Realtime ihlanganisa ukuqaphela inkulumo, ukucabanga kwemodeli yolimi, ukubiza amathuluzi kanye nokwenziwa kwenkulumo kube imodeli eyodwa, esikhundleni sendlela yendabuko yokuxhumanisa izingxenye eziningi. Isekela izilimi ezingaphezu kuka-90 namazwi angaphezu kuka-17,000. I-Mini igxile ezingxoxweni zemvelo ezibiza kancane, kanti i-Max yenzelwe imisebenzi eyinkimbinkimbi. Ukunemba kokucabanga kwenkulumo kufinyelela ku-98.8%, ukubambezeleka komsindo wokuqala kungamasekhondi angu-0.57 kuphela, futhi i-API iyahambisana nezinga le-OpenAI Realtime, okwenza kube lula kubathuthukisi ukuthuthela kuyo.

Ukuxhumana kwezwi okuhlanganisiwe: Ihlanganisa ukuqaphela inkulumo, ukucabanga kwe-LLM, ukubiza amathuluzi kanye nokwenziwa kwenkulumo kube imodeli eyodwa, ngaphandle kwesidingo sokwakha ngokwehlukana izingqalasizinda ze-ASR, VAD, LLM ne-TTS.
Ukusekelwa kwezilimi eziningi: Isekela izilimi ezingaphezu kuka-90, ilungele izinhlelo zezwi ezibhekiswe kubasebenzisi bomhlaba wonke.
Ukukhethwa okubanzi kwamazwi: Iyahambisana namazwi angaphezu kuka-17,000 akulabhulali yamazwi ye-ElevenLabs, futhi ungashintsha izwi ngokukhululekile.
Ukukhetha phakathi kwezinguqulo ezimbili: I-v1 Mini ilungele izingxoxo zemvelo ezibiza kancane, kanti i-v1 Max ilungele imisebenzi eyinkimbinkimbi.
Impendulo enokubambezeleka okuphansi: Ukubambezeleka komsindo wokuqala ngokwesilinganiso kungamasekhondi angu-0.57–0.62 kuphela. I-Max igcina ukunemba kokucabanga kwenkulumo okungu-98.8% futhi ishesha kakhulu.
Okuhlangenwe nakho kwengxoxo yemvelo: Ihl优化isa ukumiswa kwenkulumo, ukushintshana ngokukhuluma kanye nokuphathwa kokuphazamiseka. Itholela amaphuzu angaphezu kuka-94% ku-Full-Duplex-Bench.
Ikhono lokubiza amathuluzi: I-v1 Max inezinga lokuqeda imisebenzi ngokusebenzisa amathuluzi elingu-87.1%, futhi ingaxhuma ezinhlelweni zangaphandle ukuze yenze imisebenzi enezinyathelo eziningi.
Ukuhambisana ne-OpenAI API: Ilandela izinga le-OpenAI Realtime API. Abathuthukisi abanokuhlanganiswa okukhona bangathuthela kuyo ngokushintsha kuphela i-endpoint negama lemodeli.

Isakhiwo se-Speech-to-Speech esisuka ekuqaleni kuye ekugcineni: I-Eleven Realtime isebenzisa imodeli ye-end-to-end yokuguqula inkulumo ibe inkulumo. Umsindo womsebenzisi ungena ngqo kumodeli, yona iqede ukuqonda, ukucabanga nokwenza izinqumo ngaphakathi, bese ikhipha impendulo yezwi ngqo. Ayidluli esinyathelweni esicacile sokuguqula inkulumo ibe umbhalo phakathi nendawo, ngaleyo ndlela inciphise ukubambezeleka nokulahleka kolwazi phakathi kwezingxenye.
Ukucabanga nokubiza amathuluzi kwenziwa ngaphakathi kwemodeli eyodwa: Imodeli ngokwayo yenza umsebenzi wokucabanga wemodeli yolimi: iqonda inhloso yomsebenzisi, yenza ukucabanga ezingxoxweni ezinemijikelezo eminingi, inqume ukuthi ibize nini ithuluzi langaphandle, bese iqhubeka nokukhiqiza impendulo yezwi ngokusekelwe emiphumeleni yethuluzi. I-v1 Max yakhelwe ukuqinisa lolu chungechunge, futhi izinga layo lokuqeda imisebenzi ngokusebenzisa amathuluzi lingu-87.1%, liphakeme kakhulu kune-Mini enama-60.3%.
Indlela yangaphakathi yokuphatha ukuguquguquka kwengxoxo: Imodeli iphatha ngokwemvelo “izinqumo ezincane” zokuxhumana kwezwi: inquma ukuthi kufanele iqale nini ukukhuluma ngemva kokuma komsebenzisi, ukuthi imise futhi iqhubeke kanjani ngobunono lapho iphazanyiswa, nokuthi ikhiphe nini izimpawu zempendulo ezifana nokuthi “嗯” noma “对”. Lokhu kuqinisekiswa yizilinganiso ezifana ne-Full-Duplex-Bench, okwenza isigqi sengxoxo sifane nesomuntu wangempela.
Ukucabanga okusakazwayo okunciphisa ukubambezeleka: Imodeli isebenza ngendlela yokusakaza, iqonda futhi ikhiqize ngesikhathi esisodwa, ngaphandle kokulinda okokufaka okuphelele noma ukuhlelwa kokukhishwa konke. Ngakho ukubambezeleka komsindo wokuqala kulawulwa phakathi kwama-millisecond angu-570–620. Lokhu kuchaza ukuthi kungani i-Max isabela ngokushesha nakuba inokunemba okuphezulu.
Amakhono anikezwa nge-Realtime API esebenzisa i-WebSocket: Ngaphandle, inikeza ukusakazwa komsindo okubili ngesikhathi sangempela ngoxhumano olude lwe-WebSocket. Iphrothokholi iyahambisana nezinga le-OpenAI Realtime API, futhi abathuthukisi bangasebenzisa i-OpenAI SDK ukuze baxhume. Inkundla ephezulu ye-ElevenAgents yengeza iziteshi ezifana nocingo, iWebhu ne-WhatsApp, kanye nemisebenzi yebhizinisi efana nesizindalwazi solwazi, izivikelo nokuqapha.

Indlela yokuqala: Nge-ElevenAgents (kunconyiwe, ngaphandle kwekhodi) Ukubhalisa nokungena: Bhalisa i-akhawunti kuwebhusayithi ye-ElevenLabs bese ungena.
Dala i-Agent: Vula i-ElevenAgents, wakhe i-Agent entsha noma uvule ekhona.
Khetha imodeli: Kumenyu eyehlayo, khetha i-Realtime v1 Mini noma i-v1 Max.
Lungisa amakhono: Lungisa isizindalwazi solwazi, ukugeleza komsebenzi, izivikelo nezinye izinto ngokwezidingo.
Shicilela futhi uqalise: Xhuma iziteshi ezifana nocingo, iWebhu ne-WhatsApp. Inkundla inikeza ukuhlola nokuqapha okwakhelwe ngaphakathi, bese uyayiqalisa.
Indlela yesibili: Nge-Realtime API (abathuthukisi) Lungisa ukhiye: Thola i-API Key ku-console ye-ElevenLabs ukuze uqinisekise ukufinyelela.
Phinda usebenzise ikhodi ekhona: Uma usuvele uxhumeke ku-OpenAI Realtime API, shintsha kuphela ikheli le-WebSocket libe yi-wss://api.elevenlabs.io/v1/convai/realtime bese ushintsha igama lemodeli.
Cacisa imodeli nezwi: Isibonelo, setha i-eleven_realtime_v1_mini bese ukhetha izwi elifana no-brian.
Yakha uxhumano lwe-WebSocket: Sebenzisa i-RealtimeAgent + WebSocket transport ye-OpenAI SDK ukuze wakhe ukusakazwa komsindo okubili.
Qala ingxoxo: Ngemva kokuxhuma ngempumelelo, ungaqala ukuxhumana kwezwi ngesikhathi sangempela. Uma udinga amakhono enkundla afana neziteshi nesizindalwazi solwazi, kufanele usebenzise i-ElevenAgents.

Isakhiwo esihlanganisiwe: Ihlanganisa ukuqaphela inkulumo, ukucabanga, ukubiza amathuluzi kanye nokwenziwa kwenkulumo kube imodeli eyodwa, isuse izindleko zokukhetha nokuhlanganisa izingxenye eziningi.
Ukweqa ukuhwebelana phakathi kwejubane nokunemba: I-v1 Max ifinyelela ukunemba kokucabanga kwenkulumo okungu-98.8% kanye nokubambezeleka komsindo wokuqala okungamasekhondi angu-0.57, ihlanganise ukunemba okuphezulu nokubambezeleka okuphansi.
Okuhlangenwe nakho kwengxoxo yemvelo: Itholile amaphuzu angaphezu kuka-94% ku-Full-Duplex-Bench, futhi imininingwane efana nokuphendula ngemva kokuma, ukuqhubeka ngemva kokuphazanyiswa nokushintshana ngokukhuluma isezingeni elisondelene nelomuntu.
Ikhono elinamandla emisebenzini eyinkimbinkimbi: I-v1 Max inezinga lokuqeda imisebenzi yokubiza amathuluzi elingu-87.1%, ingenza ukugeleza komsebenzi okunezinyathelo eziningi futhi ilungele izimo zebhizinisi.
Ukufakwa okubanzi kwezilimi namazwi: Isekela izilimi ezingaphezu kuka-90 namazwi angaphezu kuka-17,000, ukuze uhlelo olulodwa lusebenzele abasebenzisi bomhlaba wonke.
Ukuthuthela kalula: I-API iyahambisana nezinga le-OpenAI Realtime, ngakho abathuthukisi abanokuhlanganiswa okukhona bangashintsha ngokuhlela imigqa emibili kuphela yekhodi.
Ukukhetha okuguquguqukayo phakathi kwezinguqulo ezimbili: I-Mini ihlanganisa izimo eziningi zezingxoxo zansuku zonke ngezindleko eziphansi, kanti i-Max igxile ekucabangeni okuyinkimbinkimbi, okukuvumela ukuthi ulawule izindleko ngokwezidingo.
Ilungele ukukhiqizwa kusukela ekuqaleni: Nge-ElevenAgents ungathola ngokuqondile amakhono aphelele okuthunyelwa, okuhlanganisa ukuxhumeka kweziteshi, isizindalwazi solwazi, izivikelo, ukuhlola nokuqapha.

Iwebhusayithi yephrojekthi: https://elevenlabs.io/blog/realtime

Abasizi bezwi be-AI: Abasizi bomuntu siqu bezingxoxo zansuku zonke abaqonda imiyalo futhi baphendule ngokushesha ngezwi lemvelo. Inguqulo ye-Mini ingenza lokhu ngezindleko eziphansi.
Imfundo eku-inthanethi/ukufunda izilimi: Isibonelo, uhlelo lokufunda isiNgisi lwezingane lapho umlingiswa kufanele aqonde inkulumo yomfundi, alungise amaphutha ngesikhathi futhi axhumane ngezwi lemvelo. Lokhu kudinga izinga eliphezulu lemvelo yephimbo nesivinini sokuphendula.
Insizakalo yamakhasimende yocingo yamabhizinisi: Iphatha izicelo ezinezinyathelo eziningi ezifana nokuthi “hlola i-oda” noma “shintsha ikheli” ezidinga ukubiza izinhlelo zebhizinisi. Izinga eliphezulu le-Max lokuqeda imisebenzi ngokusebenzisa amathuluzi liyilungele lezi zimo.
Ukuhlunga imikhondo yokuthengisa: Ishaya noma yamukela izingcingo ezizenzakalelayo ezivela kumakhasimende angaba khona, inqume intshisekelo ngengxoxo, iqoqe ulwazi futhi ilurekhode. I-Max ingacabanga futhi yenze ngokohlelo.
Abalingiswa abangokoqobo/ama-NPC emidlalweni: Inikeza abalingiswa abasebenzisanayo ikhono lengxoxo yezwi ngesikhathi sangempela. Isekela izilimi ezingaphezu kuka-90 namazwi amaningi, ilungele okuqukethwe komhlaba wonke nokuhlangenwe nakho okugxilisa umsebenzisi.