Spark-ASR-2.0 Uyasebenza

I-Spark-ASR-2.0 iyimodeli yakamuva ye-iFlytek enkulu yokuqaphela inkulumo, eyakhelwe phezu kwemodeli eyisisekelo yenkulumo i-Spark-Audio ye-Spark. Imodeli isebenzisa ukwakheka okuhlangene kwe-”non-autoregressive + autoregressive ethuthukiswe yi-LLM”, okwenza kuqapheleke isiShayina nesiNgisi esixubile, izilimi zesifunda, amagama ochwepheshe, umsindo omkhulu nevolumu ephansi nezinye izimo eziyinkimbinkimbi. Imiphumela yayo idlula izinga elihamba phambili embonini, kanti izindleko zokuqagela zikhuphuka ngo-10% kuphela. Imodeli ingasusa ngokuzenzakalela amagama okugcwalisa, ingeze izimpawu zokubhala futhi yenze ulimi lube sezingeni. Seyitholakala ku-iFlytek Input Method futhi i-API yayo ivuliwe; ngokuhamba kwesikhathi izosetshenziswa ezingilazini ze-AI, kumadivayisi asehhovisi nakwezinye iziphetho.

Ukuqaphela isiShayina nesiNgisi esixubile: Ukuqaphela okunembile ezimweni eziyinkimbinkimbi zokukhuluma izilimi zixubene, ngaphandle kokushintsha izilungiselelo.
Ukuqaphela izilimi zesifunda ngaphandle kokushintsha: Kusekela izilimi zesifunda zamadolobha angu-202 ezweni lonke, kuguqule inkulumo ngokunembile.
Ukuqaphela amagama ochwepheshe: Ikhono lokuqaphela amagama anzima kwezokwelapha, amakhemikhali, ezobuchwepheshe nakwezinye izinkambu lithuthuke kakhulu.
Ukuqaphela ezimweni eziyinkimbinkimbi zomsindo: Kusebenza kahle kakhulu emsindweni omkhulu, evolumeni ephansi, ekukhulumeni okusheshayo nasenkulumweni yezingane, kudlule izinga elihamba phambili embonini.
Ukuqaphela umongo: Kuhlanganisa umlando wokuqaphela, amarekhodi okulungisa namagama adumile ukuze kuxazululwe amagama anomsindo ofanayo nokungaqondakali kwencazelo.
Ukuhlelwa kombhalo ube bushelelezi futhi ube sezingeni: Kususa ngokuzenzakalela okuphindaphindiwe, kususe amagama okugcwalisa, kufake izimpawu zokubhala futhi kulungise izinombolo, izimpawu namayunithi, ukuze ”inkulumo iphenduke umbhalo ogcwele”.

Ukwakhiwa okuhlangene kwe-non-autoregressive ne-autoregressive ethuthukiswe yi-LLM: Kuqhubeka nendlela ye-non-autoregressive ye-Spark-ASR-1.0, kukhiphe ngokuhambisana lonke uchungechunge lombhalo ngesikhathi esisodwa ukuze kuqinisekiswe ukusebenza kahle kokuqagela; ngesikhathi esifanayo kwethula ukuqaphela kwe-autoregressive okuthuthukiswe yi-LLM. Lezi zindlela zombili zisebenza ndawonye ukuthuthukisa ukunemba okuphelele nekhono lokuqonda ulimi.
Ukuqiniswa okuhlangene kombhalo nenkulumo yesiShayina nesiNgisi esixubile: Umbhalo nomsindo kwenziwa amamodeli futhi kuqiniswa ngokwehlukana, bese kwenziwa ukuthuthukiswa okuhlangene, okuthuthukisa kakhulu imiphumela ezimweni ezijwayelekile zokuqaphela ezifana nesiShayina nesiNgisi esixubile, izilimi zesifunda namagama ochwepheshe.
Ukufakwa komongo oguqukayo: Ngesikhathi sokuqaphela, kuhlanganiswa ngesikhathi sangempela okuqukethwe komlando wokuqaphela komsebenzisi, amarekhodi okulungisa kanye namagama adumile aqondene naye, bese kuqondwa kusetshenziswa umongo wemisho elandelanayo ukuze kuncishiswe ngempumelelo ukuphambuka okubangelwa ukuphimisela okudidayo namagama afanayo.
Ukuqhubeka kwamakhono emodeli eyisisekelo yenkulumo: Uhlelo lonke lwakhiwe phezu kwe-Spark-Audio-1.0-Preview, luzuza inzuzo yalo yokuqaphela izimo eziyinkimbinkimbi zomsindo, bese lwenziwa ukuthuthukiswa okukhethekile kokunemba nokuhleleka kombhalo.

Indlela yokuqala: Ukuyizama ku-inthanethi
Indlela yesibili: I-iFlytek Input Method
Indlela yesithathu: Ukuhlanganisa nge-API (onjiniyela)
Vula ikhasi lokuyizama: Vakashela https://iflytekresearch.iflytek.com/experience/spark-asr
Faka noma uqophe inkulumo: Khuluma ngqo ekhasini noma ulayishe umsindo ukuze ubone imiphumela yokuqaphela ngesikhathi sangempela.
Landa i-iFlytek Input Method: Skena ikhodi noma uyifake esitolo sezinhlelo zokusebenza ukuze uthole inguqulo yakamuva ye-iFlytek Input Method.
Shintshela ekufakeni ngezwi: Esikrinini sokufaka, chofoza isithonjana semakrofoni bese ucindezela isikhathi eside ukhulume ukuze usebenzise i-Spark-ASR-2.0 ukuqaphela.
Vakashela inkundla evulekile: Ngena ku-iFlytek Open Platform https://www.xfyun.cn/services/spark_asr_zh_en_v2.0
Dala uhlelo lokusebenza uthole okhiye: Ngemva kokubhalisa uhlelo lokusebenza, thola i-AppID, i-APIKey nolunye ulwazi lokuqinisekisa.
Biza isevisi ye-API: Dlulisa umsindo ngokwemibhalo yesixhumi esibonakalayo ukuze uhlanganise amandla okuqaphela ohlelweni lwakho.

Imiphumela yokuqaphela ihamba phambili embonini: Ezilimini zesifunda, emisindweni emikhulu nasevolumeni ephansi, idlula izinga elingcono kakhulu lamanje embonini, kanti i-WER yehliswe kakhulu.
Izindleko zokuqagela ziphansi kakhulu: Ngenkathi imiphumela ithuthuka kakhulu, izindleko zokuqagela zikhuphuka ngo-10% kuphela uma ziqhathaniswa ne-1.0.
Ukwakhiwa kwe-non-autoregressive okusebenza kahle: Ikhipha uchungechunge lombhalo ngokuhambisana ngesikhathi esisodwa, ihlanganise ukunemba okuphezulu nokusebenza kahle kokuqagela.
Ukumbozwa okuphelele kwezimo eziyinkimbinkimbi: IsiShayina nesiNgisi esixubile, izilimi zesifunda zamadolobha angu-202 ngaphandle kokushintsha, amagama ochwepheshe, inkulumo esheshayo nenkulumo yezingane konke kuqapheleka ngokunembile.
Ukuqonda umongo okuqinile: Kuhlanganisa umlando wokuqaphela namagama adumile ukuze kuxazululwe ukungaqondakali ngesikhathi sangempela, kuphathwe ngokunembile amagama anomsindo ofanayo namagama afanayo.
Ukukhipha umbhalo oshelelayo: Kususa ngokuzenzakalela amagama okugcwalisa, kufake izimpawu zokubhala futhi kulungise izinombolo nezimpawu, kukhiphe ngokuqondile umbhalo osemthethweni ohlelekile futhi oxhumene.

Ukufaka ngomakhalekhukhwini: Thayipha ngezwi ku-iFlytek Input Method; khuluma isiShayina nesiNgisi kuxubene noma usebenzise ulimi lwesifunda ngokukhululekile, bese umbhalo uzenzela ”inkulumo egcwele” futhi ungathunyelwa ngqo.
Amarekhodi emihlangano: I-Office Book/iFlytek Hear ibhala phansi okuqukethwe komhlangano ngesikhathi sangempela; ngisho nasegunjini lomhlangano elinomsindo omkhulu, iqaphela ngokunembile futhi ilungise umbhalo ube sezingeni.
Amarekhodi emikhakheni yobungcweti: Irekhoda izinkulumo nezingxoxo zezokwelapha, amakhemikhali nezobuchwepheshe, futhi ibhala ngokunembile amagama ayinkimbinkimbi.
Ukuxhumana nehadiwe ehlakaniphile: Iqaphela imiyalo yezwi nezingxoxo ezingilazini ze-iFlytek AI, emishinini yokuhumusha nakwamanye amadivayisi, isebenze ngokuzinzile ezindaweni ezinevolumu ephansi.
Ukuhlanganiswa kwebhizinisi konjiniyela: Nge-API ye-Open Platform, inikeza isisekelo sokuqaphela esinokunemba okuphezulu nezindleko eziphansi ezinhlelweni zebhizinisi ezifana nesevisi yamakhasimende, ukwakha imibhalo engezansi nokufaka ngezwi.