DiffRhythm Uyasebenza

I-DiffRhythm iyimodeli ye-AI yokukhiqiza izingoma eyakhiwe yi-ASLP Laboratory yaseNorthwestern Polytechnical University. Isebenzisa amagama engoma nemiyalo yesitayela njengedatha yokudala, bese ikhiqiza ingoma ephelele equkethe izwi lomculi nokuphelezelwa komculo.

Leli thuluzi lisebenzisa imodeli yokusabalalisa efihlekile futhi linikeza amamodeli avulekile nekhodi ye-inference. Lingasetshenziselwa ukuzama ukudala umculo, futhi lingaba yisisekelo socwaningo nokuthuthukiswa okuqhubekayo.

Abasebenzisi bangafaka amagama engoma futhi baqondise ukukhiqizwa kwengoma ngemiyalo yesitayela efana nokuthi “pop” noma “folk”. Ithuluzi lisekela izingoma zesiShayina nesiNgisi, futhi lingakhiqiza ngesikhathi esisodwa umsindo ophelele onezwi lomculi nokuphelezelwa komculo, onesikhathi esiphezulu esicishe sibe yimizuzu engu-4 nemizuzwana engu-45.

Ngokwemininingwane etholakalayo, ukukhiqizwa okukodwa kuvame ukuthatha cishe imizuzwana engu-10. Umphumela othile uncike emagameni engoma afakiwe, encazelweni yesitayela kanye nendawo esebenza kuyo.

Abakhiqizi bomculo bangayisebenzisa ukuhlola ngokushesha izibonelo zezingoma, nokusiza ekuhleleni indlela yomculo nokuhlelwa kwezinsimbi. Abadali bamavidiyo amafushane nabanye abadali bokuqukethwe bangayisebenzisa ukwenza okusalungiswa komculo wangemuva.

Abathuthukisi nabacwaningi abanentshisekelo kumsindo we-AI bangasebenzisa amamodeli avulekile nekhodi ye-inference ukwenza ucwaningo noma ukuthuthukisa kabusha. Abathandi bomculo bona bangaqala ngamagama engoma nemiyalo yesitayela bazame ukukhiqiza izingoma eziphelele.

I-DiffRhythm ifanele kakhulu ukuhlola imibono, ukwenza izibonelo zezingoma kanye nokukhiqiza umsindo kokuqala. Nakuba izingoma ezikhiqiziwe ziqukethe izwi lomculi nokuphelezelwa komculo, lokho akusho ukuthi zingahlangabezana ngokuqondile nazo zonke izidingo zokushicilela noma zokukhiqiza. Umsebenzisi kusafanele ahlole ikhwalithi yomsindo, indlela yokucula, ukucaca kwamagama engoma kanye nesitayela sonke, bese enza ukucubungula kwangemva kwalokho.

Imibhalo yephrojekthi ayichazi imigomo ethile yokusetshenziswa kwezohwebo, indlela yokubuyekeza okuqukethwe okukhiqiziwe noma izidingo zezinsiza ezindaweni ezihlukene zokusebenza. Ngaphambi kokusetshenziswa okusemthethweni, kufanele uqinisekise le mithetho ngokwakho.