Ukukhiqiza umculo nge-AI
Ithegi yethuluzi le-AIEZZ
Ubheka imikhiqizo ye-AI enethegi ethi “Ukukhiqiza umculo nge-AI”, enemiphumela efanayo engu-14.
MusicFXAmathuluzi omsindo e-AII-MusicFX iyithuluzi lokuhlola lomsindo le-AI elivela ku-Google AI Lab. Lisekelwe ku-MusicLM futhi liguqula izincazelo zombhalo zesitayela, imizwa noma indawo zibe izingcezu zomculo. Abasebenzisi bafaka imiyalelo bese bekhiqiza umphumela, noma basebenzise imodi ye-DJ ukwengeza imiyalelo eminingi ngesikhathi esisodwa futhi balungise isisindo sokuhlanganiswa kwezincazelo ezahlukene ngesikhathi sangempela. Ithuluzi lisekela ubude obufika kumasekhondi angu-70 nokudlalwa okuphindaphindiwe, okulenza lifanele abadali bokuqukethwe, abathandi bomculo, o-DJ nabathuthukisi ekufuneni ugqozi, ekwenzeni okusalungiswa komculo ongemuva nasekuhloleni imiqondo. Qaphela ukuthi ligxile kakhulu ekukhiqizeni izingcezu; ubude obufushane bemiphumela nokuma kwalo njengethuluzi lokuhlola kusho ukuthi alikwazi ukuthatha indawo yokuhlela umculo okuphelele, ukukhiqiza nokucutshungulwa kokugcina. Ukusetshenziswa kwangempela kokuqukethwe okukhiqiziwe kusafanele kubuyekezwe ngokuya ngesimo esithile.038.5
Lyria2Amathuluzi omsindo e-AII-Lyria2 iyimodeli yokukhiqiza umculo ye-AI eyethulwe yi-Google DeepMind, eyenzelwe abakhiqizi bomculo, abaqambi, abathuthukisi, abadali bokuqukethwe nabathandi bomculo. Abasebenzisi bangafaka amagama engoma noma imiyalelo yombhalo, balungise ijubane, ukhiye, izinsimbi, imizwa kanye nezakhiwo ezifana ne-Intro ne-Outro, bese bekhiqiza izingoma ezinezinsimbi nezwi; abathuthukisi bangasebenzisa i-Lyria RealTime API ukuze bakhiqize ukusakazwa komculo okuqhubekayo. Umsindo okhiqiziwe ungu-48kHz stereo futhi ufaka uphawu lwamanzi lwe-SynthID. Ilungele ukuhlola imibono, ukwenza amademo ezingoma, umculo ohambisana namavidiyo nokwakha ama-prototype ezinhlelo zokusebenza, kodwa imiphumela ekhiqiziwe isadinga ukuhlolwa komuntu nokulungiswa kwangemva kokukhiqiza, ikakhulukazi ekusetshenzisweni kwamagama, emininingwaneni yokuhlela umculo nasemiphumeleni yezwi.047.7
TopMediaiAmathuluzi omsindo e-AII-TopMediai iyithuluzi lomsindo le-AI elisetshenziswa kakhulu ukuguqula umbhalo ube yinkulumo, ukukhiqiza umculo, ukukopisha izwi nokwenza izinguqulo zezingoma nge-AI, futhi linamakhono ahlobene nokukhiqizwa kwamavidiyo. Abasebenzisi bangaqala embhalweni, emagameni engoma noma encazelweni yokudala, bakhethe imiphumela yezwi noma yomculo, bese bekhiqiza amazwi aqoshiwe, izingoma nezinye izinto zemidiya. Le nkundla iqondiswe kubadali bamavidiyo, abathuthukisi bemidlalo, ochwepheshe bezokumaketha, abakhiqizi bamaphodikasti nabasebenzi bezemfundo, phakathi kwabanye. Ulwazi lukhombisa ukuthi isekela ukusetshenziswa kwamahhala nokukhokhelwayo, futhi isasebenza. Imiphumela yokugcina isadinga ukuhlolwa umuntu ukuze kuqinisekiswe ukuphimisela, imizwa nokufaneleka kokuqukethwe; uma kuhileleke ukukopishwa kwezwi, izinguqulo zezingoma noma ukushicilelwa, kufanele kuqinisekiswe nezimvume ezifanele.028
DiffRhythmAmathuluzi omsindo e-AII-DiffRhythm iyimodeli ye-AI yokukhiqiza izingoma eyakhiwe yi-ASLP Laboratory yaseNorthwestern Polytechnical University. Isebenzisa imodeli yokusabalalisa efihlekile, futhi ihloselwe abadali nabathuthukisi abadinga ukwenza ngokushesha izibonelo zezingoma, umculo wangemuva noma ucwaningo lwamamodeli. Ngemva kokufaka amagama engoma nomyalo wesitayela, ithuluzi lingakhiqiza ingoma ephelele enezwi lomculi kanye nokuphelezelwa komculo. Isikhathi esiphezulu sokukhiqiza ngesikhathi esisodwa cishe siyimizuzu engu-4 nemizuzwana engu-45, futhi lisekela izingoma zesiShayina nesiNgisi. Le phrojekthi inikeza amamodeli avulekile nekhodi yokwenza inference, ngakho ilungele ukuzama, ucwaningo kanye nokuthuthukiswa okuqhubekayo. Imiphumela ekhiqiziwe isengadinga ukukhethwa, ukulungiswa noma ukukhiqizwa kwangemva komuntu, futhi umphumela wangempela uthonywa amagama engoma nemiyalo yesitayela.018.5
MuseNetAmathuluzi omsindo e-AIIMuseNet iyimodeli ye-AI yokukhiqiza umculo eyethulwe yi-OpenAI. Isekelwe esakhiweni se-Transformer futhi ifunda inani elikhulu lamafayela omculo e-MIDI ukuze ikhiqize izingoma ezinezinguquko zokuvumelana, isigqi nesitayela. Abasebenzisi bangalalela izingoma ezihlanganiswe ngaphambilini kwimodi elula, noma baqale ngenothi elilodwa kwimodi ethuthukisiwe bese beqondisa imodeli kancane kancane ukuze iqedele izingcezu zomculo. Ithuluzi lisekela ukulingisa nokuhlanganisa izitayela eziningi zakudala, ezidumile nezivamile, futhi lingacacisa umculo ohlanganisa izinsimbi ezingafika kwezi-10. Lifanele abaqambi bomculo, ababhali bomculo wamafilimu, othisha, abacwaningi nabathandi bomculo ekufuneni ugqozi, ekusizeni ukuhlela umculo, ekuboniseni izifundo nasekwakheni izinguqulo zokuqala zomculo ongemuva. Okuqukethwe okukhiqiziwe kusadinga ukukhethwa nokulungiswa ngumuntu, futhi akukwazi ukuthatha indawo yenqubo ephelele yokuqamba, ukuhlela nokuqopha umculo.048.1
SoundfulAmathuluzi omsindo e-AII-Soundful iyithuluzi lomsindo elisebenzisa ubuhlakani bokwenziwa, elihlanganisa ukukhiqizwa komculo nomtapo womculo ukuze linikeze abasebenzisi izinto zomculo ongemuva. Abasebenzisi bangakhetha uhlobo lomculo, isigqi, umuzwa noma indikimba kuqala, bese bekhiqiza izingoma futhi bazilande noma baqhubeke nokuzihlela ngokwezidingo zabo; le nkundla iphinde ibe nomculo owenziwe ngobuhlakani bokwenziwa owabiwe abadali bomculo. Okuqukethwe kuhlanganisa izitayela ezifana ne-EDM, Deep House ne-Hip Hop, futhi kulungele abadali bokuqukethwe, abakhiqizi bomculo, amabhrendi namabhizinisi kanye nabathandi abazimele, ukuze kusetshenziswe kumavidiyo, amaphodikasti, ukusakaza bukhoma, izikhangiso, imidlalo noma imisebenzi yomuntu siqu. Ezinye izinhlelo zisekela ukulandwa komsindo nge-MP3, WAV nezinye, kanye namakhono okuqhubeka nokukhiqiza afana namathrekhi ahlukanisiwe e-STEM namafayela e-MIDI. Le nkundla inikeza izindlela zamahhala nezikhokhelwayo; izimvume zokulanda nezici ezitholakalayo zingahluka kuye ngohlelo, ngakho kufanele kuqinisekiswe imigomo yelayisensi efanele ngaphambi kokusetshenziswa okusemthethweni kwezohwebo.058
ecrett musicAmathuluzi omsindo e-AII-ecrett music iyithuluzi lomsindo le-AI labadali bokuqukethwe, elisetshenziswa kakhulu ukukhiqiza umculo ongemuva wamavidiyo, imidlalo, amaphodikasti, izikhangiso namaphrojekthi amafilimu azimele. Umsebenzisi uqala ngokukhetha isimo, umuzwa nohlobo lomculo, bese uhlelo lukhiqiza umculo; ngemva kwalokho angalungisa izinsimbi nokwakheka komculo, alayishe ividiyo ukuze abuke ukuthi umculo uhambisana kanjani nezithombe, bese ekugcineni elanda umsindo we-WAV. Lufanele abadali ngabanye namaqembu amancane abangenawo amakhono okuqamba umculo kodwa abadinga ukuqeda ngokushesha uhlaka lokuqala lomculo ohambisana nephrojekthi. Luphinde lunikeze ngezintandokazi nomlando wokudala ukusiza ukuhlela izinto zomculo. Umkhiqizo unezinhlelo zamahhala nezikhokhelwayo. Ulwazi olusekhasini luchaza umculo okhiqiziwe njengongadingi mali yelayisensi, kodwa ububanzi bokusetshenziswa kwezentengiso, imigomo yelayisensi nemikhawulo yokulanda kusafanele kuqinisekiswe ngemithetho yesevisi esebenzayo manje.018.2
Mix AudioAmathuluzi omsindo e-AII-Mix Audio iyithuluzi lomsindo le-AI elenzelwe abadali bomculo, abasakazi bamaphodikasti, abaqalayo emsindweni kanye nothisha, lihlanganisa ukuxuba okuzenzakalelayo, ukuhlela umsindo nokukhiqiza umculo. Abasebenzisi bangangenisa noma banikeze izinto ezifana nombhalo, izithombe nomsindo, basebenzise i-AI ukulungisa ivolumu, i-equalizer, ukucindezela okuguquguqukayo nemiphumela, noma bakhiqize umculo ongemuva nemisebenzi exutshwe kabusha, bese beyicubungula ngokuqhubekayo besebenzisa ama-preset. Ithuluzi liphinde lisekele ukusebenzisana kwabantu abaningi ku-inthanethi, lilungele ukudala komuntu siqu, ukukhiqizwa kokuqukethwe nokufundisa ngomsindo. Kukhona izinketho zamahhala nezikhokhelwayo, kodwa imiphumela yokucubungula okuzenzakalelayo kusafanele ilalelwe futhi ilungiswe ngokusekelwe ezintweni ezithile.038.5
boomyAmathuluzi omsindo e-AII-boomy iyithuluzi lokukhiqiza umculo nge-AI elinezindlela zamahhala nezikhokhelwayo, elenzelwe abasebenzisi abajwayelekile abangenalo ulwazi lwethiyori yomculo, abadali bokuqukethwe, abaculi abazimele nabathuthukisi bemidlalo. Umsebenzisi uqala ngokukhetha isitayela somculo, bese uhlelo lukhiqiza ingoma. Ngemva kwalokho angalungisa izigqi zezigubhu, ibhesi, imiculo, ijubane nesakhiwo, futhi angeze izwi elirekhodiwe noma elilayishiwe. Uma isiqediwe, ingoma ingasatshalaliswa ngeplathifomu iye ezinsizeni zokusakaza ezifana ne-Spotify ne-Apple Music. Ilungele ukudala umculo wangemuva, okusalungiswa kwemibono noma izingoma zomuntu siqu ngokushesha, kodwa imiphumela ekhiqiziwe isadinga ukulalelwa nokuhlelwa ngumuntu. Ukufaneleka kokusabalalisa, ububanzi bamalayisensi nemithetho yemali engenayo kufanele kuqinisekiswe ngokwemigomo yezinsizakalo ezifanele.027.4
MusicLMAmathuluzi omsindo e-AII-MusicLM iyimodeli yobuhlakani bokwenziwa egxile ekukhiqizeni umculo. Ikhiqiza kakhulu umculo ohambisana nesimo, imizwa nesitayela ngokusekelwe encazelweni yombhalo, futhi isekela nokuhlela kabusha umculo ngesitayela esithile kusetshenziswa imiculo ehonywayo, eshayelwayo ngekhwela noma edlalwayo. Umsebenzisi angaqala ngokufaka isihloko somculo, indlela yokuhlela izinsimbi noma izidingo zokushintsha ngokuhamba kwesikhathi, bese ethola okusalungiswa komsindo okufanele ukucabanga ngobuciko, ukuhlola umculo wangemuva kanye nokuhlolwa kocwaningo. Izinto ezishicilelwe ngale modeli ziphinde zethule imodi yezindaba, ukukhiqizwa kwesikhathi eside kanye nedathasethi ye-MusicCaps. Ekusetshenzisweni kwangempela, imininingwane, ukwakheka nokusebenziseka kwemiphumela ekhiqiziwe kusadinga ukuhlungwa ngumuntu, futhi amalungelo okusebenzisa izinto kanye nobubanzi bokusetshenziswa kwezentengiselwano kufanele kuqinisekiswe ngokwehlukana.028
AI-songAmathuluzi omsindo e-AII-AI-song iyithuluzi lomsindo elisebenzisa i-AI, elenzelwe ikakhulukazi ukuguqula izincazelo ezimfushane, amagama ezingoma noma izinhloso zokudala umculo wezinsimbi zibe izingoma. Ngemva kokufaka umbhalo noma amagama engoma, abasebenzisi bangakhetha izitayela ezifana ne-pop, i-rock, i-classical ne-electronic, bakhiqize umsindo ophelele ongafika cishe emizuzwini emithathu, bese bewukhipha ngefomethi ye-MP3. Ifanele abadali bamavidiyo amafushane, abathuthukisi bemidlalo abazimele, abakhiqizi bama-podcast nabathandi bomculo abangenalo ulwazi lwethiyori yomculo noma lokuhlela umculo, ukuze benze umculo wangemuva, umculo wokuqala nowokuphetha noma imisebenzi yabo. Isivinini sokukhiqiza nekhwalithi yomphumela kuncike kokuqukethwe okufakiwe nasezilungiselelweni zesitayela. Ngaphambi kokuwusebenzisa kumaphrojekthi asemthethweni, kusadingeka ulalele, ulungise futhi uqinisekise imigomo yamanje yelayisensi.047.4
Musicfy AIAmathuluzi omsindo e-AII-Musicfy AI iyithuluzi lomsindo le-AI elenzelwe ukwakha umculo nokukhiqiza okuqukethwe komsindo. Abasebenzisi bangalayisha amasampula ezwi, bakhe imodeli yabo yezwi ye-AI, bese beyisebenzisa ekuguquleni izwi nasekuculeni kabusha izingoma; bangaphinda bakhiqize umculo onomculo oyinhloko nokuphelezelwa ngokusebenzisa umbhalo noma incazelo yemizwa, futhi baguqule ukuhumming kwezwi kube umsindo wensimbi yomculo. Inkundla iphinde inikeze ngomtapo wabaculi be-AI nowempahla yokudala, futhi ifanele abakhiqizi bomculo, abadali bokuqukethwe, abasebenzisi bezinkundla zokuxhumana kanye nabantu abafuna ukuzama ukwakha umculo. Yenza kube lula ukuhamba kusukela emqondweni kuye ohlakeni lomsindo, kodwa ngaphambi kokusebenzisa izwi lomunye umuntu noma ukushicilela okuqukethwe okukhiqiziwe, abasebenzisi kusafanele baqinisekise izimvume ezifanele nemithetho yenkundla.018.4
LitMediaAmathuluzi evidiyo ye-AII-LitMedia yethulwe yi-CLEVERGUARD TECHNOLOGY CO., LIMITED, futhi inikeza amathuluzi okudala e-AI amavidiyo, izithombe, umculo, ama-avatar nemiphumela ekhethekile okuqondiswe kokuqukethwe kwezinkundla zokuxhumana, ukumaketha kwamabhrendi namaphrojekthi ezindaba. Abasebenzisi bangakha izinhlobo ezahlukene zokuqukethwe kwemidiya endaweni eyodwa ngewebhusayithi esemthethweni, futhi basebenzise izifundo zezisho zokuthuthukisa ukulawula kokudala amavidiyo.058.2
Mubert AIAmathuluzi omsindo e-AII-Mubert AI iyithuluzi lomsindo elisebenzisa i-AI, ikakhulukazi ukukhiqiza umculo ongemuva ngokusekelwe emiyalweni yombhalo, emizweni, esitayeleni, esimweni noma ebudeni besikhathi. Abadali bokuqukethwe bangayisebenzisa emavidiyweni, kumaphodikasti nakweminye imisebenzi, kuyilapho onjiniyela nemikhiqizo bengahlola umculo oguquguqukayo nge-API. Abaculi bangalayisha izinto zomculo ku-Mubert Studio. Inkundla iphinde inikeze ngamapulagi asebenza nezinhlelo ezifana ne-Adobe Premiere Pro ne-Adobe After Effects, ukuze ihambisane nezinye izinqubo zokudala. Ngesikhathi sokusebenzisa, imiyalelo nobude besikhathi kufanele kulungiswe ngokwezidingo zephrojekthi; ububanzi belayisensi kufanele buqinisekiswe ngokohlelo olukhethiwe nendawo okuzoshicilelwa kuyo.038.1Wonke amathuluzi analeli thegi ayaboniswa.