Lungisa Kahle Amamodeli Ombhalo Nezithombe Ngokusebenzisa Uhlelo Lwe-AI Oluholwa yi-Homebrew

Okwenziwa yi-Homebrew

I-Homebrew iyi-ejenti eqondisayo yokulungisa kahle amamodeli olimi nezithombe. Esikhundleni sokudinga ukuthi uhlanganise imibhalo yokuqeqesha nezilungiselelo ngesandla, ikuvumela ukuba uxoxe ne-brewmaster: imodeli ye-AI eqondisa iphrojekthi kusukela embonweni wokuqala kuya ekulungisweni kwedatha, ekuqeqeshweni, ekuhlolweni, ekuthunyelweni kwamanye amafomethi, nasekushicilelweni.

I-brewmaster ingaba ngu-Claude, imodeli ye-OpenAI, imodeli etholakala nge-OpenRouter, imodeli yasendaweni ye-Ollama noma ye-LM Studio, noma enye iseva ehambisana ne-OpenAI. Isiqondiso sivumelana nezinga lakho lolwazi olikhethile: Osaqalayo, Owenza njengokuzilibazisa, Umakhi, noma Uchwepheshe.

I-Homebrew yakhelwe ukusiza kuwo wonke umsebenzi:

• Ukuguqula umbono obanzi wemodeli ube umgomo oqondile wokuqeqesha.
• Ukuthola ihadiwe yasendaweni noma ukulungisa iseva ye-GPU ekude nge-SSH.
• Ukukhetha imodeli eyisisekelo nendlela yokuqeqesha ehambisanayo.
• Ukuthola, ukungenisa, ukuhlanza, ukubuka kuqala, noma ukukhiqiza idatha yokuqeqesha.
• Ukuncoma ama-hyperparameter ngaphakathi kwemihlahlandlela eqondene nemodeli.
• Ukuqalisa imisebenzi yokuqeqesha ezimele nokubika i-loss, inqubekelaphambili, nesikhathi esilinganisiwe sokuphothula.
• Ukuhlola umphumela uma uqhathaniswa nemodeli eyisisekelo yokuqala.
• Ukuthumela i-adapter noma imodeli ehlanganisiwe.
• Ukukhiqiza ikhadi lemodeli nokulayisha umphumela ku-Hugging Face.

I-Homebrew icela ukuqinisekiswa ngaphambi kokusebenzisa imali, ukufaka isofthiwe, ukuthumela idatha kumhlinzeki wangaphandle, noma ukushicilela imodeli. Amagama ayimfihlo, okhiye be-API, namathokheni awadluli engxoxweni.

Imisebenzi Yokuqeqesha Esekelwayo

Amamodeli ombhalo

I-Homebrew isekela imindeni yamamodeli ebaliwe, okuhlanganisa i-Qwen3, i-Qwen3.5 nezakhiwo ezihambisanayo ze-Qwen, i-Qwen3.5 MoE, i-Llama 3.1 kuya ku-3.3, i-Gemma 3, ne-Gemma 4. Kuye ngemodeli nehardware etholakalayo, ukuqeqesha kungasebenzisa i-LoRA, i-QLoRA, noma ukulungisa kahle okuphelele.

Umsebenzi ngamunye wokuqeqesha umbhalo unomunye wemigomo emithathu:

• SFT: Ukulungisa kahle okugadiwe okufundisa imodeli ye-instruct ukuziphatha, isitayela, ifomethi yempendulo, noma iphethini yokusebenzisa amathuluzi.
• CPT: Ukuqeqeshwa okuqhubekayo kwangaphambili embhalweni ongahluziwe, okuvame ukusetshenziselwa ukufundisa imodeli eyisisekelo isizinda noma ulimi.
• DPO: Ukulungisa okusekelwe kokuncanyelwayo kusetshenziswa izimpendulo ezikhethiwe nezinqatshiwe.

Le migomo ingaxhunywa ngokulandelana. Izindlela ezivamile zifaka i-SFT elula, i-CPT elandelwa yi-SFT, kanye ne-SFT elandelwa yi-DPO. Lapho izigaba ze-LoRA zixhunywa, i-Homebrew ihlanganisa isigaba ngasinye nezisindo ebesiqala ngazo ngaphambi kokuqala isigaba esilandelayo.

Amamodeli ezithombe

Ekufundiseni izithombe, i-Homebrew isekela ama-adapter e-LoRA e-Qwen-Image 2.1. Lawa ma-adapter angaqondiswa ezitayeleni, kubalingiswa, noma ezintweni. Ngesikhathi sokuqeqesha, i-Homebrew ingakhiqiza izithombe zokubuka kuqala esinyathelweni esingu-zero nasezindaweni zokuhlola zakamuva isebenzisa ama-seed angashintshi, okwenza ukuqhathanisa okubonakalayo kube lula.

Faka i-Homebrew

Ukufakwa kwendawo yokulawula

Uma ukuqeqesha kuzokwenziwa kuseva ye-GPU eqashiwe noma ekude, ikhompuyutha yakho yasendaweni idinga kuphela ukufakwa okulula kwe-Homebrew:

pip install "homebrew-ai @ git+https://github.com/empero-org/homebrew-ai"

Qalisa isixhumi esibonakalayo esiqondiswayo ngokuthi:

homebrew

Ukufakwa kwe-GPU yasendaweni

Uma ikhompuyutha ine-GPU ye-NVIDIA futhi izokwenza ukuqeqesha endaweni, faka izengezo zokuqeqesha:

pip install "homebrew-ai[train] @ git+https://github.com/empero-org/homebrew-ai"

Ungaqinisekisa ukufakwa, ukulungiselelwa komhlinzeki, ukungena ku-Hugging Face, nehardware ngokuthi:

homebrew doctor
homebrew hardware

Ukuhlola iseva yokuqeqesha ekude, dlulisa umyalo wayo we-SSH:

homebrew hardware --ssh "ssh user@example-server"

Lungiselela i-AI Eqondisayo

Lapho iqala ukusebenza okokuqala, i-Homebrew ibuza ukuthi iyiphi i-AI okufanele ibe yi-brewmaster. Bese icela ukhiye we-API odingekayo, iwugcine endaweni enamalungelo avinjelwe, ibuze izinga lakho lolwazi, bese idala iphrojekthi.

Izinhlobo zabaqondisi ezitholakalayo yilezi:

• Claude: I-README incoma le nketho ukuze uthole isiqondiso esiqine kakhulu.
• OpenAI: Isebenzisa imodeli yengxoxo enokubiza amathuluzi.
• OpenRouter: Inikeza ukufinyelela kumamodeli amaningi ngokhiye owodwa we-API.
• Ollama noma LM Studio: Isebenza endaweni; iphrojekthi incoma imodeli enama-parameter okungenani angu-14B nokubiza amathuluzi ukuze uthole imiphumela emihle.
• Custom: Ixhuma ku-endpoint ehambisana ne-OpenAI njenge-vLLM noma i-llama.cpp.

Shintsha imodeli eqondisayo kamuva ngokusebenzisa:

homebrew setup

I-Homebrew ilungisa ukuziphatha kwayo ngokuya ngomqondisi. Amamodeli aqinile athola lonke iqoqo lamathuluzi, kuyilapho amamodeli amancane asebenza endaweni ethola amathuluzi aqondene nesigaba kanye nesiqondiso esihleleke kakhulu. Amamodeli angenakho ukubiza amathuluzi ngokwendabuko angasebenzisa ngokuzenzakalelayo iphrothokholi yombhalo ye-Homebrew.

Dala Iphrojekthi Yakho Yokuqala Yokulungisa Kahle

Ungaqala ku-directory yamanje ngo-homebrew, noma udale iphrojekthi enegama ngokuqondile:

homebrew new my-pirate-chemist
cd my-pirate-chemist
homebrew

Chaza umphumela owufunayo ngolimi olujwayelekile. Isibonelo:

a chatbot that explains chemistry like a friendly pirate

I-brewmaster izobuza imibuzo kuze kube yilapho umgomo usucacile. Bese ihlola ihadiwe, incoma imodeli eyisisekelo, ixoxe ngezidingo zelayisensi, futhi inqume ukuthi ikhompyutha yasendaweni noma eqashiwe ifanele yini.

Landela Umsebenzi Wokupheka

1. Chaza umgomo

Chaza ukuziphatha okuhlosiwe kwemodeli, izethameli, indawo yesihloko, isitayela somphumela, noma umqondo wesithombe. Imigomo ethile isiza i-brewmaster ikhethe idatha efanele nomgomo wokuqeqesha ofanele.

2. Khetha ikhompyutha

I-Homebrew ithola ihadiwe yasendaweni. Uma ingekho i-GPU ye-NVIDIA efanele, ingancoma i-GPU ehambisanayo futhi inikeze amanani alinganiselwe e-Runpod ne-Vast.ai. Ayidali i-akhawunti futhi ayisebenzisi imali egameni lakho.

Ngemva kokuqasha umshini, namathisela umyalo we-SSH womnikezeli eseshini eqondisiwe. I-Homebrew ingabe isihlole ihadiwe, ilungise imvelo, ilayishe idatha, iqale ukuqeqesha, bese ithola imiphumela.

Izimo zefu ezimisiwe zingase ziqhubeke zikhokhisa isitoreji. Bhubhisa izinsiza eziqashiwe lapho iphrojekthi isiqediwe.

3. Khetha imodeli eyisisekelo

I-brewmaster incoma imodeli ngokusekelwe enjongweni, kwimemori etholakalayo, endleleni yokuqeqesha ehlosiwe, nasezidingweni zelayisensi. Iphinde ihlole ukuthi ukufinyelela kumodeli enokufinyelela okunomkhawulo kuyatholakala yini.

Ukuze uzihlolele amamodeli asekelwayo, sebenzisa:

homebrew models
homebrew models --modality text --all
homebrew models --modality image --all

4. Lungisa idatha

Idatha yokuqeqesha ingavela ku-Hugging Face, kumafayela asendaweni, ezibonelweni ezibhalwe nge-brewmaster, noma ekukhiqizweni kokwenziwa okukhethwayo. I-Homebrew ingasesha futhi ibuke kuqala amasethi edatha e-Hugging Face ngaphandle kokuwalanda kuqala.

Ukukhiqizwa kwedatha yokwenziwa kudinga ukukhetha kusengaphambili. Kungakha izingxoxo ngokusekelwe esifingqweni, kubhale kabusha isethi yedatha ekhona ngesitayela esiceliwe, noma kukhiqize amapheya okuncamelayo e-DPO. Umsebenzi ulondolozwa njengoba amaqoqo eqedwa, ngakho ukukhansela inqubo yokukhiqiza akulahli amaqoqo asevele eqediwe.

Umsebenzi we-clean_dataset ususa amarekhodi angenalutho, aphindaphindiwe, noma aphukile futhi udale ikhophi eyisipele. Buka ngokucophelela amarekhodi acutshunguliwe ukuze uqinisekise ukuthi afundisa ukuziphatha okuhlosiwe.

5. Yakha iresiphi yokuqeqesha

Umsebenzi we-propose_training_config we-Homebrew ukhetha amapharamitha e-hyperparameter ngokusekelwe eziqondisweni zemodeli esekelwayo futhi ulinganise umsebenzi ngokwe-GPU etholakalayo. Ngaphambi kokuqala ukuqeqesha, i-Homebrew ilinganisela ukusetshenziswa kwememori, ubude besikhathi, nezindleko.

6. Qalisa futhi uqaphe ukuqeqesha

Ukuqeqesha kusebenza njengenqubo ezimele emshinini one-GPU. Ukuvala itheminali yasendaweni akuwumisi umsebenzi. Buyela kufolda yephrojekthi bese usebenzisa homebrew ukuze uqhubeke nengxoxo.

Imiyalo ewusizo yokuqapha ihlanganisa:

homebrew status
homebrew status JOB_ID

Eseshini esebenzisanayo, sebenzisa:

/status
/jobs
/watch

I-Homebrew ilandela inqubekelaphambili, ibike ijika lokulahleka kanye ne-ETA, futhi inikeze incazelo ngolimi olulula lapho kwenzeka iphutha.

7. Hlola imodeli

Ngemva kokuqeqesha, hlola iziyalezo ngemodeli ecushwe kahle bese uqhathanisa izimpendulo zayo nalezo zemodeli eyisisekelo. Lokhu kungaveza ukuthi imodeli entsha ifunde isitayela noma ukuziphatha okuceliwe yini ngaphandle kokulimaza ikhwalithi yezimpendulo ezijwayelekile.

8. Thumela futhi wabelane

I-Homebrew ingapakisha umphumela njenge-adapter noma imodeli ehlanganisiwe. Iphinde ikhiqize ikhadi lemodeli elihlanganisa indlela yokuqeqesha, idatha, amalayisensi, ababambiqhaza, nezibonelo ezifanele. Ukulayishwa ku-Hugging Face kuyimfihlo ngokuzenzakalelayo.

Ukuhlolwa kwamalayisensi kuhlanganisa izinto ezifana nezidingo zokuqanjwa kwe-Llama, imigomo ye-Gemma, kanye nezaziso zamasethi edatha noma amamodeli asetshenziselwa okungezona ezohwebo.

Ukuqeqeshwa Kombhalo Okuthuthukile: CPT, SFT, ne-DPO

Sebenzisa i-CPT elandelwa yi-SFT

Khetha i-CPT lapho imodeli idinga kuqala ukujwayelana nedatha yesizinda noma yolimi engakacutshungulwa. Yilandele nge-SFT ukuze ufundise ukuziphatha kwengxoxo. Umsebenzi ngamunye olandelayo ubhekisela esigabeni sangaphambilini nge-init_from.

Base model -> CPT on raw text -> SFT on conversations

Lungisa okuncamelwayo nge-DPO

Ngemva kwe-SFT, i-DPO ingalola okuncamelwayo kwezimfanelo ezifana nethoni, isakhiwo, noma isitayela sempendulo. Amapheya okuncamelwayo angavela ku-Hugging Face, ekukhiqizweni kokwenziwa, noma kwimodeli esanda kuqeqeshwa uqobo.

I-Homebrew ingakhiqiza izimpendulo ezimbili eziphakanyisiwe zomyalo ngamunye nge-generate_candidates. Ungakhetha impendulo engcono kutheminali nge-review_candidates, noma ucele i-AI eqondisayo ukuthi yahlulele iziphakamiso ngokumelene nerubhrikhi bese uhlola ngezikhathi ezithile izinqumo zayo.

Base model -> SFT -> generate candidate pairs -> review preferences -> DPO

Ama-log-probability ayinkomba e-DPO abalwa kanye kusukela kwimodeli yokuqala yaleso sigaba, ngakho imodeli yesibili ayidingi ukuhlala kwimemori ye-GPU. Lokhu kusebenza kokubili ku-LoRA nasekuqeqeshweni okuphelele okushunwe kahle.

Qapha I-Image LoRA Ngokubuka

Imisebenzi ye-Qwen-Image 2.1 LoRA ingakhiqiza ukubuka kuqala kwemodeli eyisisekelo esinyathelweni sikaziro kanye neqoqo elisha lokubuka kuqala ku-checkpoint ngayinye emisiwe. Iziyalezo nezimbewu ezingahleliwe zihlala ziqinile, okuvumela ukuqhathaniswa okunenjongo kwama-checkpoint.

Ukubuka kuqala okulandiwe kugcinwa ngaphansi kuka:

runs/<job>/samples/step_NNNNNN/

Faka igama lokuyiqalisa le-adapter eziyalezweni zokubuka kuqala. Uma i-checkpoint yangaphambilini ibukeka ingcono kuneyokugcina, cela i-brewmaster ukuthi ipakishe leyo checkpoint.

Ukuze uthole isixhumi esibonakalayo sesiphequluli esibukisa izinto ngapha nangapha, faka:

/gallery

Igalari inikezwa endaweni ekhelini le-127.0.0.1 elinethokheni futhi ayifinyeleleki ngaphandle kwekhompyutha. Imigqa imele ama-checkpoint kanti amakholomu amele iziyalezo zokubuka kuqala. Igalari iyazivuselela ngesikhathi sokuqeqesha, isekela izithombe ezikhulisiwe, ikuvumela ukuthi uhambe phakathi kwama-checkpoint usebenzisa okhiye bemicibisholo, futhi isebenzisa u-C ukuqhathanisa umphumela nemodeli eyisisekelo.

Qonda Idatha ye-ETF

I-Homebrew isebenzisa i-Empero Trace Format, noma i-ETF, njengefomethi ehlanganisiwe ye-JSON Lines. I-ETF ingamelela izingxoxo, iziyalezo zesistimu, izikimu namakholi amathuluzi, ukucabanga, amadokhumenti okuthola ulwazi, amapheya okuncamelwayo, umbhalo ongakacutshungulwa, ukuqedelwa, nezithombe.

Sebenzisa iqembu lemiyalo le-ETF ukuze uhlole futhi uphathe amafayela:

homebrew etf validate dataset.jsonl
homebrew etf stats dataset.jsonl
homebrew etf convert
homebrew etf schema

Bheka imibhalo ye-ETF yephrojekthi ukuze ubone isakhiwo sayo esiphelele.

Imiyalo Ewusizo Nezilawuli Zeseshini

• homebrew: Qala noma uqhubeke nephrojekthi yamanje.
• homebrew new NAME: Dala iphrojekthi.
• homebrew setup: Khetha noma shintsha i-AI eqondisayo.
• homebrew doctor: Hlola ukufakwa, umhlinzeki we-AI, ukungena kwe-Hugging Face, kanye nehadiwe.
• homebrew hardware: Bonisa umbiko wehadiwe yasendaweni noma ekude.
• homebrew models: Faka ohlwini amamodeli ayisisekelo asekelwayo.
• homebrew status JOB: Hlola imisebenzi yokuqeqesha.

Ngaphakathi kweseshini, /level ishintsha izinga lencazelo, /usage ibonisa ulwazi lokusetshenziswa, /thinking full ikhulisa ukuboniswa kokucabanga okubonakalayo kwe-brewmaster, /thinking off iyakufihla, kanti /quit iyaphuma eseshini.

Amathiphu Athuthukile Okusetha

Hlela i-Homebrew ukuze isebenze kumatheminali anemikhawulo

I-Homebrew inikeza okuguquguqukayo kwemvelo kwezixhumanisi zamatheminali ezenziwe zaba lula:

HOMEBREW_AI_PLAIN_INPUT=1 homebrew
HOMEBREW_AI_SIMPLE_PROMPTS=1 homebrew
HOMEBREW_AI_THINKING=off homebrew

HOMEBREW_AI_PLAIN_INPUT ishintsha ibha yokufaka enohlaka ibe yiprompt elula. HOMEBREW_AI_SIMPLE_PROMPTS isebenzisa izinketho ezinezinombolo esikhundleni samamenyu okhiye bemicibisholo. HOMEBREW_AI_THINKING yamukela on, full, noma off.

Lawula ukuhambisana kokukhiqizwa kwedatha yokwenziwa

Ukukhiqizwa kokwenziwa kusekela abasebenzi abafanayo abaphakathi koyedwa nabayishumi nesithupha. Ngokwesibonelo:

HOMEBREW_AI_SYNTH_WORKERS=4 homebrew

Khetha inani elihlonipha imikhawulo yezinga yomhlinzeki wakho kanye nemingcele ye-akhawunti yakho.

Hlola amafayela ephrojekthi

Iphrojekthi ejwayelekile iqukethe:

my-project/
  homebrew.yaml
  data/
  data/_sets/<name>/
  runs/<job_id>/
  .homebrew/

• homebrew.yaml igcina izinqumo nesimo, okuhlanganisa inhloso, imodeli, ikhompyutha, amasethi edatha, imisebenzi, nokuthunyelwa.
• data/ iqukethe amasethi edatha e-ETF nama-manifest achaza imithombo, amalayisense, nokuhlanganiswa.
• data/_sets/<name>/ iqukethe amasethi okuqeqesha nawokuhlola akhiwe.
• runs/<job_id>/ igcina ukucushwa komsebenzi, idatha ekopishiwe, isimo, amamethrikhi, izingodo, nezinto zokugcina ezikhiqiziwe.
• .homebrew/ iqukethe umlando wengxoxo osetshenziselwa ukuqhubeka neseshini.

Izilungiselelo zomsebenzisi zigcinwa ngaphansi kwe-~/.config/homebrew-ai/. Imininingwane yokungena igcinwa ku-credentials.yaml ngemodi engu-600. Amaphrofayili emodeli engeziwe angabekwa ku-~/.config/homebrew-ai/profiles/ kusetshenziswa i-schema efanayo namaphrofayili afakiwe.

Izincomo Ezisebenzayo

1. Qala ngenhloso emincane. Ukuziphatha okuqondile noma umqondo obonakalayo kulula ukuwuhlola kunenhloso evamile.
2. Buka kuqala amarekhodi okugcina okuqeqesha. Ukuhlanza nokubhala kabusha ngesitayela kungashintsha lokho okubonwa imodeli, ngakho hlola izibonelo ezimele ngaphambi kokuqeqesha.
3. Qala nge-SFT ukuze wenze izinguquko zokuziphatha. Sebenzisa amaketanga ayinkimbinkimbi kuphela lapho iphrojekthi idinga ngempela ukuqeqeshwa kwangaphambili kwesizinda noma ukwenziwa kahle kokuncamelayo.
4. Qhathanisa nemodeli eyisisekelo. Ukuhlolwa okubheke eceleni kwenza kube lula ukunquma ukuthi ukuqeqesha kudale yini ukuthuthuka okuwusizo.
5. Buyekeza amalayisense ngaphambi kokushicilela. Okukhiqizile kungokwakho, kuncike kumalayisense amamodeli ayisisekelo namasethi edatha asetshenzisiwe.
6. Gcina ama-checkpoint awusizo. Ikakhulukazi ekuqeqesheni i-Image LoRA, i-checkpoint enamandla kakhulu ngokubukeka ingase ingabi eyokugcina.
7. Qeda ingqalasizinda eqashwe. Misa futhi ususe izinsiza zamafu ngemva kokulanda nokuqinisekisa imiphumela.

Isiphetho

I-Homebrew iguqula ukulungisa kahle amamodeli kube ukuhamba komsebenzi okuqondisiwe nokusekelwe engxoxweni, kuyilapho igcina ukulawula idatha, izindleko, ukufakwa, nokushicilela. Isekela amaphrojekthi e-SFT aqondile kanye nezinhlelo ezixhunyiwe ze-CPT, SFT, ne-DPO, kanye nokuqeqeshwa kwe-Qwen-Image LoRA okusekelwe kuma-checkpoint. Qala ngokufaka ithuluzi lomugqa womyalo, khetha umqondisi onekhono, chaza inhloso egxile, bese uvumela i-brewmaster ikuqondise esinyathelweni ngasinye esiqinisekisiwe.

Ukuze uthole ikhodi yomthombo nemibhalo yamanje, vakashela inqolobane ye-Homebrew ku-GitHub. I-Homebrew isebenzisa ilayisense yayo: imigomo yesitayela se-MIT isebenza kubantu ngabanye nasezinhlanganweni ezifika emngceleni wemali engenayo oshiwo enqolobaneni, kanti izinhlangano ezinkulu zidinga ilayisense yezentengiso.