Umhlahlandlela Womsizi Wasekhaya Wokufunda Nokuhlela Amaphepha: Ukufaka I-CLI Agent Egxile Kubumfihlo Ku-Linux

Isingeniso Sephrojekthi

Umsizi wasekhaya wokufunda nokuhlela amaphepha uyi-CLI Agent elula esebenzela ku-Linux futhi esiza ngemisebenzi yamaphepha. Ngemva kokuba umsebenzisi efake umbuzo, imodeli ingabiza amathuluzi asekhaya namandla okusesha amaphepha ukuze isize ukufunda, ukufingqa nokuhlaziya okuqukethwe kwamaphepha asekhaya.

Iphrojekthi isebenzisa ngokuzenzakalelayo i-Qwen3-14B-AWQ, enesisindo semodeli esicishe sibe ngu-9.4 GB. Ifanele abasebenzisi abanama-GPU e-NVIDIA abafuna ukusebenzisa imodeli endaweni yabo futhi bavikele ubumfihlo bamaphepha nemibuzo yabo. Ngokuzenzakalelayo, iphrojekthi ayikwenzi kusebenze ukusesha ku-inthanethi; izimpendulo zisuselwa kakhulu emandleni emodeli uqobo kanye nesisekelo solwazi sasekhaya esakhiwe umsebenzisi.

Iphrojekthi isekela iphrothokholi ye-MCP futhi ingaxhuma kumasevisi e-MCP ngokusebenzisa indlela yokubhalisa amathuluzi. Njengoba ibhajethi yokufaka, imiyalelo yesistimu nobude bokuphumayo kwamathuluzi kungalungiswa, ukusetshenziswa kwayo akugcini ngokusiza ngamaphepha kuphela.

Izici Eziyinhloko

• Ukusebenzisa i-Agent yasekhaya esiza ngamaphepha endaweni ye-Linux.
• Ukusebenzisa ngokuzenzakalelayo imodeli yasekhaya i-Qwen3-14B-AWQ.
• Ukuguqula amafayela e-PDF anombhalo, i-Markdown ne-TXT abe yisisekelo solwazi sasekhaya esiseshekayo.
• Ukweseka imibuzo esebenzisanayo kanye nokwenza umbuzo owodwa ngomugqa womyalo.
• Ukugcina amarekhodi emibuzo nezimpendulo ngefomethi ye-Markdown.
• Ukweseka iphrothokholi ye-MCP nendlela yokubhalisa amathuluzi.
• Ukweseka ngokuzikhethela izindawo zokuhlola ze-LangGraph ukuze kuqhutshekwe nesikhathi kwezinye iz窗口.
• Ukunikeza imibhalo yokuhlola imvelo, i-GPU nokumiswa kwemodeli.

Okumele Kulungiswe Ngaphambi Kokufaka

Iphrojekthi ihloselwe i-Linux futhi kunconywa umshini one-GPU ye-NVIDIA. Isisindo semodeli sicishe sibe ngu-9.4 GB, kodwa ngesikhathi sokusebenza kudingeka futhi kugcinwe inkumbulo eyanele ye-GPU ukuze kwenziwe inference yemodeli. Lapho kulungiswa imodeli, ibhajethi yokufaka noma ubude bokuphumayo, kufanele kuhlolwe umthamo wememori ye-GPU.

Ama-PDF askeniwe okwamanje awasekeli i-OCR. Uma udinga ukusesha amaphepha askeniwe, kufanele uqale uguqule okuqukethwe kube umbhalo, noma usebenzise ama-PDF anombhalo, amafayela e-Markdown noma e-TXT asekelwa iphrojekthi.

Ukulanda Nokufaka Iphrojekthi

Qala ngokwenza i-clone yendawo yokugcina ye-GitHub, bese uqamba ifolda yephrojekthi ngokuthi local-agent:

git clone https://github.com/Ayi914/paperchecker.git local-agent
cd local-agent

Uma ungasebenzisi i-Git, ungakhetha futhi Code → Download ZIP ekhasini le-GitHub, uyivule bese uvula itheminali kufolda yephrojekthi.

Ngemva kokungena kufolda yephrojekthi, sebenzisa iskripthi sokufaka:

bash scripts/install.sh

Ngemva kokuphothulwa kokufaka, sebenzisa iskripthi sokuqalisa:

bash scripts/start.sh

Ukuqalisa kokuqala kudinga ukulinda imodeli ilayishwe. Lapho kuvela umyalo >>> etheminali, ungafaka umbuzo. Isibonelo:

>>> Chaza ukuthi ukuxhumana kwezinsalela kuxazulula yiphi inkinga

Ngemva kwalokho, uma ungena kufolda yephrojekthi, ngokuvamile udinga kuphela ukusebenzisa bash scripts/start.sh ukuze uyiqalise.

Ukusebenza Kokuqala Nokumiswa Kwemodeli

Uma ifolda yemodeli ingaphelele noma udinga ukukhetha enye imodeli, ungasebenzisa:

bash scripts/setup.sh

Uma ukulanda imodeli kwehluleka, qala uhlole inethiwekhi. Ungaphinda ulande ifolda ephelele yemodeli emshinini onenethiwekhi, uyikopishe emshinini okuqondiswe kuwo, bese ukhetha imodeli ekhona ngesikhathi sokumisa.

Uma ukuqaliswa kwemodeli kwehluleka, ungabheka ifayela lelogi elishiwo etheminali. Ilogi ivame ukuba lapha:

logs/cli-vllm-*.log

Qinisekisa futhi ukuthi inkumbulo ye-GPU ayisetshenziswa ezinye izinhlelo.

Ukungenisa Amaphepha Akho Nokwakha Inkomba

Ukuze i-Agent iphendule imibuzo isebenzisa amaphepha akho, faka ama-PDF anombhalo, amafayela e-Markdown noma e-TXT kufolda ethi data/knowledge/. Isibonelo, ifolda ingaba namaphepha amaningi namanothi ahlobene.

Ngemva kokulungisa amafayela, sebenzisa umyalo wokukhomba isisekelo solwazi:

bash scripts/start.sh rag-index

Ngesikhathi sokuqala kwakhiwa inkomba, kuzolandwa imodeli ezimele yokusesha, ngakho kudingeka uxhumano lwenethiwekhi. Ngemva kokuphothulwa kokukhomba, qala kabusha i-Agent esebenzisanayo:

bash scripts/start.sh

Manje ungabuza imibuzo esekelwe emaphepheni asekhaya, isibonelo:

Fingqa izinto ezintsha eziyinhloko ze-YOLOv1 ngokusekelwe emaphepheni asekhaya, bese ubhala imithombo.

Uma ungafakanga amaphepha noma ungakakhi inkomba, izimpendulo zizosuselwa kakhulu olwazini lwemodeli uqobo, hhayi okuqukethwe kwamaphepha asekhaya. Iphrojekthi ayikwenzi kusebenze ukusesha ku-inthanethi ngokuzenzakalelayo.

Ukusetshenziswa Okusebenzisanayo

Ngemva kokuqalisa, faka umbuzo ngemva komyalo >>> bese ucindezela u-Enter. Lokhu kulungele imibuzo elandelanayo, ukuqhathanisa imibono yamaphepha noma ukuhlaziya kancane kancane isihloko esisodwa.

Ungasebenzisa imiyalo eyakhelwe ngaphakathi elandelayo ukuze uphathe ingxoxo:

• /help: Buka imiyalo yengxoxo.
• /new: Qala isikhathi esisha.
• /exit, /quit noma Ctrl+D: Phuma ohlelweni.

Umbuzo nezimpendulo zomjikelezo ngamunye zigcinwa ngokuzenzakalelayo njengefayela le-Markdown. Indlela iba:

output/inyanga/usuku/isikhathi_microsecond.md

Ukwenza Umsebenzi Owodwa Ngomugqa Womyalo

Uma ungadingi ukungena kusixhumi esibonakalayo esisebenzisanayo, ungadlulisela umbuzo ngokuqondile njengempikiswano yeskripthi sokuqalisa:

bash scripts/start.sh "Fingqa indlela yokunaka"

Sebenzisa --quiet ukuze kukhishwe impendulo kuphela:

bash scripts/start.sh "Fingqa indlela yokunaka" --quiet

Uma ungafuni ukugcina ifayela lempendulo, engeza --no-save:

bash scripts/start.sh "Umbuzo" --no-save

Ukumisa Ibhajethi Yokufaka, Ubude Bokuphumayo Nemiyalelo

Ibhajethi yokufaka ye-Agent kanye nomyalo wesistimu kungashintshwa ku-config/agent.yaml, ngakho iphrojekthi ingasetshenziswa nakwezinye izimo zama-Agent asekhaya.

Kubalulekile ukuhlukanisa amapharamitha amabili: tool_output_max_chars: 4000 kufayela lokumisa umkhawulo wokunqunywa kwezinhlamvu zemiphumela yamathuluzi, hhayi umkhawulo wama-token wempendulo yemodeli. Ubude obukhulu bokuphumayo kwemodeli bulawulwa ngu-LOCAL_AGENT_MAX_TOKENS kufayela lemvelo, kanti i-.env.example imiswe ngokuzenzakalelayo kuma-token angu-2048.

Ibhajethi yokufaka ye-Agent ngokuzenzakalelayo ingama-token angu-4096. Lapho ulungisa ibhajethi yokufaka, umyalo wesistimu, ubude bokuphumayo kwamathuluzi noma ama-token aphezulu okuphumayo, kufanele ucabange ngobude bomongo kanye nememori ye-GPU etholakalayo ukuze ugweme ukumiswa okuphezulu kakhulu okungenza imodeli ingasebenzi kahle.

Ukugcina Nokubuyisela Isikhathi Phakathi Kwamawindi

Ngokuzenzakalelayo, umongo wesikhathi ugcinwa kuphela enqubweni esebenzayo. Ngemva kokuvala i-CLI, uhlelo aluwubuyiseli ngokuzenzakalelayo umongo, futhi amafayela ezimpendulo e-Markdown asevele akhiqiziwe awafundwa ngokuzenzakalelayo.

Uma udinga ukuqhubeka nesikhathi esifanayo kwelinye iwindi, shintsha run.checkpoint_enabled ube ngu-true ku-config/agent.yaml, futhi usebenzise njalo i-ID yesikhathi efanayo:

bash scripts/start.sh -i --thread-id my-paper

Isimo sesikhathi sizogcinwa lapha:

data/checkpoints/langgraph.sqlite

Ukufaka /new, noma ukuqala iwindi elisha lokusebenzisana ngaphandle kokucacisa i-ID yesikhathi, kuzokwakha isikhathi esisha. Ngokujwayelekile ukubizwa kwemodeli ngakunye kusebenzisa imijikelezo yengxoxo engu-4 yakamuva, futhi kusaboshwe yibhajethi yokufaka yama-token angu-4096.

Ukuhlola Imvelo Nokuxazulula Izinkinga

Uma uhlangabezana nenkinga, kunconywa ukuthi uqale usebenzise iskripthi sokuhlola imvelo:

bash scripts/doctor.sh

Lesi skripthi sihlola imvelo, i-GPU nokumiswa kwemodeli, kodwa asilayishi imodeli enkulu futhi asiqali i-inference, ngakho sifanele ukusetshenziswa ngaphambi kokuqalisa okujwayelekile noma ngesikhathi sokuxazulula izinkinga.

• Ayikho i-GPU: Kunconywa umshini we-Linux one-GPU ye-NVIDIA.
• Ifolda yemodeli ayiphelele: Sebenzisa bash scripts/setup.sh ukuze ukhethe kabusha imodeli noma uqhubeke nokulanda.
• Ukulanda imodeli kwehlulekile: Hlola inethiwekhi, noma ulande ifolda ephelele yemodeli emshinini onenethiwekhi bese uyikopisha endaweni okuqondiswe kuyo.
• Ukuqalisa imodeli kwehlulekile: Bheka logs/cli-vllm-*.log, futhi uqinisekise ukuthi inkumbulo ye-GPU ayisetshenziswa ezinye izinhlelo.
• Amaphepha asekhaya awasetshenziswa: Qinisekisa ukuthi amafayela aku-data/knowledge/ futhi usuyisebenzisile bash scripts/start.sh rag-index.

Izeluleko Ezisebenzayo Zokusebenzisa

• Ngaphambi kokusebenzisa okokuqala, sebenzisa bash scripts/doctor.sh ukuze uthole kusenesikhathi izinkinga ze-GPU, ifolda yemodeli noma zokumisa.
• Beka ndawonye amaphepha adinga ukucashunwa nokuhlaziywa ku-data/knowledge/, bese ubuza ngemva kokuphothula ukukhomba.
• Lapho ubuza, cacisa ububanzi bokufingqa, ifomethi yokuphumayo noma ucele imithombo ukuze kube lula ukuqinisekisa okuqukethwe kwamaphepha asekhaya.
• Uma inkumbulo ye-GPU inganele, ungakhulisi ngokunganaki ibhajethi yokufaka, umkhawulo wokuphumayo kwamathuluzi noma ama-token aphezulu okuphumayo.
• Uma udinga ukucubungula isihloko socwaningo esifanayo ngokuqhubekayo, vula izindawo zokuhlola bese ugcina i---thread-id ingashintshiwe.
• Ama-PDF askeniwe awakwazi ukuthembela ngokuqondile kule phrojekthi ukuze kwenziwe i-OCR; qala ulungise okuqukethwe kombhalo okuseshekayo.

Isifinyezo

I-paperchecker inikeza inqubo ephelele eqala ekuqaliseni imodeli yasekhaya, iqhubeke nokukhomba amaphepha, ize ifike emibuzweni nezimpendulo ze-CLI. Ngemva kokufaka iphrojekthi, ungasebenzisa imodeli ezenzakalelayo ekuhlaziyeni imibuzo evamile, noma ufake amaphepha akho anombhalo esisekelweni solwazi bese uwakhomba, ukuze i-Agent iphendule isebenzisa ulwazi lwasekhaya. Nge-agent.yaml, okuguquguqukayo kwemvelo nezindawo zokuhlola zesikhathi, ungakwazi ukuqhubeka nokulungisa umongo, ukuphumayo nendlela yokuphatha izikhathi.

Ikhodi yephrojekthi isebenzisa ilayisensi ye-MIT. Uma uhlangabezana nezinkinga zokuqalisa noma zemodeli, qala usebenzise iskripthi sokuxilonga bese uhlola amalogi.