Ukuqonda i-DeepSeek V4 × J-Space: Kusukela ku-diode yeketango lokucabanga kuya ekusetshenzisweni kobunjiniyela be-Benchmark

Uhlolojikelele lwephrojekthi

J-Space Cognition Suite V3.6 iwuhlelo lokulawula olungancikile kumodeli olusebenza esigabeni sokucabanga. Aluguquli izisindo zemodeli, kodwa luphatha wonke umjikelezo wokuphila womsebenzi ngokusebenzisa umzila wendawo yokusebenza, ukuqhubeka kwesimo, imingcele yezenzo, ukuqinisekisa kanye nezindlela zokubuyisela.

Lesi sihloko sisekelwe ekuqaphelweni kobunjiniyela okushicilelwe yiphrojekthi kanye namarekhodi e-Benchmark. Okuqukethwe kuyingxenye yokuxilonga ubunjiniyela bebhokisi elimnyama; akulona iphepha locwaningo, futhi akunikezi ubufakazi bezindlela zangaphakathi zemodeli, izindlela zokwahlulela ezisemthethweni, ukwakheka kokuhlolwa kokususa izingxenye, noma ukuhlukaniswa komnikelo oyimbangela.

Ikheli lephrojekthi: J-Space Cognition Suite V3.6. Amarekhodi okuqala anelayisensi ye-CC BY-ND 4.0.

Ukuqonda i-diode yeketango lokucabanga

Incazelo yokusebenza

“I-diode yeketango lokucabanga” yigama lobunjiniyela elichaza ukuziphatha kweseshini yebhokisi elimnyama. Lisho ukuthi iketango lokucabanga eliqhubekayo eseshini eyodwa livame ukuwela ngokuzinzile kwenye yalezi zindlela ezimbili:

• Ukuzwa ngokucabanga okufushane: Ukwakha isinqumo ngokushesha bese kungena esenzweni, ngebhulokhi yokucabanga emfushane.
• Ukucabanga okude: Ukuqala ngokuhlaziya, ukuhlola kabusha nokuhlela isikhathi eside, bese kunqunywa ukuthi kuthathwe isinyathelo yini.

Ngemva kokuba indlela yokuqala isenze isibopho, ukucabanga okulandelayo kuvame ukuqhubeka ngakolunye uhlangothi olufanayo. Ukuvela ngezikhathi ezithile kokuxubana kwamagama noma ukushintsha okungazinzile akusho ukuthi imodeli ithole isimo esimaphakathi esingasebenzisa izinzuzo zazo zombili izinhlangothi ngesikhathi esisodwa.

Izisho ezifana ne-We need kanye ne-Let me zingasebenza kuphela njengezihloli zomkhondo wangaphandle; azikwazi ngokwazo ukufakazela ikhono lemodeli, ikhwalithi yokucabanga noma isimo sangaphakathi.

Izinkinga ezivamile zalezi zindlela ezimbili

Ukuzwa ngokucabanga okufushane kungase kwamukele ngokushesha incazelo yokuqala ezwakala kahle, kushiye imingcele eyinkimbinkimbi, ukuxhumanisa okuphakathi, ubufakazi bamathuluzi noma ukuqinisekiswa kokugcina. Kungase futhi kumemezele umsebenzi uphelile ngokushesha ngemva kokuphumelela kokuhlolwa kwendawo.

Ukucabanga okude kungase kudale inertia yokuhlaziya, ukubambezeleka kwesenzo nokuhlela okuphindaphindiwe. Lokhu kungaholela ekubizweni kwamathuluzi sekwephuzile, ekwandeni kokusetshenziswa kwama-Token nesikhathi, ekuphambukeni kwesimo sesikhathi eside, noma ekwehlulekeni ukuvala umsebenzi ngisho nalapho ulwazi selwanele.

Ngakho-ke, inkinga yobunjiniyela akukhona ukuthi olunye uhlangothi luhlale lubi kakhulu, kodwa ukuthi iseshini ayikwazi ukulungisa ngokuzinzile indlela yokucabanga ngokwesigaba somsebenzi: ingashesha kakhulu lapho kudingeka ubufakazi obengeziwe, bese iqhubeka nokucabanga lapho kudingeka isenzo esisheshayo.

Umbono wokufanela ngokweqile kwesixhumi esibonakalayo esilula

Ukuxilonga kobunjiniyela okusetshenziswa yi-J-Space kuphakamisa ukuthi ukuziphatha kokuqeqeshwa kwangemva kokwakhiwa kwe-Agent kwa-DeepSeek kungase kuhlobane kakhulu nokusatshalaliswa kwesixhumi esibonakalayo semodi elula ye-DeepSeek Harness. I-persona elula, i-Tool Schema yokuqala, imingcele ezifaka ngokuzenzakalelayo kanye nemibandela yokuphuma kwakha ndawonye uphawu lwesixhumi esibonakalayo; ukushintsha kwesixhumi esibonakalayo kungafaka iseshini emzileni ohlukile.

Lapha, “ukufanela ngokweqile” kuwukufingqa nje ukuzwela kwezimo zebhokisi elimnyama. Ubufakazi obushicilelwe busekela ubudlelwano phakathi kwezimo zesixhumi esibonakalayo nokushintsha kwemizila, kodwa abanele ukubuyisa idatha yokuqeqesha, izimo ezifihliwe noma indlela ephelele yokuqeqesha.

Ukuhlukaniswa kwemisebenzi yezixazululo ezintathu zobunjiniyela

Anchored Standard: ukubuyisa indawo yokungena

dsh-anchored-standard igxile ezimweni zesixhumi esibonakalayo sesicelo sokuqala semodeli. Isixazululo sayo esiyisisekelo sibuyisa kuqala i-Tool Schema yangempela enamathuluzi amabili ye-Minimal futhi sicindezele okuqukethwe okufakwa ngokuzenzakalelayo; ngemva kokuba iseshini ikhiqize umcimbi oqhubekayo, sivula ikhathalogi encane yamathuluzi ahlala ekhona, bese sivula amanye amathuluzi lapho kudingeka.

Ukuhlolwa okushicilelwe kubonisa ukuthi i-Tool Schema yokuqala, isabelomali sokuphuma nokuqukethwe okufakwa ngokuzenzakalelayo kungashintsha umzila wokuqala wokucabanga, kodwa “ukubambeka komzila” akusho ukuthi ikhono lomsebenzi selithuthuke ngokuzinzile. Imiphumela yamasampula amancane ayikwazi ukwandiswa ngokuqondile ibe inzuzo yekhono evamile.

Routing Suite: ukukhetha indawo yokungena

dsh-routing-suite ithumela amaseshini amasha emikhawulweni ehlukene yokuziphatha ezinzile ngokuhlukanisa umsebenzi wokuqala, ukuhlanganisa i-persona kanye nobuso bamathuluzi. Igcizelela ukugwema izindawo zoshintsho ezingazinzile, kunokubheka izilawuli zamanani aqhubekayo njengokujula kokucabanga okungalungiswa ngokuqhubekayo.

I-mixed esezintweni zayo isho indawo yoshintsho noma yokuncintisana engazinzile, hhayi isimo esimaphakathi esifanele esihlanganisa izinzuzo zokucabanga okufushane nokude. Iphrojekthi iphinde yashicilela ukulungiswa komphakathi kwezincazelo ezithile zangaphambili ezazinamandla kakhulu ngokwembangela.

J-Space: ukulawula inqubo yomsebenzi oqhubekayo

I-J-Space isebenza kuwo wonke umjikelezo wokuphila komsebenzi ngemva kokuba iseshini isingene emzileni othile. Ayisho ukuthi iqeda i-diode yeketango lokucabanga, kodwa inciphisa izinkinga zesakhiwo ezivela ngemva kokuba iseshini iwele kolunye uhlangothi.

• Anchored Standard: Ibuyisa uphawu lwesixhumi esibonakalayo esaziwayo lendawo yokungena.
• Routing Suite: Ikhetha indawo yokungena ezinzile efaneleka kakhulu ngokomsebenzi.
• J-Space: Igcina ngokuqhubekayo isimo, izenzo, ukuqinisekisa kanye nenqubo yokubuyisela.

Lobu budlelwano bungukuhlelwa kwamazinga okusiza ukuqonda ubunjiniyela. Lezi zixazululo ezintathu azikakaqedi ukuhlolwa okuhlanganisiwe ngaphansi kwe-Harness efanayo, ngakho akunakwenzeka ukuzibeka ezikhundleni ngokusekelwe kulokhu.

Ukuthola nokusetha

Ukuthola iphrojekthi

Ikhodi yomthombo ingatholakala endaweni yokugcina iphrojekthi:

git clone https://github.com/Tiger3807861189/J-Space-Cognition-Suite-V3.6.git
cd J-Space-Cognition-Suite-V3.6

Amarekhodi amanje okubuka ubunjiniyela awanikezi umyalo wokufaka okuncikile, ifomethi yefayela lokumisa, umyalo wokuqalisa noma indlela yokubiza i-API. Ngakho-ke, lapho kusetshenziswa ngempela, kufanele kulandelwe i-README yakamuva nezincazelo zamafayela ezisendaweni yokugcina iphrojekthi; akufanele kucatshangwe ngokwakho ukuthi kukhona iphakheji ethile ye-Python, imbobo yeseva noma isixhumi esibonakalayo se-plugin.

Ukuqinisekisa imingcele ngaphambi kokusetha

1. Qinisekisa ukuthi i-J-Space isebenza esigabeni sokucabanga futhi ayidingi ukuguqula noma ukuqeqesha kabusha izisindo zemodeli.
2. Chaza ngokusobala i-persona ye-Harness okuqondiswe kuyo, i-Tool Schema yokuqala, okuqukethwe okufakwa ngokuzenzakalelayo kanye nesabelomali sokuphuma.
3. Qopha ihardware, indlela yokuhlukanisa izinqubo, ukutholakala kwamathuluzi kanye nemingcele yokufinyelela olwazini.
4. Lungiselela isimo esiqhubekayo, inqubo yokuqinisekisa, ama-checkpoint kanye nendlela yokubuyisela lapho umsebenzi mude.
5. Uma kuqhathaniswa i-Benchmark, qinisekisa ukuthi imodeli eyisisekelo, izimo ze-Harness kanye nendlela yokukala ziyefana.

Lezi zimo akuzona nje izincazelo zemvelo ezingabalulekile. I-README ikubeka ngokusobala ukuthi isixhumi esibonakalayo, amathuluzi kanye nemingcele yokufinyelela olwazini kungashintsha imiphumela ebonwayo.

Indlela yokusebenzisa eyisisekelo

Isinyathelo sokuqala: ukwakha incwadi yesimo somsebenzi

I-J-Space isebenzisa incwadi ethi Goal / Core / Verified / Open / Next ukugcina isimo semisebenzi edlula amafayela, amathuluzi kanye nesikhathi eside. Isibonelo esilandelayo serekhodi lomsebenzi senzelwe ukuqonda incazelo yezinkambu kuphela, akusona ifomethi yefayela lokumisa elinqunywe yindawo yokugcina:

Goal: Ukulungisa inkinga yokulayisha ukumiswa kuwo wonke amafayela
Core: Ukugcina ukuhambisana kwesixhumi esibonakalayo esikhona, ungaguquli amagama emingcele omphakathi
Verified: Iphutha seliphinde lakhiwa; ukuhlaziya ifayela elilodwa kusebenza kahle
Open: Ukulandelana kokumboza kwamafayela amaningi akukaqinisekiswa
Next: Qalisa ukuhlolwa okuncane komehluko bese uhlola ilogi yokulayisha

• Goal: Umgomo wokugcina okufanele ufezekiswe.
• Core: Umngcele oyinhloko ongafanele ulahleke.
• Verified: Amaqiniso asevele aqinisekiswe ubufakazi noma ukuhlolwa.
• Open: Imibuzo nezingozi ezingakaxazululwa.
• Next: Isenzo esilandelayo esiqondile, hhayi ukuqhubeka nokuhlaziya okungacacile.

Isinyathelo sesibili: ukubona izingozi zangaphandle zomzila wamanje

Ungahluleli isimo semodeli ngokusekelwe emagameni okuqala kuphela; hlola ukuziphatha komsebenzi. Uma imodeli inikeza isiphetho ngokushesha kodwa ingahlanganisi imingcele, ingasebenzisi amathuluzi noma ingaqedi ukuqinisekisa, phatha lokhu njengengozi yohlangothi lokucabanga okufushane. Uma iqhubeka ibhala kabusha uhlelo, ibambezeleka ukubiza amathuluzi noma ingakwazi ukuvala umsebenzi nangemva kokuba ubufakazi sebanele, phatha lokhu njengengozi yohlangothi lokucabanga okude.

Isinyathelo sesithathu: ukwengeza ukuxhumanisa nokuqinisekisa ohlangothini lokucabanga okufushane

Lapho iseshini incike ekwahluleleni okusheshayo, kungasetshenziswa lezi zindlela ezishiwo ku-README:

• bridge-before-conclusion: Qedela ukucabanga okuphakathi okudingekayo nokuxhumana kwemingcele ngaphambi kokuletha isiphetho.
• Ukusakaza imingcele eyabiwe: Vumela izinyathelo ezidlula amafayela namathuluzi ukuthi ziqhubeke zibona imingcele efanayo.
• Empirics: Sebenzisa ubufakazi obubonakalayo ukusekela izinqumo.
• verifier: Hlola ngokuzimele ukuthi umphumela uyahlangabezana yini nomgomo.
• coverage: Qinisekisa ukuthi ububanzi bokuqinisekisa abushiyanga igatsha elibalulekile.

Ngokwesibonelo, ungamemezeli umsebenzi uphelile ngokushesha ngemva kokuphumelela kokuhlolwa kwendawo. Qala uhlole ukuthi amafayela ahlobene, okokufaka kwemingcele kanye nemiphumela yamathuluzi konke kumboziwe yini, bese ubuyekeza i-Verified.

Isinyathelo sesine: ukubopha uhlangothi lokucabanga okude esenzweni

Lapho iseshini ihlaziya ngokuphindaphindiwe kodwa ingakhiqizi umngcele omusha, kungasetshenziswa:

• Inkulumo yomuntu wokuqala esebenzayo, ebopha ukulandisa emsebenzini wamanje nasesenzweni.
• I-Next ecacile nesebenzisekayo.
• Uhlu olulinganiselwe lwezinketho, ukugwema ukunweba ngokungapheli isikhala sezixazululo.
• Ukuhlolwa komehluko, kusetshenziswa ukuhlolwa okuncane ukuhlukanisa izincazelo ezingaba khona.
• I-checkpoint, egcina isimo ezindaweni ezibalulekile futhi iqhubekisela umsebenzi ekuvaleni.

Ngokwesibonelo, esikhundleni sokuqhubeka ubala izimbangela eziningi ezingaba khona, gcina izinketho ezimbalwa bese wenza ukuhlolwa okuncane okungazihlukanisa. Umphumela wokuhlolwa kufanele ubhalwe ngokushesha ku-Verified noma ku-Open, bese kubuyekezwa isinyathelo esilandelayo.

Isinyathelo sesihlanu: ukuvuselela isimo ezindaweni zokushintsha amathuluzi

Ukushintsha amathuluzi, ukuwela amafayela noma ukulinda isikhathi eside kungabangela ukuphambuka kwesimo. Njalo lapho kushintshwa ithuluzi noma kuvuselelwa umsebenzi, kufanele kufundwe kabusha umgomo, imingcele eyinhloko, amaqiniso aqinisekisiwe, imibuzo evulekile kanye nesenzo esilandelayo. Umsebenzi wendlela yokubuyisela ukugcina ukuqhubeka komsebenzi wangaphandle, hhayi ukuvumela imodeli ukuthi ishintshe ngokukhululekile indlela yangaphakathi yeketango lokucabanga.

Indlela yokufunda imiphumela ye-Benchmark

Amarekhodi okuqhathanisa e-DeepSeek V4-Pro-0813

Endaweni yokuhlola ekhona yephrojekthi, amarekhodi amaphuzu omdabu e-V4-Pro-0813 nangemva kokwengezwa kwe-J-Space ami kanje; inani eliphezulu lingcono:

• HLE ngaphandle kwamathuluzi: 42.7 → 48.0
• HLE ngamathuluzi: 60.0 → 67.7
• Terminal Bench 2.1: 87.9 → 90.1
• NL2Repo: 61.5 → 73.4
• CyberGym: 83.3 → 86.8
• DeepSWE: 62.7 → 72.0
• Toolathlon-Verified: 74.1 → 79.5
• Agents' Last Exam: 25.7 → 30.3
• AutomationBench Public: 31.8 → 38.2

Amarekhodi ephrojekthi e-V4-Flash-0731 nawo abonisa izinguquko zamaphuzu amaningi, isibonelo i-HLE enamathuluzi isuka ku-51.5 iye ku-60.6, i-NL2Repo isuka ku-54.2 iye ku-70.2, kanti i-DeepSWE isuka ku-54.4 iye ku-67.4.

Ukuqonda indlela yobunjiniyela ngokohlobo lomsebenzi

• HLE ngaphandle kwamathuluzi: Gxila ekuxhumaniseni okudingekayo, ekulawuleni ukuzethemba nasekuhloleni okuzimele, ugweme iziphetho zangaphambi kwesikhathi noma ukwandisa okungenamsebenzi ngale kwemingcele yolwazi.
• HLE enamathuluzi ne-CyberGym: Thuthukisa ukuthola nokuhlanganisa ubufakazi usebenzisa i-Empirics, izindawo zokushintsha amathuluzi kanye nokumbozwa kokuqinisekisa.
• Terminal Bench: Sebenzisa i-Next ecacile, ukuphinda uzame ukuxilonga kanye ne-checkpoint ukulinganisa isivinini sesenzo nokuqinisekisa.
• NL2Repo ne-DeepSWE: Gcina imingcele edlula amafayela ngokusakaza okwabiwe, incwadi eqhubekayo kanye nokuqinisekisa.
• Toolathlon-Verified: Phatha ukuhlelwa kwamathuluzi usebenzisa isimo esabiwe, ukuhlolwa kwezindawo zokushintsha kanye ne-coverage.
• Agents' Last Exam ne-AutomationBench: Phatha imisebenzi ehlukahlukene nokwenziwa okunekhefu elide ngokukhetha i-pass, isimo esiqhubekayo kanye nokubuyisela.

Lokhu kuhlobana kuyincazelo yobunjiniyela kuphela. I-Benchmark ayizange imake iseshini ngayinye ngokwesimo se-diode, ngakho akunakwenzeka ukubala ingxenye yomnikelo we-diode kumaphuzu, futhi zonke izinguquko azikwazi ukubangelwa yindlela eyodwa kuphela.

Iziphakamiso zokuzijwayeza ezithuthukile

Ungaphathi i-trajectory probe njengenkomba yekhwalithi

Ubude bochungechunge lokucabanga, isitayela somugqa wokuqala namagama athile kungasiza kuphela ekuqaphelweni kwe-trajectory. Okufanele kuhlolwe ngempela ukuthi umsebenzi uqediwe yini, amathuluzi athathe izinyathelo ezisebenzayo yini, ubufakazi banele yini, ukuhlolwa kokufakazela kuhlanganisa konke yini, nokuthi amaphuzu e-Benchmark yokuqala ashintshile yini.

Gcina umongo wokuhlola uhambisana

Lapho uqhathanisa nesisekelo, kufanele urekhode futhi uzame ukugcina kungashintshi izimo zehadiwe, ukuhlukaniswa kwezinqubo, izinkomba zamathuluzi, imingcele yokufinyelela olwazini, i-persona, i-Schema yomjikelezo wokuqala, isabelomali somphumela kanye nokuqukethwe okufakwa ngokuzenzakalelayo. Kujwayelekile ukuthi amaphuzu ashintshe uma kusetshenziswa ukucushwa okuhlukene kwe-Harness.

Gwema ukuphishekela indawo ye-mixed engazinzile

Ungayiqondi indawo yenguquko njengokujula kokucabanga “okumaphakathi” okusebenzisekayo. Indlela ezinzile kakhudlwana ukukhetha indawo yokuqala ezinzile nefanele, bese usebenzisa indlela yemisebenzi yangaphandle ye-J-Space ukulungisa ukungahambisani phakathi kwe-trajectory emisiwe nezigaba zomsebenzi.

Hlukanisa ukuthuthukiswa kwekhono nokuthuthukiswa kwenqubo

I-J-Space ayidali ulwazi olungenayo imodeli eyisisekelo, futhi ayiqinisekisi ushintsho oluhle kuyo yonke imisebenzi, amamodeli noma ama-Harness. Ilawula kakhulu inqubo yomsebenzi yangaphandle, ngakho amakhono olwazi, i-trajectory yokuqala kanye nenqubo yomsebenzi kufanele kuhlolwe ngokwehlukana.

Sebenzisa ama-checkpoint ukweseka ukubuyiselwa

Ngemva kokuqeda ukubizwa kwethuluzi okubalulekile, ukulungisa amafayela amaningi noma umjikelezo owodwa wokuqinisekisa, gcina i-checkpoint. Lapho ubuyisela, qala ngokwakha kabusha i-Goal / Core / Verified / Open / Next, bese wenza isenzo esisha, ukuze ugweme ukuphinda ucabange kusukela ekuqaleni futhi ulahlekelwe amaqiniso asevele aqinisekisiwe.

Imingcele Yokusetshenziswa

• I-overfitting ye-chain-of-thought diode kanye nesixhumi esibonakalayo esilula kakhulu kuyimibono yokuxilonga ubunjiniyela bebhokisi elimnyama, hhayi ukudalulwa okusemthethweni kwe-DeepSeek mayelana nesakhiwo noma inkinga yokuqeqeshwa.
• Ubudlelwano bezigaba phakathi kwe-Anchored Standard, Routing Suite kanye ne-J-Space abukaqinisekiswa ukuhlolwa okuhlanganisiwe okujwayelekile.
• Amaphuzu akhona awomongo othile wokuhlola wephrojekthi, futhi awanele ukusungula ukusebenza okuvamile kuwo wonke amamodeli.
• Amarekhodi amaphuzu awakusekeli ukuhlukaniswa okunembile komnikelo oyimbangela.
• I-J-Space ayiqinisekisi ukusebenza kuyo yonke imisebenzi, amamodeli nama-Harness.

Isiphetho

Inani eliyinhloko le-J-Space alikho ekumangaleleni ukuthi isusa uhlobo oluthile lokucabanga oluyisisekelo, kodwa lise ekuphatheni imisebenzi eyinkimbinkimbi kusetshenziswa isimo esiqhubekayo, izenzo ezicacile, ubufakazi bamathuluzi, ukuhlolwa kokufakazela kanye nokubuyiselwa ngemva kokwehluleka. Ekusetshenzisweni kwangempela, kufanele kuqala ulawule isixhumi esibonakalayo nezimo zokuhlola, bese usebenzisa ileja nama-checkpoint ukugcina ukuqhubeka komsebenzi, futhi ekugcineni uhlole umphumela ngekhwalithi yokuqedwa komsebenzi kanye nemiphumela engaqinisekiswa kabusha.

Ekusetshenzisweni kobunjiniyela, ungacaphuna J-Space Cognition Suite V3.6. Lapho kuhileleka ubufakazi bemishini noma iziphetho zesayensi, kufanele kulindwe izinguqulo zamaphepha ezizayo, kunokwenza iziphetho ezeqa ububanzi bobufakazi obutholakala kumarekhodi obunjiniyela amanje.