Price: 0
Number of applications: 1
12.01.26 (inclusive)
Partnership
Idea
ICT tasks
Media sphere
Other technological solutions
Software/ IS
Bagdarlamalyk kamtamasyz etudi testileudin dasturli adisteri (unit tester) generative chat bottards texeruge jaramaida. Dialogtardy kolmen testileu tim kop uakytty alady, subjectively bolyp keledi zhane paidalanushylardyn minez-kulkyn barlyk nuskalaryn kamti almaida. Negizgi bottyn promptary nemese bilim bazasy zhanartylgan kezdeh regression kaupi zhogary (bot manmindi umyta basta nemese "hallucination" ushyrady). Biz botty ondiristik ortaga (production) shygarmas buryn, onyn syzyk emes, kurdeli dialogtarda "surinbeitine" koz zhetkizuimiz kerek.
QA processin automattandyru: Hypothesalar men promptardy testileu uakytyn birneshe kunnen birneshe minutka dein kyskart. Onim sapasy: "Hallucinatiyalar" men manmindi zhogaltu zhagdailaryn nakhty client kormes buryn anyktau. Objective: Bottyn arbir zhanartuy boyynsha dialog sapasyn sandyk metrikalaryn (Scorecard) alu. Scale Tau mumkindigi: Zhuyenin turaktylygyn texeru ushin bir tunde 1000 dialogue simulationsin iske kosu mumkindigi.
Baizhanissov B.
Purpose and description of task (project)
Maksaty zhane tapsyrmanyn sipattamasy (Purpose and description of the task) Matsaty: Turistik agenttiktinnakty clienttinin minez-kulkyn imitationalaytyn zhane texeriletin bottyn zhauaptaryn sapasyn bagalaytyn automattandyrylgan zhuyeni ("Bot-testilushi") kuru. Tapsyrmanyn mani: Bizdin negizgi botymyzdyn API-yna suraular zhiberetin, jauaptardy kabyldap, olarga baga beretin, rold turgydan "kiyn" nemese "kurdeli" client bola alatyn kurald azirleu kazhet. Talap etilin functional (Umitkerden usynystar kutemiz): Personalar men scriptylerdi generationau (Simulation): Bot-testileushi arturli rulderdi oynai bilui kerek (series: "Budget shekteuli tourist", "Balaly otbasy", "Shydamsyz client"). Tapsyrma: Turlar, konak uiler, vizalar zhane ushu biletteri boyynsha nakhty suranystardy imitationau. Manmindi ustap turudy texeru (Context & Memory Testing): Bul – sonny talap. Testileushi negizgi botty kasakan "shatastyru" kerek. Scenario: Turkiyadagi konak uy turaly surau -> Ushu bileti turaly surau -> Kaytadan konak uydegi tamakan turaly surau (konak uy atauyn kaytalamastan). Umitkerge surak: Negizgi bottyn aangime zhelisin zhogaltpaganyn bagdarlamalyk turde kalai texeresiz? Stress Testing (Adversarial Testing): Aralas nietter (Mixed Intents): birneshe kyzmetti surau ("Mysyrga bargym keledi, birak ushu yerten bolsyn zhane konak uy 5 zhuldyzdy, ari arzan bolsyn"). Taqyrypty auystyru: Turdy tandaudan akshany kaytaru maselesine kenetten otu. Bagalau moduli (AI Judge): Testileushi zhai gana soylesip koimai, yesep berui kerek. Metricalar: Zhauaptyn relevanttygy (1-10), Faktilik daldik (hallucinationsardyn zhoktygy), Karym-katynas tones. Umitkerge surak: Zhauaptardyn sapasyn automaty turde bagalau ushin kandai adistemi usynasyz (LLM-as-a-Judge, RAGAS nemese baska)?
Whatsapp
