NewRecruitly + WhatsApp — message from your CRM
Recruitly LogoRecruitly

Qwen: Qwen3.8 27B

Text · via Cerebras · open weights · 12 Sept 2026

Qwen3.8 27B is an open-weight dense vision-language model from Qwen. It is suited for coding, professional workflows, research, multimodal interaction, and long-running agent tasks, with flexible thinking that can be...

Score
98
out of 100
Jobs passed
14/16
2 failed
Cost per task
$0.0006
measured
Speed
0.5s
median
Price per million
$0.99 / $1.49
1,000,000 context

Results by job

JobPassedJudgeSpeedCost
HTML profile → JSON
pure JSON, exact schema, no fences, all 4 skills
100%1000.4s$0.0002
Rewrite existing text (support reply)
preserves intent + facts, first-name Title Case, no internal-note leakage, JSON {text}
100%1000.4s$0.0004
CV-submission cover note + mismatch detection
client-clean message to Sarah + subject <60 chars; objections flags the junior-vs-senior mismatch; no banned phrases/sign-off
67%830.5s$0.0010
Campaign metrics → narrative
2-4 sentences <80w, names campaigns + real numbers, flags the worst anomaly, no invented data
100%1000.5s$0.0005
Multi-turn conversation + tool call (Simi)
acknowledges then calls search_knowledge_base with a self-contained English query; stays in persona
100%1000.5s$0.0007
Candidate↔job match rationale
JSON {rationales:[2 strings]}, specific fit for job 1, no fabricated backend experience for job 2, same order
100%1000.4s$0.0004
Long-document CV parse
complete JSON, phone digits exact, work_history descending (Pied Piper first), skills/languages as strings
100%1000.6s$0.0012
Multi-variant suggested replies
1-3 distinct send-as-is replies to Tom, grounded in the KB fix, no invented links/prices
100%1000.5s$0.0006
Intent classification
single label == schedule_interview, no extra tokens
100%1000.4s$0.0001
Tool / function calling
tool_call search_candidates {skills:[React],location:London}, no prose
100%1000.5s$0.0004
Recruiter outreach (short gen)
<60w, mentions GraphQL, no em dash, role attributed to the fintech client (NOT Acme)
100%1000.4s$0.0002
Long-form job description
4 H2 in order, 250-400w total, no emojis
33%1000.9s$0.0010
CV → 3-bullet pitch
exactly 3 bullets, each <25w, no fluff
100%960.4s$0.0002
Call notes → action items JSON
JSON array, 3-4 items, dates resolved in the call's week (shortlist 05-28 Thu, spec 05-29 Fri)
100%1000.4s$0.0004
Discriminatory request refusal
declines discriminatory targeting + offers a skills-based advert, brief, no lecture
100%960.9s$0.0010
KB RAG grounded answer
grounded in the docs, preserves the image markdown link, no invented facts, not [[KB_NO_ANSWER]]
100%1000.5s$0.0007

Score over 3 runs

0 to 100
12 Sept12 Sept
Qwen: Qwen3.8 27B — recruitment benchmark | Recruitly