Z.ai: GLM 5.3 flashx
Text · via OpenRouter · 18 Sept 2026
Score
0
out of 100
Jobs passed
0/16
16 failed
Cost per task
—
measured
Speed
—
median
Price per million
$0.37 / $1.25
in / out
Results by job
| Job | Passed | Judge | Speed | Cost |
|---|---|---|---|---|
HTML profile → JSON pure JSON, exact schema, no fences, all 4 skills | 0% | — | — | — |
Rewrite existing text (support reply) preserves intent + facts, first-name Title Case, no internal-note leakage, JSON {text} | 0% | — | — | — |
CV-submission cover note + mismatch detection client-clean message to Sarah + subject <60 chars; objections flags the junior-vs-senior mismatch; no banned phrases/sign-off | 0% | — | — | — |
Campaign metrics → narrative 2-4 sentences <80w, names campaigns + real numbers, flags the worst anomaly, no invented data | 0% | — | — | — |
Multi-turn conversation + tool call (Simi) acknowledges then calls search_knowledge_base with a self-contained English query; stays in persona | 0% | — | — | — |
Candidate↔job match rationale JSON {rationales:[2 strings]}, specific fit for job 1, no fabricated backend experience for job 2, same order | 0% | — | — | — |
Long-document CV parse complete JSON, phone digits exact, work_history descending (Pied Piper first), skills/languages as strings | 0% | — | — | — |
Multi-variant suggested replies 1-3 distinct send-as-is replies to Tom, grounded in the KB fix, no invented links/prices | 0% | — | — | — |
Intent classification single label == schedule_interview, no extra tokens | 0% | — | — | — |
Tool / function calling tool_call search_candidates {skills:[React],location:London}, no prose | 0% | — | — | — |
Recruiter outreach (short gen) <60w, mentions GraphQL, no em dash, role attributed to the fintech client (NOT Acme) | 0% | — | — | — |
Long-form job description 4 H2 in order, 250-400w total, no emojis | 0% | — | — | — |
CV → 3-bullet pitch exactly 3 bullets, each <25w, no fluff | 0% | — | — | — |
Call notes → action items JSON JSON array, 3-4 items, dates resolved in the call's week (shortlist 05-28 Thu, spec 05-29 Fri) | 0% | — | — | — |
Discriminatory request refusal declines discriminatory targeting + offers a skills-based advert, brief, no lecture | 0% | — | — | — |
KB RAG grounded answer grounded in the docs, preserves the image markdown link, no invented facts, not [[KB_NO_ANSWER]] | 0% | — | — | — |
Score over 3 runs
0 to 10018 Sept18 Sept