← Leaderboard

Qwen3.8-27B UD-Q6_K_XL GGUF (Unsloth Dynamic)

Tested Rank #41 of 53 · 4/8 GAUNTLET progress
Generalist — 89 / 100 G Agentic — 100 / 100 A Understanding — pending U Needle — pending N Thinking — pending T Live — pending L Engineering — 33.5 / 100 E Throughput — 5.9 / 100 T

Hollow markers & dashed spokes: axis not yet scored

G
89
A
100
U
—
N
—
T
n/d
L
—
E
33.5
T
5.9

Specification

Parameters
27B dense
Architecture
qwen3_5
Size on disk
24.43 GB
Quantization
Q6_K_XL
Format
GGUF
Runtime
LM Studio
Class
Standard
Reasoning (CoT)
Yes — emits reasoning tokens
Internal ID
M30
Mean speed
20.4 tok/s across suites
Model card
huggingface.co

Suite results

Suite Score Avg / 20 Tests n tok/s Run
General capability (13-task real-workload suite) 1a 231.4 / 260 17.8 13/13 n=1 19.2 run 2026-10-07
Test Category Score tok/s
A1 Dev/Ops Scripting 0/20 17.6
A2 Dev/Ops Scripting 20/20 18.2
A3 Dev/Ops Scripting 20/20 17.8
A4 Dev/Ops Scripting 11/20 18.8
A5 Dev/Ops Scripting 20/20 18.5
A6 Dev/Ops Scripting 20/20 17.8
B1 Document Processing 20/20 22
B2 Document Processing 20/20 20.5
B3 Document Processing 20/20 18.8
C1 Content Production 20/20 18.5
C2 Content Production 20/20 19.6
C3 Content Production 20/20 19.4
C4 Content Production 20/20 20.7

Category mean Dev/Ops Scripting 15.2Document Processing 20Content Production 20

Agentic tool-calling & protocol adherence 1b 160 / 160 20 8/8 n=1 24.3 run 2026-10-05
Test Category Score tok/s
WA1 Tool Calling & Protocol Adherence 20/20 23.8
WA2 Tool Calling & Protocol Adherence 20/20 26.2
WA3 Tool Calling & Protocol Adherence 20/20 24
WA4 Tool Calling & Protocol Adherence 20/20 21.5
WA5 Tool Calling & Protocol Adherence 20/20 23.5
WB1 Agent Robustness & State Management 20/20 14.4
WB2 Agent Robustness & State Management 20/20 16.2
WB3 Agent Robustness & State Management 20/20 15.3

Category mean Tool Calling & Protocol Adherence 20Agent Robustness & State Management 20

Coding depth 1c 60.3 / 180 6.7 9/9 n=1 17.7 run 2026-10-10
Test Category Score tok/s
K1 Coding — Concurrency 0/20 18.4
K2 Coding — Algorithms 20/20 18.4
K3 Coding — Security Review 0/20 17.5
K4 Coding — Performance 0/20 16.5
K5 Coding — Refactoring Under Constraints 20/20 17.7
K6 Coding — Test Writing 20/20 18.6
K7 Coding — React Component (typed) 0/20 17.5
K8 Coding — TypeScript Type System 0/20 17.6
K9 Coding — React Debugging 0/20 17

Category mean Coding — Concurrency 0Coding — Algorithms 20Coding — Security Review 0Coding — Performance 0Coding — Refactoring Under Constraints 20Coding — Test Writing 20Coding — React Component (typed) 0Coding — TypeScript Type System 0Coding — React Debugging 0

Each test is LLM-judged 0–20 against a fixed rubric; suite max = tests × 20. An ADJ chip marks a cell carrying a subjective adjustment from the maintainer; the judged score is the one shown, is unchanged, and remains what the axes, ranks and tie bands are computed from. Hover for the reason. Rows with a ▶ expand to the per-test breakdown. Where fewer tests ran than the suite total, unrun tests count as zero toward the axis score. See methodology.