← Leaderboard
Qwen3.8-27B MLX 8bit (lmstudio-community)
Tested Rank #20 of 36 · 3/8 GAUNTLET progress
Hollow markers & dashed spokes: axis not yet scored
G
60.5
A
87.5
U
—
N
—
T
n/d
L
—
E
—
T
6.4
Specification
- Parameters
- 27B dense
- Architecture
- qwen3_5
- Size on disk
- 28 GB
- Quantization
- 8bit
- Format
- MLX
- Reasoning (CoT)
- Yes — emits reasoning tokens
- Internal ID
- M25g
- Mean speed
- 15.4 tok/s across suites
- Model card
- huggingface.co
Suite results
| Suite | Score | Avg / 20 | Tests | tok/s |
|---|---|---|---|---|
| General capability (13-task real-workload suite) 1a | 157.3 / 260 | 12.1 | 13/13 | 15 |
| Agentic tool-calling & protocol adherence 1b | 140 / 160 | 17.5 | 8/8 | 15.8 |
Each test is LLM-judged 0–20 against a fixed rubric; suite max = tests × 20. Where fewer tests ran than the suite total, unrun tests count as zero toward the axis score. See methodology.