Hollow markers & dashed spokes: axis not yet scored
G
27.5
A
39
U
—
N
—
T
n/d
L
—
E
—
T
100
Specification
- Parameters
- 1B
- Architecture
- gemma3_text
- Size on disk
- 0.74 GB
- Quantization
- QAT 4bit
- Format
- MLX
- Reasoning (CoT)
- No
- Internal ID
- M26
- Mean speed
- 239.2 tok/s across suites
- Model card
- huggingface.co
Suite results
| Suite | Score | Avg / 20 | Tests | tok/s |
|---|---|---|---|---|
| General capability (13-task real-workload suite) 1a | 71.5 / 260 | 5.5 | 13/13 | 312.8 |
| Agentic tool-calling & protocol adherence 1b | 62.4 / 160 | 7.8 | 8/8 | 165.5 |
Each test is LLM-judged 0–20 against a fixed rubric; suite max = tests × 20. Where fewer tests ran than the suite total, unrun tests count as zero toward the axis score. See methodology.