Jev directory
Decider 0.8B
- Reading time
- 2 min
- Published by
- Community
- Author
- Mapika
- Last verified
- Oct 2026
Highlights
- 1.4 GB bf16 checkpoint on Qwen/Qwen3.5-0.8B-Base; one epoch over 1.47M examples and 455M tokens on one GH200.
- In-task accuracy 0.776 with ECE 0.032 across 69 tasks; held-out 0.707 with ECE 0.096 across 24 tasks.
- Within 1 to 4 points of decider-2b on routing, classification, yes/no judgments and JSON lookups, 1.5x faster.
- Gives up knowledge, not format: TruthfulQA 0.41 vs 0.55, OpenBookQA 0.67 vs 0.81 and ARC 0.74 vs 0.86.
- Same interface as the family: decider.infer.Decider and POST /v1/systemone in TypeSafe Jev's format.
Quickstart
from decider.infer import Decider
d = Decider("Mapika/decider-0.8b")
d.system_one(
{"ticket": "I was charged twice for order A-104. Please refund the duplicate."},
{"team": {"type": "choice", "instructions": "Which team should handle this?",
"criteria": {"billing": "Charges, invoices, refunds", "technical": "Bugs, outages", "other": None}},
"refund_requested": {"type": "noul", "instructions": "Does the customer ask for a refund?"}})Watch out
Card reviewed 2026-10-17; all comparisons are self-reported on the card, which says it is a weaker game player (CliffWalking fails, held-out Freeway scores 0) and that what it gives up against the 2B is knowledge, not the decision format. The numbers come from one training run.
Questions about this entry
Short answers drawn from the linked project or page.
Reactions & coverage
Posts, threads, and videos about this entry from around the web.
X: Standard One SH (StandardThinking)
LinkedIn: What multimodal decision models actually change, and what they do not.
LinkedInJevDirectory.org
Hacker News: Decision Index 0.2.1 scores open reproductions of Jev on a frozen suite.
jackbravo4 pointsDecision Index 0.2.1 – 70 open reproductions of TypeSafe Jev's Decision ModelRead the thread on Hacker NewsHacker News: Pointer to a DiffusionGemma plus vLLM tutorial for a Jev-shaped classifier.
1 pointHow to build a Jev-style classifier with DiffusionGemma and vLLMRead the thread on Hacker NewsFrom the Jev guides
Original write-ups on what this entry is for.
From the Jev AI model community
Posts from builders shipping with Jev right now.