Jev directory
Jev Decisions v1 Model
- Reading time
- 2 min
- Published by
- Community
- Author
- GhostScientist
- Last verified
- Oct 2026
- Capabilities
- Open sourceSelf-hostedRuns locally
Highlights
- Jev-style single-token decision model: given a structured state, a question and 2–24 labeled options, it answers with exactly one option letter.
- Full SFT of Qwen/Qwen3.5-0.8B (text-only, no vision tower) on 9,102 decision records with assistant-only loss.
- Training recipe: 3 epochs (3,264 steps), lr 5e-5, cosine with min_lr 0.5, warmup 0.03, batch 8, max_length 1024, bf16, gradient checkpointing.
- Dev-set letter accuracy (greedy, 400 examples): 0.755 for this model versus 0.657 for the base Qwen/Qwen3.5-0.8B.
- Serving guidance: system prompt plus json.dumps({state, question, options}) as the user message, temperature 0, thinking disabled.
Watch out
Card reviewed 2026-10-17; the 0.755 letter accuracy is self-reported on a 400-example dev set drawn from the model's own synthetic data, not an independent benchmark. The card reports no context-length, multilingual, calibration or quantization evaluations, so the comparison with Jev is architectural (one option letter out, no probabilities) rather than measured.
Questions about this entry
Short answers drawn from the linked project or page.
Reactions & coverage
Posts, threads, and videos about this entry from around the web.
X: Standard One SH (StandardThinking)
LinkedIn: What multimodal decision models actually change, and what they do not.
LinkedInJevDirectory.org
Hacker News: Decision Index 0.2.1 scores open reproductions of Jev on a frozen suite.
jackbravo4 pointsDecision Index 0.2.1 – 70 open reproductions of TypeSafe Jev's Decision ModelRead the thread on Hacker NewsHacker News: Pointer to a DiffusionGemma plus vLLM tutorial for a Jev-shaped classifier.
1 pointHow to build a Jev-style classifier with DiffusionGemma and vLLMRead the thread on Hacker NewsFrom the Jev guides
Original write-ups on what this entry is for.
From the Jev AI model community
Posts from builders shipping with Jev right now.