Jev directory
Decider-31b
- Reading time
- 2 min
- Published by
- Community
- Author
- Mapika
- Last verified
- Oct 2026
Highlights
- Gemma-4-31B-it fine-tune merged into the attention and MLP projections, quantized to NVFP4 at about 31 GB: MLP in NVFP4, attention bf16, FP8 KV cache.
- Self-reported public index 64.27 (raw 73.24), coverage 1.0 and ECE_bw 0.039 over all 140,178 requests of the 0.3 suite.
- Questions below 0.7 top probability get a second reading with reversed options; that touched 28% of public-suite questions.
- Median latency 39 ms and p95 531 ms on one B300; the card's RTX PRO 6000 estimate stays under one second for mean and p80.
- Needs an NVFP4 GPU (B200/B300, RTX PRO 6000, RTX 50 series) and decider-ai 1.9.0; no reasoning trace is ever generated.
Quickstart
python -m venv decider-vllm && . decider-vllm/bin/activate
pip install vllm==0.29.0 fastapi "uvicorn[standard]" jinja2 huggingface_hub
pip install --no-deps "decider-ai>=1.9.0"
DECIDER_MODEL=Mapika/decider-31b uvicorn decider.serve_vllm:app --host 127.0.0.1 --port 8000Watch out
Card reviewed 2026-10-17; the card states its Decision Index run was not verified by the maintainers and is not on the board, temperatures were fitted on the author's own rows, training used public train splits of benchmarks the index tests (test rows were matched and dropped), and results live in a gated dataset. The repository declares Apache-2.0 while the Gemma-4-31B-it base carries Google's Gemma terms.
Questions about this entry
Short answers drawn from the linked project or page.
Reactions & coverage
Posts, threads, and videos about this entry from around the web.
X: Standard One SH (StandardThinking)
LinkedIn: What multimodal decision models actually change, and what they do not.
LinkedInJevDirectory.org
Hacker News: Decision Index 0.2.1 scores open reproductions of Jev on a frozen suite.
jackbravo4 pointsDecision Index 0.2.1 – 70 open reproductions of TypeSafe Jev's Decision ModelRead the thread on Hacker NewsHacker News: Pointer to a DiffusionGemma plus vLLM tutorial for a Jev-shaped classifier.
1 pointHow to build a Jev-style classifier with DiffusionGemma and vLLMRead the thread on Hacker NewsFrom the Jev guides
Original write-ups on what this entry is for.
From the Jev AI model community
Posts from builders shipping with Jev right now.