Skip to content

Jev directory

Decider-31b

Mapika's NVFP4 fine-tune of Gemma-4-31B-it answers typed Choice, Noul and Score questions with calibrated probabilities and no generated text, self-reporting a 64.27 chance-corrected public Decision Index and 39 ms median latency on a B300.
Reading time
2 min
Published by
Community
Author
Mapika
Last verified
Oct 2026

Highlights

  • Gemma-4-31B-it fine-tune merged into the attention and MLP projections, quantized to NVFP4 at about 31 GB: MLP in NVFP4, attention bf16, FP8 KV cache.
  • Self-reported public index 64.27 (raw 73.24), coverage 1.0 and ECE_bw 0.039 over all 140,178 requests of the 0.3 suite.
  • Questions below 0.7 top probability get a second reading with reversed options; that touched 28% of public-suite questions.
  • Median latency 39 ms and p95 531 ms on one B300; the card's RTX PRO 6000 estimate stays under one second for mean and p80.
  • Needs an NVFP4 GPU (B200/B300, RTX PRO 6000, RTX 50 series) and decider-ai 1.9.0; no reasoning trace is ever generated.

Quickstart

bash
python -m venv decider-vllm && . decider-vllm/bin/activate
pip install vllm==0.29.0 fastapi "uvicorn[standard]" jinja2 huggingface_hub
pip install --no-deps "decider-ai>=1.9.0"
DECIDER_MODEL=Mapika/decider-31b uvicorn decider.serve_vllm:app --host 127.0.0.1 --port 8000

Watch out

Card reviewed 2026-10-17; the card states its Decision Index run was not verified by the maintainers and is not on the board, temperatures were fitted on the author's own rows, training used public train splits of benchmarks the index tests (test rows were matched and dropped), and results live in a gated dataset. The repository declares Apache-2.0 while the Gemma-4-31B-it base carries Google's Gemma terms.

Questions about this entry

Short answers drawn from the linked project or page.

Reactions & coverage

Posts, threads, and videos about this entry from around the web.

X: Standard One SH (StandardThinking)

LinkedIn: What multimodal decision models actually change, and what they do not.

LinkedInJevDirectory.org

Hacker News: Pointer to a DiffusionGemma plus vLLM tutorial for a Jev-shaped classifier.

1 pointHow to build a Jev-style classifier with DiffusionGemma and vLLMRead the thread on Hacker News

From the Jev guides

Original write-ups on what this entry is for.

From the Jev AI model community

Posts from builders shipping with Jev right now.

Follow @typesafeai