Skip to content

Jev directory

Jev Decisions v1 Model

GhostScientist's Jev-inspired single-token decision model: a full SFT of Qwen/Qwen3.5-0.8B that answers a structured state/question/options task with exactly one option letter, at a card-reported 0.755 greedy dev accuracy against 0.657 for the base model.
Reading time
2 min
Published by
Community
Author
GhostScientist
Last verified
Oct 2026
Capabilities
Open sourceSelf-hostedRuns locally

Highlights

  • Jev-style single-token decision model: given a structured state, a question and 2–24 labeled options, it answers with exactly one option letter.
  • Full SFT of Qwen/Qwen3.5-0.8B (text-only, no vision tower) on 9,102 decision records with assistant-only loss.
  • Training recipe: 3 epochs (3,264 steps), lr 5e-5, cosine with min_lr 0.5, warmup 0.03, batch 8, max_length 1024, bf16, gradient checkpointing.
  • Dev-set letter accuracy (greedy, 400 examples): 0.755 for this model versus 0.657 for the base Qwen/Qwen3.5-0.8B.
  • Serving guidance: system prompt plus json.dumps({state, question, options}) as the user message, temperature 0, thinking disabled.

Watch out

Card reviewed 2026-10-17; the 0.755 letter accuracy is self-reported on a 400-example dev set drawn from the model's own synthetic data, not an independent benchmark. The card reports no context-length, multilingual, calibration or quantization evaluations, so the comparison with Jev is architectural (one option letter out, no probabilities) rather than measured.

Questions about this entry

Short answers drawn from the linked project or page.

Reactions & coverage

Posts, threads, and videos about this entry from around the web.

X: Standard One SH (StandardThinking)

LinkedIn: What multimodal decision models actually change, and what they do not.

LinkedInJevDirectory.org

Hacker News: Pointer to a DiffusionGemma plus vLLM tutorial for a Jev-shaped classifier.

1 pointHow to build a Jev-style classifier with DiffusionGemma and vLLMRead the thread on Hacker News

From the Jev guides

Original write-ups on what this entry is for.

From the Jev AI model community

Posts from builders shipping with Jev right now.

Follow @typesafeai