CommunityJev Models & Reimplementations
Releasing the Inner Jev: A Simple Recipe for Open Decision Models (arXiv 2610.17205)
Shows that open instruction-tuned models already read decisions from answer-letter logits without training, and that LoRA fine-tuning with a decision head lifts them past Jev: Gemma 4 31B goes from 79.6 to 84.4 on the new 2,352-question OpenDecisions set and scores 81.5 on JevBench v1.7.
- Format
- Article
- Published by
- Community
- Last verified
- Oct 2026
Highlights
- Reads answers from letter logits (A, B, C, and so on) at the last token position with no additional training.
- Fine-tunes with LoRA and a decision head initialized from a slice of the language-model head.
- Gemma 4 31B scores 79.6 on OpenDecisions untuned, versus Jev's 80.1, then 84.4 after fine-tuning.
- The fine-tuned model reaches 81.5 on JevBench v1.7, 4.4 Capability points above Jev, and 4.3 on OpenDecisions.
- OpenDecisions is a 2,352-question validation set reflecting JevBench task composition with a Capability score.
Watch out
arXiv preprint submitted October 12, 2026 (cs.AI) by Jonathan Geuter, Andrew Cheng, and David Alvarez-Melis. Results are self-reported; the abstract says the models, serving code, and OpenDecisions are released but names no repository, and it does not detail how many seeds or runs back the scores.
Questions about this entry
Short answers drawn from the linked project or page.
According to the paper, nothing extra: reading out answers from letters A, B, C, and so on in the model's output logits at the last token position already gives comparable performance without additional training.
It uses LoRA plus a decision head initialized from a slice of the language-model head. Gemma 4 31B moves from 79.6 to 84.4 on OpenDecisions, which the paper says sets a new state of the art on that set.
It scores 84.4 on OpenDecisions and 81.5 on JevBench v1.7, outperforming Jev by 4.3 and 4.4 Capability points respectively, while untuned it scored 79.6 on OpenDecisions versus Jev's 80.1.
A new 2,352-question validation dataset designed to reflect the task composition of JevBench, computing a Capability score based on accuracy and calibration metrics.
Gemma 4 31B, Gemma 4 12B, Qwen3.6-27B, and Qwen3.5-4B, each fine-tuned with LoRA and a decision head initialized from a slice of the language-model head.
On a suite of public decision datasets the models achieve accuracy comparable to Jev with lower calibration error, according to the paper's self-reported comparison.
The abstract says the authors release their models, serving code, and OpenDecisions, but the digest names no repository URL, so there is no release location to point to from this entry.
Reactions & coverage
Posts, threads, and videos about this entry from around the web.
LinkedIn: What multimodal decision models actually change, and what they do not.
LinkedInJevDirectory.org
Hacker News: Decision Index 0.2.1 scores open reproductions of Jev on a frozen suite.
jackbravo4 pointsDecision Index 0.2.1 – 70 open reproductions of TypeSafe Jev's Decision ModelRead the thread on Hacker NewsHacker News: Pointer to a DiffusionGemma plus vLLM tutorial for a Jev-shaped classifier.
1 pointHow to build a Jev-style classifier with DiffusionGemma and vLLMRead the thread on Hacker NewsHacker News: A one-token logprob wrapper that also classifies webcam frames.
allanrbo151 pointsA single function Jev-like wrapper for LLMs, including vision modelsRead the thread on Hacker NewsRelated terms
Glossary definitions related to this entry.
More Jev resources like this
1.3kGitHub stars
Reads a typed decision from one prefill of a pretrained instruction-tuned model by restricting the next-token distribution to option tokens, then corrects label and position bias with no gradient steps. Averaging over cyclic rotations lowers order-flip rates and raises accuracy on 11 of 11 models.
Jev Models & ReimplementationsArticle#community#research#arxiv
Community
nokia-applied-research/AnyJevPython
nokia-applied-research/AnyJevPythonSanSi turns a pre-trained looped language model into a typed decision model that revises its hidden state across loops without generating tokens. On 10,027 test decisions from 59 sources it reaches 72.0% accuracy, 13.5 points above a same-shaped non-looped model trained with the same recipe.
Jev Models & ReimplementationsArticle#community#research#arxiv
Community
423GitHub stars
PostHog's reasoning Jev-style classifier with a diffusion drafter, reporting higher accuracy than Kev-9B and hosted Jev on held-out and JevBench tiers.
Jev Models & Reimplementations#community#evaluation#open-models
Community
PostHog/jeevesPython
PostHog/jeevesPythonIntroduces Jeva, a decision-native architecture that encodes the request and each option separately and scores options symmetrically. It targets null-awareness, permutation invariance, option scalability, and cacheability, reporting near-perfect null detection and no decision flips under tested permutations.
Jev Models & ReimplementationsArticle#community#research#arxiv
Community
A working RLCD implementation for reasoning models: the model samples a rationale, and a strictly proper scoring rule grades the answer distribution it commits to afterward. With Qwen3-1.7B it matches or beats SFT, RFT/STaR, and GRPO in accuracy and beats all in selective prediction.
Jev Models & ReimplementationsArticle#community#research#arxiv
Community
ZimmyGao/openjev-rlcdPython
ZimmyGao/openjev-rlcdPython0GitHub stars
Trains a small decision head label-free to recover about 99% of a frozen language model's multiple-choice accuracy using two-thirds of its transformer layers. Its +1T variant reaches 75.0% mean accuracy across eight benchmarks versus 75.7% for the full model, with higher batched vLLM throughput.
Jev Models & ReimplementationsArticle#community#research#arxiv
Community
Ujjawal-K-Panchal/FunDMPython
Ujjawal-K-Panchal/FunDMPythonFrom the Jev guides
Original write-ups on what this entry is for.
More than eighty preprints now evaluate, attack, and reproduce the typed-decision class. The broadest board, the coherence gap, the rejection bottleneck, and the attacks that still work.
Jev Practices & Patterns#research#evaluation#calibration
Read article
Training recipes, looped architectures, and language ports: what the open side of the typed-decision class shipped this month, and how to pick by runtime and calibration instead of the leaderboard.
Jev Models & Reimplementations#open-models#training#local
Read article
Base decision checkpoints sit near chance on purpose. The typed-decisions loop, the corpora behind the students, and the temperature fit that turns probabilities into thresholds.
Jev Practices & Patterns#fine-tuning#calibration#open-models
Read article
From the Jev community
Posts from builders shipping with Jev right now.