Skip to content

AnyJev Technical Report (arXiv 2610.00831)

Reads a typed decision from one prefill of a pretrained instruction-tuned model by restricting the next-token distribution to option tokens, then corrects label and position bias with no gradient steps. Averaging over cyclic rotations lowers order-flip rates and raises accuracy on 11 of 11 models.

Stars
1.3k
Language
Python
License
APACHE-2.0
Format
Article
Published by
Community
Last verified
Oct 2026

Highlights

  • Reads a typed decision from one prefill by restricting the next-token distribution at the answer position to option tokens.
  • Corrects label bias by dividing out a label prior estimated from unlabelled inputs.
  • Averages log-probabilities over the K cyclic rotations of the option list to correct position bias.
  • On two 20-option tasks rotations lower order-flip rates from 0.33 to 0.14 and from 0.33 to 0.18, raising accuracy on 11 of 11 models.
  • A stopping rule reads about 7.3 of 18 rotations in the serving run, giving 2.2 times more decisions per second on vLLM.

Watch out

arXiv preprint posted September 30, 2026 (cs.LG) by Jiamu Zhang and eight co-authors, described in its comment as an early report on work in development. The verified disagreement bound holds on two of four cells in one experiment, and the serving configuration was selected and bounded on a single split.

Questions about this entry

Short answers drawn from the linked project or page.

Reactions & coverage

Posts, threads, and videos about this entry from around the web.

LinkedIn: What multimodal decision models actually change, and what they do not.

LinkedInJevDirectory.org

Hacker News: Pointer to a DiffusionGemma plus vLLM tutorial for a Jev-shaped classifier.

1 pointHow to build a Jev-style classifier with DiffusionGemma and vLLMRead the thread on Hacker News

More Jev resources like this

Introduces Jeva, a decision-native architecture that encodes the request and each option separately and scores options symmetrically. It targets null-awareness, permutation invariance, option scalability, and cacheability, reporting near-perfect null detection and no decision flips under tested permutations.
Jev Models & ReimplementationsArticle#community#research#arxiv
Community
Shows that open instruction-tuned models already read decisions from answer-letter logits without training, and that LoRA fine-tuning with a decision head lifts them past Jev: Gemma 4 31B goes from 79.6 to 84.4 on the new 2,352-question OpenDecisions set and scores 81.5 on JevBench v1.7.
Jev Models & ReimplementationsArticle#community#research#arxiv
Community
Trains a small decision head label-free to recover about 99% of a frozen language model's multiple-choice accuracy using two-thirds of its transformer layers. Its +1T variant reaches 75.0% mean accuracy across eight benchmarks versus 75.7% for the full model, with higher batched vLLM throughput.
Jev Models & ReimplementationsArticle#community#research#arxiv
SanSi turns a pre-trained looped language model into a typed decision model that revises its hidden state across loops without generating tokens. On 10,027 test decisions from 59 sources it reaches 72.0% accuracy, 13.5 points above a same-shaped non-looped model trained with the same recipe.
Jev Models & ReimplementationsArticle#community#research#arxiv
Community
SBERT2S1 converts biomedical Sentence-Transformers encoders into typed decision models with bi-encoder cross-head and prior-fused residual variants, alongside BIODECIDE and MEDLINE-S1. Retrieval training helps the prior-fused head in 10 of 15 comparisons after fine-tuning.
Jev Models & ReimplementationsArticle#community#research#arxiv
Community
StartLux-Decision is a family of decision models from 0.8B to 27B parameters pairing single-pass Instant variants with AutoThink versions that reason only when uncertain. On the public subset of Decision Index 0.3 the 27B AutoThink model reaches 73.4.
Jev Models & ReimplementationsArticle#community#research#arxiv
Community

From the Jev guides

Original write-ups on what this entry is for.

More than eighty preprints now evaluate, attack, and reproduce the typed-decision class. The broadest board, the coherence gap, the rejection bottleneck, and the attacks that still work.
Jev Practices & Patterns#research#evaluation#calibration
Read article
Training recipes, looped architectures, and language ports: what the open side of the typed-decision class shipped this month, and how to pick by runtime and calibration instead of the leaderboard.
Jev Models & Reimplementations#open-models#training#local
Read article
Base decision checkpoints sit near chance on purpose. The typed-decisions loop, the corpora behind the students, and the temperature fit that turns probabilities into thresholds.
Jev Practices & Patterns#fine-tuning#calibration#open-models
Read article
Back to all resources

From the Jev community

Posts from builders shipping with Jev right now.

Follow @typesafeai