CommunityJev Models & Reimplementations
From Text Decisions to Pixels: An Study of Jev-Style Visual Choice Model (arXiv 2609.29283)
Presents PixelJev, a native-image decision interface that maps an image, a task instruction, and a runtime candidate set to a structured choice and candidate-conditioned probabilities. 64-shot source adaptation raises Pets accuracy from 60.13% to 92.40% across optimization seeds.
- Format
- Article
- Published by
- Community
- Last verified
- Oct 2026
Highlights
- Maps an image, task instruction, and runtime candidate set to a structured choice with candidate-conditioned probabilities.
- Unifies recognition and multiple-choice VQA through an existing language-model readout.
- 64-shot source adaptation raises Pets accuracy from 60.13% to 92.40% across optimization seeds.
- Transfers to natural resampling, new texture labels, and A-OKVQA without target fitting.
- Frozen 4B beats adapted 2B on DTD and ScienceQA, and accuracy gains do not ensure calibrated target probabilities.
Watch out
arXiv preprint submitted September 24, 2026 (cs.AI, cs.LG) by Xunlan Zhou, Xianliang Yang, and Li Zhao. Evaluations use small open multimodal models across seven benchmarks; the paper states that schema robustness, cross-family transfer, and reliable use of visual evidence remain open requirements.
Questions about this entry
Short answers drawn from the linked project or page.
An image, a task instruction, and a runtime candidate set, returned as a structured choice with candidate-conditioned probabilities using small open multimodal models.
It raised Pets accuracy from 60.13% to 92.40% across optimization seeds, and a matched prompt-only follow-up attributes the large Pets gain to adaptation.
Yes. The paper reports transfer to natural resampling, new texture labels, and A-OKVQA without target fitting.
Frozen inference already supports both VQA tasks, and a frozen 4B model is stronger than an adapted 2B model on DTD and ScienceQA.
On Pets and ScienceQA it attributes the large Pets gain to adaptation and identifies a narrower output validity benefit of candidate readout in adapted VQA.
No. The paper states that accuracy gains do not ensure calibrated target probabilities, one of the remaining requirements for general-purpose visual decision models.
Schema robustness, cross-family transfer, and reliable use of visual evidence, according to the paper.
Reactions & coverage
Posts, threads, and videos about this entry from around the web.
Hacker News: A one-token logprob wrapper that also classifies webcam frames.
allanrbo151 pointsA single function Jev-like wrapper for LLMs, including vision modelsRead the thread on Hacker NewsRelated terms
Glossary definitions related to this entry.
More Jev resources like this
45GitHub stars
Encodes an image and public context once, runs isolated question suffixes as a batch, and reads candidate probabilities from the backbone's language-model head. Answer-supervised post-training lifts equal-weight macro accuracy from 70.6% to 76.1% across four benchmarks.
Jev Models & ReimplementationsArticle#community#research#arxiv
Community
guanxuyu-sv/Visual-JevPython
guanxuyu-sv/Visual-JevPythonCasts video understanding and interaction as structured decisions by replacing autoregressive answer decoding with a shared head that scores temporal intervals and textual options. VideoJev-4B and VideoJev-35B-A3B improve mean mIoU by 6.7 and 10.8 points on temporal grounding with 2.8–3.1x speedups.
Jev Models & ReimplementationsArticle#community#research#arxiv
Community
Introduces Jeva, a decision-native architecture that encodes the request and each option separately and scores options symmetrically. It targets null-awareness, permutation invariance, option scalability, and cacheability, reporting near-perfect null detection and no decision flips under tested permutations.
Jev Models & ReimplementationsArticle#community#research#arxiv
Community
Shows that open instruction-tuned models already read decisions from answer-letter logits without training, and that LoRA fine-tuning with a decision head lifts them past Jev: Gemma 4 31B goes from 79.6 to 84.4 on the new 2,352-question OpenDecisions set and scores 81.5 on JevBench v1.7.
Jev Models & ReimplementationsArticle#community#research#arxiv
Community
1.3kGitHub stars
Reads a typed decision from one prefill of a pretrained instruction-tuned model by restricting the next-token distribution to option tokens, then corrects label and position bias with no gradient steps. Averaging over cyclic rotations lowers order-flip rates and raises accuracy on 11 of 11 models.
Jev Models & ReimplementationsArticle#community#research#arxiv
Community
nokia-applied-research/AnyJevPython
nokia-applied-research/AnyJevPythonSanSi turns a pre-trained looped language model into a typed decision model that revises its hidden state across loops without generating tokens. On 10,027 test decisions from 59 sources it reaches 72.0% accuracy, 13.5 points above a same-shaped non-looped model trained with the same recipe.
Jev Models & ReimplementationsArticle#community#research#arxiv
Community
From the Jev guides
Original write-ups on what this entry is for.
More than eighty preprints now evaluate, attack, and reproduce the typed-decision class. The broadest board, the coherence gap, the rejection bottleneck, and the attacks that still work.
Jev Practices & Patterns#research#evaluation#calibration
Read article
TypeSafe publishes evals, but the numbers that matter are the ones measured on your task. A tour of the independent benchmarks, field reports, and the recurring finding that question design dominates.
Jev Practices & Patterns#benchmarks#evaluation#calibration
Read article
Training recipes, looped architectures, and language ports: what the open side of the typed-decision class shipped this month, and how to pick by runtime and calibration instead of the leaderboard.
Jev Models & Reimplementations#open-models#training#local
Read article
From the Jev community
Posts from builders shipping with Jev right now.