AutoTrust JEV-27B-VL
The vision sibling: the same text-trained System 1 head on Qwen3.8-27B's image encoder, taking images zero-shot, ranked first of 20 vision decision models on the community Jev Decision Index 0.3.
- Published by
- Community
- Author
- AutoTrust AI Lab
- Last verified
- Oct 2026
- Languages
- Python
- Capabilities
- Open sourceSelf-hostedRuns locally
Highlights
- System 1 was trained on text only; every image decision is zero-shot on the untouched vision encoder.
- Full score 69.82 with ECE 0.019 on the Vision board of Jev Decision Index 0.3, above the stock 397B reference by 6.4 points.
- Text parity with JEV-27B: mean probability difference of 0.010 on 1,000 answer-checking decisions.
- --max-num-seqs 8 is mandatory on the vLLM path; more than eight sequences returns wrong System 1 probabilities.
Watch out
Needs one 80 GB or larger GPU and the same vLLM dev build as JEV-27B. Image calibration has not been measured systematically, and the computer-use demo scored 95% of 60 tasks only with numbered boxes plus element text — with boxes alone it dropped to 10%.
Questions about this entry
Reactions & coverage
Posts, threads, and videos about this entry from around the web.
LinkedIn: What multimodal decision models actually change, and what they do not.
LinkedInJevDirectory.org
Hacker News: Decision Index 0.2.1 scores open reproductions of Jev on a frozen suite.
jackbravo4 pointsDecision Index 0.2.1 – 70 open reproductions of TypeSafe Jev's Decision ModelRead the thread on Hacker NewsHacker News: Pointer to a DiffusionGemma plus vLLM tutorial for a Jev-shaped classifier.
1 pointHow to build a Jev-style classifier with DiffusionGemma and vLLMRead the thread on Hacker NewsHacker News: A one-token logprob wrapper that also classifies webcam frames.
allanrbo151 pointsA single function Jev-like wrapper for LLMs, including vision modelsRead the thread on Hacker NewsMore Jev resources like this
From the Jev guides
Original write-ups on what this entry is for.
From the Jev community
Posts from builders shipping with Jev right now.