User repository on GitHub
FunDM (Fun Decision Model): Cheap Decision Models from Frozen LLMs
- Forks
- 0
- Last pushed
- Updated Oct 2026
Repo stats from the GitHub API, cached Oct 2026.
CommunityJev Models & Reimplementations
FunDM: Cheap & Label-Free Decision Models from Frozen Language Models (arXiv 2610.17175)
Trains a small decision head label-free to recover about 99% of a frozen language model's multiple-choice accuracy using two-thirds of its transformer layers. Its +1T variant reaches 75.0% mean accuracy across eight benchmarks versus 75.7% for the full model, with higher batched vLLM throughput.
- Stars
- 0
- Language
- Python
- License
- APACHE-2.0
- Format
- Article
- Published by
- Community
- Last verified
- Oct 2026
Highlights
- Trains a small decision head label-free so it learns the full model's answer probabilities with KL divergence, no correct-answer labels.
- One backbone pass reads the question and all options together; the head returns probabilities for every option.
- Uses 24 of Qwen3-8B's 36 layers and skips the LM head; the +1T variant reaches 75.0% mean accuracy over eight benchmarks.
- Agent heads trained without pass/fail labels select passing runs for 74.4 to 74.6 of 100 held-out tasks, versus 74 for the full-model judge.
- On MMLU-Pro both heads achieve 1.56 to 1.57 times batched vLLM throughput with about one-third lower peak GPU allocator memory.
Watch out
arXiv preprint submitted October 12, 2026 (cs.LG) by Ujjawal K. Panchal. Numbers are self-reported across eight multiple-choice benchmarks and a coding-agent selection task; the 75.0% figure is a mean that trails the full model's 75.7%, and code is linked at github.com/Ujjawal-K-Panchal/FunDM.
Questions about this entry
Short answers drawn from the linked project or page.
A decision model that pairs a frozen language model with a small decision head trained label-free, recovering about 99% of the frozen model's multiple-choice accuracy while using only two-thirds of its transformer layers.
It learns the full model's answer probabilities with KL divergence, so no correct-answer labels are needed for training.
Using 24 of Qwen3-8B's 36 layers and skipping the LM head, its +1T variant reaches 75.0% mean accuracy over eight benchmarks, versus 75.7% for the full model.
Both heads achieve 1.56 to 1.57 times batched vLLM throughput with about one-third lower peak GPU allocator memory.
Both heads score higher than released Contrastive Language Models, fine-tuned CLM, and CLM-shaped heads trained from scratch across the eight multiple-choice benchmarks and coding-agent selection.
They learn judge probabilities without pass/fail labels and select passing runs for 74.4 to 74.6 of 100 held-out tasks on average, versus 74 for the full-model judge and 52.0 for a CLM-shaped action-trained head.
Yes, code is available at github.com/Ujjawal-K-Panchal/FunDM, as linked in the abstract.
Reactions & coverage
Posts, threads, and videos about this entry from around the web.
LinkedIn: What multimodal decision models actually change, and what they do not.
LinkedInJevDirectory.org
Hacker News: Decision Index 0.2.1 scores open reproductions of Jev on a frozen suite.
jackbravo4 pointsDecision Index 0.2.1 – 70 open reproductions of TypeSafe Jev's Decision ModelRead the thread on Hacker NewsHacker News: Pointer to a DiffusionGemma plus vLLM tutorial for a Jev-shaped classifier.
1 pointHow to build a Jev-style classifier with DiffusionGemma and vLLMRead the thread on Hacker NewsHacker News: A one-token logprob wrapper that also classifies webcam frames.
allanrbo151 pointsA single function Jev-like wrapper for LLMs, including vision modelsRead the thread on Hacker NewsMore Jev resources like this
Shows that open instruction-tuned models already read decisions from answer-letter logits without training, and that LoRA fine-tuning with a decision head lifts them past Jev: Gemma 4 31B goes from 79.6 to 84.4 on the new 2,352-question OpenDecisions set and scores 81.5 on JevBench v1.7.
Jev Models & ReimplementationsArticle#community#research#arxiv
Community
1.3kGitHub stars
Reads a typed decision from one prefill of a pretrained instruction-tuned model by restricting the next-token distribution to option tokens, then corrects label and position bias with no gradient steps. Averaging over cyclic rotations lowers order-flip rates and raises accuracy on 11 of 11 models.
Jev Models & ReimplementationsArticle#community#research#arxiv
Community
nokia-applied-research/AnyJevPython
nokia-applied-research/AnyJevPython423GitHub stars
PostHog's reasoning Jev-style classifier with a diffusion drafter, reporting higher accuracy than Kev-9B and hosted Jev on held-out and JevBench tiers.
Jev Models & Reimplementations#community#evaluation#open-models
Community
PostHog/jeevesPython
PostHog/jeevesPythonSecJev is a family of security-specialized System One decision models from 0.8B to 9B parameters, built on Kev's single-pass candidate scorer. It spans 14 tasks and eight sources, and SecJev-0.8B beats general Kev-9B by 20.51 points in task-macro accuracy.
Jev Models & ReimplementationsArticle#community#research#arxiv
Community
Introduces Jeva, a decision-native architecture that encodes the request and each option separately and scores options symmetrically. It targets null-awareness, permutation invariance, option scalability, and cacheability, reporting near-perfect null detection and no decision flips under tested permutations.
Jev Models & ReimplementationsArticle#community#research#arxiv
Community
45GitHub stars
Encodes an image and public context once, runs isolated question suffixes as a batch, and reads candidate probabilities from the backbone's language-model head. Answer-supervised post-training lifts equal-weight macro accuracy from 70.6% to 76.1% across four benchmarks.
Jev Models & ReimplementationsArticle#community#research#arxiv
Community
guanxuyu-sv/Visual-JevPython
guanxuyu-sv/Visual-JevPythonFrom the Jev guides
Original write-ups on what this entry is for.
Training recipes, looped architectures, and language ports: what the open side of the typed-decision class shipped this month, and how to pick by runtime and calibration instead of the leaderboard.
Jev Models & Reimplementations#open-models#training#local
Read article
Closed weights have not stopped the ecosystem from rebuilding the shape in the open. API-compatible servers, retrained heads on small models, and inference-time tricks that skip generation entirely.
Jev Repos & SDKs#open-models#research#local
Read article
Jev takes text only; Clef-omni adds image, audio, and video input and Liquid d1 adds images, each keeping the same typed-answer shape. Where that matters, where it does not, and the costs the vendors underplay.
Jev Models & Reimplementations#multimodal#open-models#decision-model
Read article
From the Jev community
Posts from builders shipping with Jev right now.