Skip to content

Choosing an Open Decision Model

Interface, size, license, claims — in that order. A selection guide across the system-one catalog, from a 706K form scorer to 27B Jev students.

Published
Category
Jev Practices & Patterns
Resources cited
20
Reading time
3 min
Tags#open-models#evaluation#benchmarks#local

Seven hundred and ninety-nine repositories carry the system-one tag on Hugging Face, and most of them are not for you. The way to cut the pile is a short sequence: the interface decides whether it drops into your code, the size decides where it runs, the license decides whether it can ship, and only then do the benchmark claims matter.

Start with the interface

If your code already speaks Jev's POST /v1/systemone, the shortest path is a model that serves the same contract. Interfaze Lev does, from a 4B LoRA adapter on Qwen3.5-4B. OpenDecider Nano does, from a 400M encoder. Drex DLM does, from an 8B diffusion backbone with its own hosted twin. bev-decider, Darwin-27B-ZTC, and Strands Decider 2B all ship a serve command that exposes it.

Everything else has its own shape: AutoTrust's students expose POST /v1/decide beside an OpenAI-compatible chat path, Liquid d1-3B uses a Python system_one() method with no HTTP decision route, and Julia 1 is a package, not a server. Converting is usually a thin adapter, but it is work your SDK will not do for you.

Match the model to the job

ModelSizeWhere it fits
Cua-S1 Forms706Kform-field choices, browser-side
Julia 1144M2–20 options, low latency, multilingual
OpenDecider Nano400Mbrowser or 4 GB GPU, Jev-shaped API
Laya421MEnglish or 100+ languages, guardrails
Strands Decider 2B2Bagent routing, tool selection
Drex DLM8Bnon-commercial, Mac-friendly
JEV-9B / JEV-27B9B / 27Bdistillation fidelity to hosted Jev

Option counts discriminate too: Julia accepts 2–20 options natively, d1's score questions take 2–10 levels, AutoTrust's decision head reads up to 256 options, and Laya's fixed head budget starts dropping accuracy past roughly 20. If your label space is 77 categories, that limit decides more than the accuracy table does.

Read the license before the benchmark

Most of the family is Apache-2.0. The exceptions matter: Drex's weights are CC BY-NC 4.0, bev-decider is CC BY-NC because of its training data, d1-3B is under Liquid's lfm1.0 terms, and Security-One 27B is gated behind a conditions gate. Jev-Style v3 is Apache-2.0 but notes some training rows carry restrictive or unclear terms — read the card's data section, not just the license line.

Check the claims

Then read provenance. Mapika's readout scored 57.33 on Decision Index v0.2.1, second of 70 and just under Jev 1.13.0's 57.91 — and the number was measured by the leaderboard rather than the project. JEV-27B-VL tops the community vision board at 69.82, above a stock 397B reference. Both are real signals, and both are contestable in ways the cards disclose.

Three questions sort the claims quickly. Was the comparison fine-tuned against fine-tuned, or fine-tuned against zero-shot? Were the Jev reference numbers published by TypeSafe, or rerun by the author? And is the headline accuracy or calibration — the Typed Decision Leaderboard ties three systems within a bootstrap interval, which is a more honest result than a clean ranking would be.

Pick the interface that fits, verify the license, reproduce one claim on your own split, and keep the hosted API in your back pocket as the reference. The full tour is in Open weights on Hugging Face, and the calibration pass is in Fine-tuning and calibration.

From the Jev directory

The resources behind this article.

The Hugging Face hub for Laya's open System 1 checkpoints: the 421M English model at the repo root, a 322M multilingual build in a subfolder, and the typed-decisions fine-tune, all Apache-2.0.
Jev Models & Reimplementations#community#open-models#local
Community
Supersonic Labs' 144.3M-parameter decision model on mmBERT-small: choice, score, and noul answers from supplied options in one pass, 73.15% on 2,000 typed decisions, Apache-2.0.
Jev Models & Reimplementations#community#open-models#local
Community
An open distillation of Jev 1.13 onto Qwen3.8-27B: a 108.9M-parameter decision block answers typed questions in one prefill pass and adds a POST /v1/decide route beside a full System 2.
Jev Models & Reimplementations#community#open-models#local
Community
The 9B member of AutoTrust's Jev students: a 40.2M-parameter decision block on Qwen3.5-9B with 0.019 mean KL to Jev 1.13 and 70.7% HumanEval left untouched, small enough for one modest GPU.
Jev Models & Reimplementations#community#open-models#local
Community
The vision sibling: the same text-trained System 1 head on Qwen3.8-27B's image encoder, taking images zero-shot, ranked first of 20 vision decision models on the community Jev Decision Index 0.3.
Jev Models & Reimplementations#community#open-models#local
Community
Liquid AI's 3.12B decision model built on LFM2.5-VL: state plus typed questions in one forward pass with zero output tokens, 48.57 on Decision Index 0.2.1 and 8 ms per decision on an RTX 4090.
Jev Models & Reimplementations#community#open-models#local
Community
An untrained readout: stock Gemma-4-31B weights plus a decider config that reads option letters at the answer slot, scored #2 of 70 on Decision Index v0.2.1 at 57.33 against Jev 1.13.0's 57.91.
Jev Models & Reimplementations#community#open-models#local
Community
Nace.AI's 8B decision model on NVIDIA's Efficient-DLM diffusion backbone: a 256-dim pointer head scores every option in one pass, behind the same POST /v1/systemone API as its hosted service.
Jev Models & Reimplementations#community#open-models#local
Community
A 400M-parameter Jev-compatible decision model with a browser build: 0.796 on typed decisions against Laya's 0.766, 17 ms per question on an L40S, and an ONNX file that runs in a tab.
Jev Models & Reimplementations#community#open-models#local
Community
Interfaze's 4B LoRA adapter over Qwen3.5-4B that speaks POST /v1/systemone: 0.807 held-out weighted accuracy and 0.061 ECE after calibration, with a 200,000-example training recipe documented.
Jev Models & Reimplementations#community#open-models#local
Community
A 0.4B Jev-compatible decision model with measured order invariance: 960 random option shuffles moved no probability by more than 1e-5, and bev-decider serve exposes /v1/systemone.
Jev Models & Reimplementations#community#open-models#local
Community
Superagent's security triage model: a continual fine-tune of AutoJev-27B that returns calibrated probabilities for prompt-injection and content checks, with a release policy at 0.70 unsafe.
Jev Models & Reimplementations#community#open-models#local
Community
FINAL-Bench's zero-token classifier: one forward pass plus a fitted temperature produce a full distribution over options, scoring 0.743 on the 2,000-decision typed-decisions test split.
Jev Models & Reimplementations#community#open-models#local
Community
Strands Agents' small decider for agent plumbing: routing, tool selection, triage, and guardrails from a 2B LoRA checkpoint that serves /v1/systemone locally or through a Python package.
Jev Models & Reimplementations#community#open-models#local
Community
A 706,048-parameter form-filling scorer from Cua AI: given a UI element and candidate options it returns one probability per option, including check, click, and skip actions.
Jev Models & Reimplementations#community#open-models#local
Community
A 4B scorer rebuilt from Qwen3-4B into a branching cross-encoder: one branch per option, no position bias, up to 256 options, and calibrated probabilities with no text to parse.
Jev Models & Reimplementations#community#open-models#local
Community
GGUF builds of the Jev-Style v3 decision model on Qwen3.5-0.8B: a 0.53 GB Q4_K_M file the card says is decision-identical to FP32 on 240/240 parity rows, served through a pinned llama.cpp scorer.
Jev Models & Reimplementations#community#open-models#local
Community
The fine-tuned Laya checkpoint for four typed-decision workflows: 0.766 accuracy on 2,000 held-out decisions, above Jev 1.13.0's published 0.727 and the teacher self-agreement ceiling it trained past.
Jev Models & Reimplementations#community#open-models#local
Community
The System One Mosaic Benchmark leaderboard: about 100 decision models compared across 100+ specialized tasks, with results regenerated from a public dataset rather than estimated.
Jev Benchmarks & EvaluationsPlayground#community#evaluation#benchmarks
Community
An independent 2,018-item answer-verifier benchmark: the same items and labels for every entrant, each run on its own maker's code, with Jev, ZTC-Judge, Darwin, and open models ranked by weighted AUC.
Jev Benchmarks & EvaluationsPlayground#community#evaluation#benchmarks
Community
Back to all articles

More Jev articles

Most Jev accuracy problems are state problems. What belongs in a state, what is a pre-made judgment to leave out, and why naming the slice you ask about matters more than the wording.
Jev Practices & Patterns#state#design#primitives
Read article
A Noul returns one number and no separate confidence. How to read the value, pin its boundary with criteria, split compound questions, and set a per-action threshold that matches the cost of being wrong.
Jev Practices & Patterns#noul#primitives#confidence
Read article

From the Jev community

Posts from builders shipping with Jev right now.

Follow @typesafeai