Skip to content

The Open Decision-Model Roundup

Training recipes, looped architectures, and language ports: what the open side of the typed-decision class shipped this month, and how to pick by runtime and calibration instead of the leaderboard.

Published
Category
Jev Models & Reimplementations
Resources cited
21
Reading time
3 min
Tags#open-models#training#local#research

The open side of the decision-model class was already moving when this month's arXiv wave landed, and the wave added training recipes, architectures, and language ports faster than any leaderboard can absorb. Here is the shape of it: what the open models are, how they are trained, and what to actually pick by.

The training recipes

OpenJev-RLCD is a working implementation of the RLCD idea TypeSafe described: the model samples a rationale, then a strictly proper scoring rule grades the answer distribution it commits to. With Qwen3-1.7B it matches or beats SFT, RFT/STaR, and GRPO in accuracy and beats all of them on selective prediction. FunDM skips training entirely, reading decisions from frozen language models; Jeva builds the machinery from first principles. Dyad extends an LLM with native typed decision-making, and PACT tunes single-token decisions with pairwise anchoring. LLM-as-Jev argues fine-tuning is mostly unnecessary — the LLM is already a decision model when you read it correctly.

Architectures beyond the encoder

SanSi loops a typed decision model for System 1.5 thinking; JevCascade studies readout stability and compute allocation for prefill-only decisions; FastJEV attacks redundancy for compact inference; NumericJev decodes numbers with multiway decision trees. On the serving side, LAVOIR puts the decision and a value-of-information question in one forward pass, so the model can ask for missing slots instead of guessing.

The ports and the languages

Chinese-Jev brings the shape to Chinese-language tasks, and the Hugging Face ecosystem now carries the ports: Laya multilingual routes by script, OpenThai-SystemOne is a Thai build with GGUF, Ollama, and CoreAI ports, and StartLux-Decision ships a family from 0.8B to 35B with quantizations. Turkish, Japanese, and biomedical variants are all in the catalog, alongside Laya typed-decisions GGUF and ONNX ports for runtimes without PyTorch.

What the open models give you

  • A same-shape API. Most serve POST /v1/systemone or a Python API that mirrors the SDK, so the switch is a base URL or a model field.
  • Weights you can patch. The labels-override-definitions study found one open code base immune to option-label bias by rendering only the definition — a fix you can make yourself in open weights, and one that the hosted model comparison could not apply.
  • Measured baselines. Laya's reproduction reproduces the card's 0.766 and finds it uniformly under-confident (ECE 0.214), which a temperature fit drops to 0.037.
  • Calibration you control. The distilled student study shows sentence encoders can carry typed decisions in-domain, which is what makes a small local model viable.

Pick by runtime and calibration, not the leaderboard

The student-guided routing paper is the honest summary of this space: open checkpoints compete on cost, latency, and control, while accuracy depends on question design and the candidate set you actually run. Benchmark the port you can serve — GGUF on a laptop, MLX on a Mac, ONNX in the browser — on your own rows, and measure calibration and rejection before accuracy. The open weights article covers the hub side, and choosing an open decision model covers the decision itself.

From the Jev directory

The resources behind this article.

A working RLCD implementation for reasoning models: the model samples a rationale, and a strictly proper scoring rule grades the answer distribution it commits to afterward. With Qwen3-1.7B it matches or beats SFT, RFT/STaR, and GRPO in accuracy and beats all in selective prediction.
Jev Models & ReimplementationsArticle#community#research#arxiv
Trains a small decision head label-free to recover about 99% of a frozen language model's multiple-choice accuracy using two-thirds of its transformer layers. Its +1T variant reaches 75.0% mean accuracy across eight benchmarks versus 75.7% for the full model, with higher batched vLLM throughput.
Jev Models & ReimplementationsArticle#community#research#arxiv
Introduces Jeva, a decision-native architecture that encodes the request and each option separately and scores options symmetrically. It targets null-awareness, permutation invariance, option scalability, and cacheability, reporting near-perfect null detection and no decision flips under tested permutations.
Jev Models & ReimplementationsArticle#community#research#arxiv
Community
Dyad augments a pretrained LLM with an environment-conditioned action encoder that scores candidate action descriptions to yield a distribution over typed actions. Training only the encoder helps across four unseen environments; joint training adds a 3.80% absolute gain on ALFWorld with a 9B model.
Jev Practices & PatternsArticle#community#research#arxiv
Community
PACT turns contrastive training pairs into four loss terms for single-token typed-decision models. On a frozen 324-item holdout it matches the published recipe's accuracy (84.6% versus 85.2%) while cutting answer flips under relabelling from 13.8% to 9.8%.
Jev Practices & PatternsArticle#community#research#arxiv
LLM-as-Jev asks how far off-the-shelf LLMs already go as Jev-style decision models and when fine-tuning is needed. Frozen Qwen3.5-4B and Qwen3-0.6B match or exceed existing training-free readouts on the same 4B backbone, and Thinking Jev adds budgeted test-time reasoning.
Jev Practices & PatternsArticle#community#research#arxiv
Community
SanSi turns a pre-trained looped language model into a typed decision model that revises its hidden state across loops without generating tokens. On 10,027 test decisions from 59 sources it reaches 72.0% accuracy, 13.5 points above a same-shaped non-looped model trained with the same recipe.
Jev Models & ReimplementationsArticle#community#research#arxiv
Community
JevCascade allocates inference-time compute for prefill-only decision models using readout stability: when only the candidate menu changes, post-intervention accuracy is already determined by the cached first-pass distribution. Menu-only interventions are predicted to within 4.2 points across six model families.
Jev Practices & PatternsArticle#community#research#arxiv
Community
A training-free method that studies redundancy in candidate evaluation for JEV-style multimodal decisions. Shared context anchoring, candidate prefix sharing, and decision-guided pruning cut candidate depth by 43.75%–45.83% while retaining 93.66%–97.52% of task scores.
Jev Practices & PatternsArticle#community#research#arxiv
Community
A training-free algorithm that gets numerical output from any LLM with a Jev-like structured-choice interface by recursively refining a range through a multiway decision tree. Range-normalized MAE is 1.84% versus 5.18% for direct choice, and code is available on GitHub.
Jev Models & ReimplementationsArticle#community#research#arxiv
LAVOIR extends the Laya single-pass decision encoder so one forward pass returns both the decision distribution and, for every candidate missing slot, the expected gain from asking the user about it. Its question policy matches a greedy oracle on seen schemas and is 14.1 points more accurate than never asking.
Jev Models & ReimplementationsArticle#community#research#arxiv
A System One model for Chinese-language decisions trained on a 10-million-example corpus and fine-tuned for medicine, legal, and finance. Pre-training exceeds closed-source Jev by 1.24% on general tasks with a 20.3x speedup; domain fine-tuning beats Jev in medicine by 4.0%.
Jev Models & ReimplementationsArticle#community#research#arxiv
Community
The 322M mmBERT-base build of Laya for 100+ languages: state plus typed questions return typed answers with probabilities in one forward pass, with up to 8,192 tokens for long documents.
Jev Models & Reimplementations#community#open-models#local
Community
An open Thai + English System One decision model at 0.8B, Apache-2.0: choice with up to 255 options, fractional score, and noul answers in one forward pass over a Qwen3.5-0.8B text tower.
Jev Models & Reimplementations#community#open-models#local
Community
A 4B decision model taking text, JSON, or images up to 262,144 tokens: 52.75 on Decision Index 0.2.1, 204 of 231 on JevBench public, and 26.0 ms for a three-question request on one H200.
Jev Models & Reimplementations#community#open-models#local
Community
ggmlc-compiled GGUFs of the Laya typed-decisions specialist on ModernBERT-large: F16, Q8_0, and UD_Q4_K_M files for invoice, security, customer-service, and harness presets, Apache-2.0.
Jev Models & Reimplementations#community#open-models#local
Community
An analysis of open-weight typed decision models that finds their probabilities mostly follow option labels rather than written definitions. Deleting every definition leaves laya-td accuracy unchanged (0.8559 versus 0.8487), while renaming options to A and B raises accuracy by 0.1511.
Jev Practices & PatternsArticle#community#research#arxiv
Community
A bias audit of typed decision models used as judges, running the CALM benchmark's bias tests on eight TDMs and seven LLM judges from 2024 and 2026. Every TDM is biased in three to eight of twelve tests, and emotional tone drops a typical TDM's accuracy from 99% to 42%.
Jev Benchmarks & EvaluationsArticle#community#research#arxiv
Community
An independent reproduction of the shipped Laya Typed-Decisions checkpoint, a 421M-parameter ModernBERT-large assessor, finding it uniformly under-confident rather than over-confident. A single fitted temperature removes most miscalibration, while the preregistered isotonic selection failed its held-out contrast.
Jev Benchmarks & EvaluationsArticle#community#research#arxiv
Community
SBERT2S1 converts biomedical Sentence-Transformers encoders into typed decision models with bi-encoder cross-head and prior-fused residual variants, alongside BIODECIDE and MEDLINE-S1. Retrieval training helps the prior-fused head in 10 of 15 comparisons after fine-tuning.
Jev Models & ReimplementationsArticle#community#research#arxiv
Community
A student-guided distillation pipeline for routing across 60 LLM task categories: a ModernBERT student retrieves top-k candidates and a DeBERTa-v3 zero-shot NLI teacher reranks only those. The best checkpoint reaches 77.5% teacher agreement, with Coverage@16 of 91-100%.
Jev Practices & PatternsArticle#community#research#arxiv
Community
Back to all articles

More Jev articles

More than eighty preprints now evaluate, attack, and reproduce the typed-decision class. The broadest board, the coherence gap, the rejection bottleneck, and the attacks that still work.
Jev Practices & Patterns#research#evaluation#calibration
Read article
A Choice can only pick from its options. How rejection options, candidate coverage, and escalation bands keep a narrow taxonomy honest under inputs it never anticipated.
Jev Practices & Patterns#rejection#confidence#patterns
Read article

From the Jev community

Posts from builders shipping with Jev right now.

Follow @typesafeai