Skip to content

OpenJev-RLCD: A Working RLCD Implementation (arXiv 2609.38850)

A working RLCD implementation for reasoning models: the model samples a rationale, and a strictly proper scoring rule grades the answer distribution it commits to afterward. With Qwen3-1.7B it matches or beats SFT, RFT/STaR, and GRPO in accuracy and beats all in selective prediction.

Stars
24
Language
Python
License
MIT
Format
Article
Published by
Community
Last verified
Oct 2026

Highlights

  • A variance identity shows scoring the mixture of several samples rewards disagreeing rationales.
  • RLVR is described as exactly this mixture objective without its diversity term.
  • Naive optimization either switches reasoning off or drowns the objective out in policy-gradient noise.
  • Two-stage recipe: calibrate, then reinforce; Qwen3-1.7B is evaluated on two reasoning tasks with 3 seeds and paired tests.
  • On GSM8K answer verification a single query decides a larger share of items at 5% error than GRPO.

Watch out

arXiv preprint submitted September 30, 2026 (cs.AI, cs.CL) by Zhimin Gao and Pichao Wang. The evidence is one 1.7B model on two reasoning tasks, all self-reported; the abstract also notes that when uncertainty comes from annotator disagreement, RLCD provably cannot beat cross-entropy.

Questions about this entry

Short answers drawn from the linked project or page.

More Jev resources like this

SanSi turns a pre-trained looped language model into a typed decision model that revises its hidden state across loops without generating tokens. On 10,027 test decisions from 59 sources it reaches 72.0% accuracy, 13.5 points above a same-shaped non-looped model trained with the same recipe.
Jev Models & ReimplementationsArticle#community#research#arxiv
Community
Shows that open instruction-tuned models already read decisions from answer-letter logits without training, and that LoRA fine-tuning with a decision head lifts them past Jev: Gemma 4 31B goes from 79.6 to 84.4 on the new 2,352-question OpenDecisions set and scores 81.5 on JevBench v1.7.
Jev Models & ReimplementationsArticle#community#research#arxiv
Community
StartLux-Decision is a family of decision models from 0.8B to 27B parameters pairing single-pass Instant variants with AutoThink versions that reason only when uncertain. On the public subset of Decision Index 0.3 the 27B AutoThink model reaches 73.4.
Jev Models & ReimplementationsArticle#community#research#arxiv
Community
Introduces Jeva, a decision-native architecture that encodes the request and each option separately and scores options symmetrically. It targets null-awareness, permutation invariance, option scalability, and cacheability, reporting near-perfect null detection and no decision flips under tested permutations.
Jev Models & ReimplementationsArticle#community#research#arxiv
Community
Reads a typed decision from one prefill of a pretrained instruction-tuned model by restricting the next-token distribution to option tokens, then corrects label and position bias with no gradient steps. Averaging over cyclic rotations lowers order-flip rates and raises accuracy on 11 of 11 models.
Jev Models & ReimplementationsArticle#community#research#arxiv
CalOn is a unified 0.6B-parameter encoder that jointly encodes text and type definitions to extract entities, relations, and event triggers and arguments across datasets and schemas. Across 40 benchmarks it outperforms the evaluated baselines on most and leads all reported relation extraction benchmarks.
Jev Models & ReimplementationsArticle#community#research#arxiv
Community

From the Jev guides

Original write-ups on what this entry is for.

Training recipes, looped architectures, and language ports: what the open side of the typed-decision class shipped this month, and how to pick by runtime and calibration instead of the leaderboard.
Jev Models & Reimplementations#open-models#training#local
Read article
More than eighty preprints now evaluate, attack, and reproduce the typed-decision class. The broadest board, the coherence gap, the rejection bottleneck, and the attacks that still work.
Jev Practices & Patterns#research#evaluation#calibration
Read article
TypeSafe publishes evals, but the numbers that matter are the ones measured on your task. A tour of the independent benchmarks, field reports, and the recurring finding that question design dominates.
Jev Practices & Patterns#benchmarks#evaluation#calibration
Read article
Back to all resources

From the Jev community

Posts from builders shipping with Jev right now.

Follow @typesafeai