OpenJev-RLCD: A Working RLCD Implementation (arXiv 2609.38850)
A working RLCD implementation for reasoning models: the model samples a rationale, and a strictly proper scoring rule grades the answer distribution it commits to afterward. With Qwen3-1.7B it matches or beats SFT, RFT/STaR, and GRPO in accuracy and beats all in selective prediction.
A variance identity shows scoring the mixture of several samples rewards disagreeing rationales.
RLVR is described as exactly this mixture objective without its diversity term.
Naive optimization either switches reasoning off or drowns the objective out in policy-gradient noise.
Two-stage recipe: calibrate, then reinforce; Qwen3-1.7B is evaluated on two reasoning tasks with 3 seeds and paired tests.
On GSM8K answer verification a single query decides a larger share of items at 5% error than GRPO.
Watch out
arXiv preprint submitted September 30, 2026 (cs.AI, cs.CL) by Zhimin Gao and Pichao Wang. The evidence is one 1.7B model on two reasoning tasks, all self-reported; the abstract also notes that when uncertainty comes from annotator disagreement, RLCD provably cannot beat cross-entropy.
Questions about this entry
Short answers drawn from the linked project or page.
RLCD samples a rationale and then scores the answer distribution the model commits to afterward with a strictly proper scoring rule; a variance identity shows RLVR is exactly the mixture objective without its diversity term.
The variance identity shows that scoring the mixture of several samples rewards disagreeing rationales, which is why the per-rationale objective needs a careful two-stage treatment.
Calibrate, then reinforce. Optimized naively, the per-rationale objective either switches reasoning off or is drowned out by policy-gradient noise, according to the paper.
With Qwen3-1.7B on two reasoning tasks, three seeds, and paired tests, RLCD matches or beats the temperature-scaled baselines in accuracy and beats all of them in selective prediction.
The paper reports that a single RLCD query decides a larger share of items at 5% error than GRPO under the same setting.
When uncertainty comes from annotator disagreement, the paper states that RLCD provably cannot beat cross-entropy.
Yes, the abstract links code and results at github.com/ZimmyGao/openjev-rlcd.
SanSi turns a pre-trained looped language model into a typed decision model that revises its hidden state across loops without generating tokens. On 10,027 test decisions from 59 sources it reaches 72.0% accuracy, 13.5 points above a same-shaped non-looped model trained with the same recipe.
Shows that open instruction-tuned models already read decisions from answer-letter logits without training, and that LoRA fine-tuning with a decision head lifts them past Jev: Gemma 4 31B goes from 79.6 to 84.4 on the new 2,352-question OpenDecisions set and scores 81.5 on JevBench v1.7.
StartLux-Decision is a family of decision models from 0.8B to 27B parameters pairing single-pass Instant variants with AutoThink versions that reason only when uncertain. On the public subset of Decision Index 0.3 the 27B AutoThink model reaches 73.4.
Introduces Jeva, a decision-native architecture that encodes the request and each option separately and scores options symmetrically. It targets null-awareness, permutation invariance, option scalability, and cacheability, reporting near-perfect null detection and no decision flips under tested permutations.
Reads a typed decision from one prefill of a pretrained instruction-tuned model by restricting the next-token distribution to option tokens, then corrects label and position bias with no gradient steps. Averaging over cyclic rotations lowers order-flip rates and raises accuracy on 11 of 11 models.
CalOn is a unified 0.6B-parameter encoder that jointly encodes text and type definitions to extract entities, relations, and event triggers and arguments across datasets and schemas. Across 40 benchmarks it outperforms the evaluated baselines on most and leads all reported relation extraction benchmarks.
Training recipes, looped architectures, and language ports: what the open side of the typed-decision class shipped this month, and how to pick by runtime and calibration instead of the leaderboard.
More than eighty preprints now evaluate, attack, and reproduce the typed-decision class. The broadest board, the coherence gap, the rejection bottleneck, and the attacks that still work.
TypeSafe publishes evals, but the numbers that matter are the ones measured on your task. A tour of the independent benchmarks, field reports, and the recurring finding that question design dominates.