CommunityJev Models & Reimplementations
Calibrated Typed Decisions for Entity, Relation, and Event Extraction (arXiv 2610.17113)
CalOn is a unified 0.6B-parameter encoder that jointly encodes text and type definitions to extract entities, relations, and event triggers and arguments across datasets and schemas. Across 40 benchmarks it outperforms the evaluated baselines on most and leads all reported relation extraction benchmarks.
- Format
- Article
- Published by
- Community
- Last verified
- Oct 2026
Highlights
- Unified 0.6B-parameter encoder handles entity, relation, and event extraction across datasets and schemas.
- Jointly encodes text and type definitions, then anchors every extracted mention to the input text.
- Outperforms evaluated baselines on most of 40 benchmarks and leads all reported relation extraction benchmarks.
- Achieves the highest average F1 for event triggers and arguments with gold triggers, per the abstract.
- Calibration correction improves confidence estimates for entities, relations, and event arguments with little F1 change.
Watch out
arXiv preprint posted October 12, 2026 (cs.CL, cs.AI) by Yang Wang and co-authors. All results are self-reported across the 40 benchmarks the authors evaluated; the abstract does not list the baselines or state whether checkpoints were released.
Questions about this entry
Short answers drawn from the linked project or page.
CalOn is a unified 0.6B-parameter encoder for entity, relation, and event extraction. It jointly encodes text and type definitions and directly identifies entity spans, relations, event triggers, and arguments in one model.
It encodes the requested type definitions with the text and considers the requested types together, using their combined evidence to identify relevant candidates before assigning a type, rather than supporting user-specified types through a separate mechanism.
The authors evaluate across 40 benchmarks. CalOn outperforms the evaluated baselines on most, leads all reported relation extraction benchmarks, and achieves the highest average F1 for event triggers and arguments with gold triggers.
Yes. The same span-pair formulation performs strongly on aspect sentiment triplet extraction and pronoun resolution, two tasks beyond the entity, relation, and event extraction benchmarks used for the main evaluation.
Supervised training on diverse sources is supplemented with a reward that encourages correct extractions and penalizes incorrect ones, which the authors describe as part of the training recipe for the unified encoder.
A correction for the probability bias introduced during training improves confidence estimates for entities, relations, and event arguments after calibration, with little change in F1, according to the abstract.
Teams extracting entities, relations, or events across multiple datasets and annotation guidelines, where a single 0.6B encoder and calibrated confidence estimates matter more than task-specific model size.
Reactions & coverage
Posts, threads, and videos about this entry from around the web.
X: A 26-sheet plan set in 2.9 seconds
X: Which exam questions come back
X: 900 images in 40 seconds
Related terms
Glossary definitions related to this entry.
More Jev resources like this
9GitHub stars
A training-free algorithm that gets numerical output from any LLM with a Jev-like structured-choice interface by recursively refining a range through a multiway decision tree. Range-normalized MAE is 1.84% versus 5.18% for direct choice, and code is available on GitHub.
Jev Models & ReimplementationsArticle#community#research#arxiv
Community
Bring-AI/jev-numericPython
Bring-AI/jev-numericPythonIntroduces Jeva, a decision-native architecture that encodes the request and each option separately and scores options symmetrically. It targets null-awareness, permutation invariance, option scalability, and cacheability, reporting near-perfect null detection and no decision flips under tested permutations.
Jev Models & ReimplementationsArticle#community#research#arxiv
Community
Shows that open instruction-tuned models already read decisions from answer-letter logits without training, and that LoRA fine-tuning with a decision head lifts them past Jev: Gemma 4 31B goes from 79.6 to 84.4 on the new 2,352-question OpenDecisions set and scores 81.5 on JevBench v1.7.
Jev Models & ReimplementationsArticle#community#research#arxiv
Community
A working RLCD implementation for reasoning models: the model samples a rationale, and a strictly proper scoring rule grades the answer distribution it commits to afterward. With Qwen3-1.7B it matches or beats SFT, RFT/STaR, and GRPO in accuracy and beats all in selective prediction.
Jev Models & ReimplementationsArticle#community#research#arxiv
Community
ZimmyGao/openjev-rlcdPython
ZimmyGao/openjev-rlcdPython1.3kGitHub stars
Reads a typed decision from one prefill of a pretrained instruction-tuned model by restricting the next-token distribution to option tokens, then corrects label and position bias with no gradient steps. Averaging over cyclic rotations lowers order-flip rates and raises accuracy on 11 of 11 models.
Jev Models & ReimplementationsArticle#community#research#arxiv
Community
nokia-applied-research/AnyJevPython
nokia-applied-research/AnyJevPythonSanSi turns a pre-trained looped language model into a typed decision model that revises its hidden state across loops without generating tokens. On 10,027 test decisions from 59 sources it reaches 72.0% accuracy, 13.5 points above a same-shaped non-looped model trained with the same recipe.
Jev Models & ReimplementationsArticle#community#research#arxiv
Community
From the Jev guides
Original write-ups on what this entry is for.
More than eighty preprints now evaluate, attack, and reproduce the typed-decision class. The broadest board, the coherence gap, the rejection bottleneck, and the attacks that still work.
Jev Practices & Patterns#research#evaluation#calibration
Read article
TypeSafe publishes evals, but the numbers that matter are the ones measured on your task. A tour of the independent benchmarks, field reports, and the recurring finding that question design dominates.
Jev Practices & Patterns#benchmarks#evaluation#calibration
Read article
Training recipes, looped architectures, and language ports: what the open side of the typed-decision class shipped this month, and how to pick by runtime and calibration instead of the leaderboard.
Jev Models & Reimplementations#open-models#training#local
Read article
From the Jev community
Posts from builders shipping with Jev right now.