Jev Arxiv

• Recalibrating Many Questions with Few Labels: Minimax Rates and Identification Limits (arXiv 2610.18488)

  

  A theoretical study of recalibrating many related yes/no questions that each have few labels, motivated by decision models such as Jev. It derives minimax compound-risk rates and shows pooled isotonic fitting with one per-question correction achieves them, while tuning questions separately loses a factor.

  Jev Practices & PatternsArticle#community#research#arxiv

  Community
• Jev-ToM: Evaluating Theory of Mind in Typed Decision Models (arXiv 2610.18610)

  0GitHub stars

  A benchmark evaluating Theory of Mind selection in typed decision models against generative baselines: 11,117 English questions from nine ToM benchmarks across six capability groups. TypeSafe Jev reaches 73.2% source-balanced accuracy and ranks first or second on every capability.

  Jev Benchmarks & EvaluationsArticle#community#research#arxiv

  CommunityHKUST-KnowComp/Jev-ToMPython
• Cheap, Consistent, Calibrated, but Biased? Typed Decision Models as Judges (arXiv 2610.18122)

  

  A bias audit of typed decision models used as judges, running the CALM benchmark's bias tests on eight TDMs and seven LLM judges from 2024 and 2026. Every TDM is biased in three to eight of twelve tests, and emotional tone drops a typical TDM's accuracy from 99% to 42%.

  Jev Benchmarks & EvaluationsArticle#community#research#arxiv

  Community
• Consider, Then Choose: Order-Invariant Decisions in System One Models (arXiv 2610.18233)

  

  A study of option-order sensitivity in System One models and a training-free fix called Runoff. It scores each option alone to keep a few candidates, then compares them with each candidate in every position, removing order dependence in two forward passes.

  Jev Practices & PatternsArticle#community#research#arxiv

  Community
• ProbabilityBench: Model Evaluation and Calibration with Exact Ground-Truth Uncertainty (arXiv 2610.17016)

  

  A benchmark providing exact instance-level class probabilities across three simulated text domains: peer review, covert information transfer, and credit risk. Because the data-generating process is defined, exact probabilities and Bayes error are computable, enabling KL-divergence scoring of reported probabilities.

  Jev Benchmarks & EvaluationsArticle#community#research#arxiv

  Community
• Does a Hosted Decision Model Respect Irrelevant Alternatives? A Pre-Registered Test of Option-Set Dependence in Jev (arXiv 2610.16655)

  

  A pre-registered study of whether jev-1.13.0 satisfies independence of irrelevant alternatives, using 299,463 calls on intent and topic classification. Every added option shifts the log-odds between the gold and strongest wrong label by 0.20–0.52 nats RMS, 1.2 to 3 times run-to-run variation.

  Jev Benchmarks & EvaluationsArticle#community#research#arxiv

  Community
• Does System One Transfer? Calibrated Typed-Decision Models, Label Budgets, and Translation for Indonesian Regional Languages (arXiv 2610.14112)

  0GitHub stars

  A pre-registered evaluation of the commercial Jev model and open Laya-multilingual on Indonesian regional languages, using the parallel NusaX and NusaTranslation test sets. Jev is more accurate on sentences lexically closer to Indonesian, and the human Indonesian translation raises accuracy by up to 37.2 points.

  Jev Benchmarks & EvaluationsArticle#community#research#arxiv

  Communitytnromy/evaluating-system-one-models-for-indonesian-regional-languagesHTML
• TypedBench: A Benchmark for Calibration, Framing Sensitivity, and Cost in System One Decision Models (arXiv 2610.11392)

  

  A benchmark for typed decision models such as Jev, built from seven policy-labelled generators and nine evaluation suites. It reports accuracy as medians across paraphrases, calibration against a matched noise floor, and realized cost under asymmetric cost matrices.

  Jev Benchmarks & EvaluationsArticle#community#research#arxiv

  Community
• JEV versus LLMs: Accuracy, Cost and Calibration on Seven Political Science Replications (arXiv 2610.06625)

  

  A comparison of JEV with LLMs and human coders on seven political science replications. JEV matches or approaches GPT-6 Luna and Qwen3.8-27B on many tasks, but the authors find no cost advantage over GPT-6 Luna at OpenAI's batch prices.

  Jev Benchmarks & EvaluationsArticle#community#research#arxiv

  Community
• GraphDecisionBench: Benchmarking System One Models on Graph Tasks (arXiv 2610.06354)

  6GitHub stars

  A model-independent benchmark for graph decision tasks, combining structural task profiles, matched graph-text input contrasts, and heuristic-proposal controls. It finds accurate adjacency recognition does not guarantee broader structural correctness.

  Jev Benchmarks & EvaluationsArticle#community#research#arxiv

  CommunityVictorYXL/GraphDecisionBenchPython
• General Decision Models: Benchmarking and Insights Beyond Jev (arXiv 2610.03935)

  

  Introduces JEVal, a bilingual benchmark of 11,257 instances from 36 datasets across 10 application domains, and evaluates 25 model configurations spanning general decision models and generative LLMs. It also proposes SII-Decision-4B and 27B, distilled models answering a typical query in about 0.1 s.

  Jev Benchmarks & EvaluationsArticle#community#research#arxiv

  Community
• Benchmarking candidate coverage and rejection policy transfer in typed decision models (arXiv 2610.03387)

  0GitHub stars

  A benchmark of rejection-policy transfer across Laya, Jev, and Qwen2.5-7B-Instruct at equal calibration budgets, covering artificial omission, natural retrieval misses, and public out-of-scope queries. Source calibration often fails to preserve the target operating point.

  Jev Benchmarks & EvaluationsArticle#community#research#arxiv

  Communityluckykevvv/Decision_Model_BenchmarkPython
• To Jev or Not? Evaluating the Accuracy and Efficiency of Structured Decision Models for Hate-Speech Moderation (arXiv 2610.03324)

  

  HATEDECIDE evaluates six decision-model configurations on four hate-speech datasets against specialized, zero-shot, commercial, and supervised baselines. The best hosted model comes within 1.6 macro-F1 points of the best commercial LLM at approximately 97% lower inference cost.

  Jev Benchmarks & EvaluationsArticle#community#research#arxiv

  Community
• Code Owns the Simulation, Jev Owns the Evaluation (arXiv 2610.01834)

  

  A test of Jev on reflection tests, one-shot matrix games, ALFWorld, and robot control that finds a sharp boundary: it succeeds when the right option can be judged from what the input describes, but fails when the right option depends on predicting something not in the input.

  Jev Practices & PatternsArticle#community#research#arxiv

  Community
• Judgement in the Age of Jev: From Evaluation Scarcity to Evaluation Abundance (arXiv 2610.01231)

  

  A conceptual article that formulates a conditional Jevons hypothesis for machine evaluation: sufficiently large reductions in the marginal cost of usable machine evaluation may increase its organizational consumption where latent demand is substantial and complementary costs do not dominate.

  Jev Practices & PatternsArticle#community#research#arxiv

  Community
• Beyond Answer Confidence: A Controlled Audit of Self-Knowledge in a Black-Box Decision Model (arXiv 2610.01006)

  4GitHub stars

  An audit of whether Jev's confidence reflects missing knowledge rather than chance, using over 15 public datasets and 6 generated task families with paired interventions. Jev's confidence is calibrated on familiar closed-choice tasks but fails as an indicator of missing knowledge.

  Jev Benchmarks & EvaluationsArticle#community#research#arxiv

  CommunitySyntheme/beyond-answer-confidencePython
• Evaluating and Benchmarking the System One Model Jev (arXiv 2609.37647)

  6GitHub stars

  A zero-shot evaluation of Jev (jev-1.13.0) on 37 datasets spanning classification, routing, NLI, reading comprehension, commonsense reasoning, moderation, legal clause analysis, and rubric scoring. It runs 346,009 requests for under USD 10 and reaches 95–99% accuracy on IMDB, SST-2, HellaSwag, and ARC.

  Jev Benchmarks & EvaluationsArticle#community#research#arxiv

  CommunityAppliedMachineLearning-Lab/jev-benchmarkingPython
• Calibrated to Whom? Persona and Language Effects on Cultural Values in JEV (arXiv 2609.36399)

  

  An audit of TypeSafe's JEV with the Values Survey Module 2013: 24 items asked as 12 matched Saudi and 12 matched American personas, without a persona, in English and Arabic, under eight request formulations, for 288,000 answers.

  Jev Benchmarks & EvaluationsArticle#community#research#arxiv

  Community
• Jev thinks "I don't know'', but doesn't say it: Introducing Sys1Cal-v1 Dataset for Probability Calibration (arXiv 2609.35342)

  

  Introduces Sys1Cal-v1, a dataset of True/False questions about propositions whose exact probability is known by construction, queried through Jev's three primitives and scored by total variation from ground truth. Recovering a suppressed third value raises median soft accuracy from 0.771 to 0.978.

  Jev Benchmarks & EvaluationsArticle#community#research#arxiv

  Community
• Beyond Calibration: Do a Typed-Decision Model's Probabilities Obey the Probability Axioms? (arXiv 2609.33209)

  0GitHub stars

  Tests whether typed-decision model probabilities satisfy coherence, using logically linked questions that need no labels. On 480 negation pairs, Jev's probabilities for a label being X and not X miss summing to one by 0.064 on average.

  Jev Benchmarks & EvaluationsArticle#community#research#arxiv

  Communitybro789/typed-decision-coherencePython
• Typed Decision Models: An Early Evidence Audit and Evaluation Checklist (arXiv 2609.32160)

  

  An audit of 28 papers posted between 19 and 24 September 2026, nine days after TypeSafe released Jev, relating their findings to earlier work and deriving a 14-item evaluation checklist. The typed readout shows no independent accuracy advantage yet; the clearest gains are latency and cost.

  Jev Benchmarks & EvaluationsArticle#community#research#arxiv

  Community
• KITE: Scaling Jev Population Experiments with Sparse Flagship Calibration (arXiv 2609.27535)

  1GitHub stars

  KITE queries a typed behavioral kernel once per unique state, then runs populations of any size from the table, reserving an expensive flagship model for sparse paired anchors. On Epstein experiments with 9,070 participants, anchors covering 1.7% of states cut effect error by 41%.

  Jev Tools & CLIsArticle#community#research#arxiv

  CommunityHengyuLi-Ozaki-lab/kite_population_simulatorPython
• Specialized Decision Models vs. General-Purpose LLMs: Benchmarking Jev Across Knowledge, Reasoning, and Multilingual Tasks (arXiv 2610.11978)

  

  A comparison of Jev with 19 LLMs across 13 multiple-choice benchmarks covering knowledge, reasoning, and multilingual understanding. Jev is competitive with frontier LLMs on knowledge and commonsense tasks, but on MathQA it trails the frontier median by 17.7 points.

  Jev Benchmarks & EvaluationsArticle#community#research#arxiv

  Community
• Can Decision Models Understand Stance? Evaluating Jev Against General-Purpose LLMs (arXiv 2610.11901)

  

  An evaluation of Jev on two stance detection datasets, VAST for English texts and ZS-CSD for Chinese conversations, against four general-purpose LLMs and two fine-tuned models. Jev matches GPT-5.6 on VAST but falls behind stronger LLMs on ZS-CSD.

  Jev Benchmarks & EvaluationsArticle#community#research#arxiv

  Community
• Nudge the Judge: Uncovering Program Decision Hijacking in Real-World Jev Applications (arXiv 2610.18612)

  2GitHub stars

  An automated framework that traces adversarial context through Jev-backed program decisions to downstream effects. Across 228 real-world Jev applications and 2,273 test cases, 81.5% show decision flips, 98.6% with potential security impact, and Decision Flip Rate beats the strongest baseline by 50.4 points.

  Jev Benchmarks & EvaluationsArticle#community#research#arxiv

  Communityxiaoxiaohg8d/JevProbe-Python
• Jev-Guard: Fast Routing and Auditing Agent Actions over Editable Policy Trees (arXiv 2610.18326)

  

  A unified guardrail model that selects an applicable audit policy from a policy tree, then classifies safety conditioned on the retrieved policies. On 7,033 cases it reports 93.72% safety accuracy and 93.10% hierarchical routing accuracy at 58 ms mean latency.

  Jev Models & ReimplementationsArticle#community#research#arxiv

  Community
• Same Attack, Different Judge: A First Controlled Adversarial Comparison of Jev, LLM Judges, and Purpose-Built Safety Classifiers (arXiv 2610.17820)

  

  A controlled adversarial comparison of Jev against five GPT and GLM judges and two local classifiers under identical payloads and policies. Jev is the most robust on input moderation and the fastest overall, but detects only 62% of phishing emails and flags the most benign requests.

  Jev Benchmarks & EvaluationsArticle#community#research#arxiv

  Community
• Hidden Risks of Jev: An Empirical Study of Security, Privacy, and Dual Use (arXiv 2610.04985)

  0GitHub stars

  A systematic study of Jev's security and privacy implications using the official API and NanoJev, a local model with controllable training data. It adapts prompt injection, adversarial suffixes, and poisoned training data, runs inference attacks against typed outputs, and maps dual uses.

  Jev Practices & PatternsArticle#community#research#arxiv

  Communityshihe98/Security_Privacy_JevPython
• SecJev: Bringing Security Expertise to System One Decision Models (arXiv 2610.03073)

  

  SecJev is a family of security-specialized System One decision models from 0.8B to 9B parameters, built on Kev's single-pass candidate scorer. It spans 14 tasks and eight sources, and SecJev-0.8B beats general Kev-9B by 20.51 points in task-macro accuracy.

  Jev Models & ReimplementationsArticle#community#research#arxiv

  Community
• HydroJEV: A one-second, training-free screen for cyber-attack and fault attribution in water distribution networks (arXiv 2610.02048)

  

  A pre-registered evaluation of Jev as a one-second, training-free screen for SCADA alarm triage in water distribution networks. On a four-class EPANET C-Town benchmark it matched a hand-written rule tree, and a gated cascade spared an LLM reviewer 35-38% of windows.

  Jev Practices & PatternsArticle#community#research#arxiv

  Community
• Jev-IDS: System One Models for Network Intrusion Detection (arXiv 2610.01079)

  

  JEV-IDS is an open experimental network intrusion detector that serializes one flow per request and asks Jev for a binary attack probability and a finite-choice traffic category. On a 300-flow NSL-KDD pilot it reports F1 0.859 and novel-attack recall 0.838.

  Jev Tools & CLIsArticle#community#research#arxiv

  Community
• JEV as a Judge for Agent Trace Security: An Empirical Comparison with Generative LLM Judges (arXiv 2609.34862)

  

  An empirical comparison of Jev as a typed judge for retrospective agent-trace security against four generative judges on 5,219 trajectories. Jev averages positive-class F1 77.8 versus 74.1 for GLM-5.2, leading on two of four benchmark collections.

  Jev Benchmarks & EvaluationsArticle#community#research#arxiv

  Community
• JevAdvBench: A Benchmark and Black-Box Attacks for Reinforcement Learning for Calibrated Decisions Models (arXiv 2609.31142)

  

  JevAdvBench is a black-box adversarial benchmark for RLCD models such as Jev, with 812 typed questions over 66 scenarios and 9,744 single-edit attack variants. On jev-1.13.0 an appended unverified opinion flipped 12.1% of decisions and pushed 38% of confident answers below the review threshold.

  Jev Benchmarks & EvaluationsArticle#community#research#arxiv

  Community
• Just Ask Jev: Reinforcement Learning for Calibrated Decisions as a Zero-Shot Detector of AI Alignment Failures (arXiv 2609.29429)

  28GitHub stars

  RLCDAlignBench measures Jev as a zero-shot detector of ten alignment failures across 44 benchmarks and five target models. A single generic question reaches median AUROC 0.886 and beats supervised baselines on most benchmarks at 63 times lower cost than LLM judges.

  Jev Benchmarks & EvaluationsArticle#community#research#arxiv

  Communitysumleo/RLCDAlignBenchPython
• Calibrated Decision Models for Autonomous Penetration-Testing Harnesses: JEV and Laya as System One Decision Layers for LLM-Driven Pentest Agents (arXiv 2609.28940)

  

  A position and case-study paper on using System One decision models like Jev and the open-source Laya as decision layers in LLM-driven penetration-testing harnesses. It names four decision points, runs an exploratory 13-vulnerability NeuroSploit comparison, and proposes Rave, an unevaluated model.

  Jev Practices & PatternsArticle#community#research#arxiv

  Community
• Decision Hijacking: Prompt Injection Attacks on Jev's Typed Probabilistic Decisions (arXiv 2609.28613)

  

  An evaluation of prompt injection against Jev's typed probabilistic decisions using 510 reconstructed InjecAgent cases. Malicious content shifts action probabilities but rarely flips Jev to the attacker's target; score-feedback attacks raise fresh-run success from 1.8% to 3.5%.

  Jev Practices & PatternsArticle#community#research#arxiv

  Community
• COGNIT-Guard: Calibrated Standalone Direct-Decision Guardrails with Heterogeneous CPU-NPU Confidence Cascading under Explicit Latency and False-Positive Constraints (arXiv 2609.33671)

  

  COGNIT-Guard is a safety guardrail that pairs a calibration-tuned CPU gatekeeper with confidence-gated escalation to an NPU-resident 322M direct-decision model, Laya-322M. It reports 98.85% accuracy and 0.42% benign false-positive rate on DUCS-Bench, with experience replay recovering out-of-distribution accuracy.

  Jev Tools & CLIsArticle#community#research#arxiv

  Community
• Jeva: System One Models from First Principles (arXiv 2610.18773)

  

  Introduces Jeva, a decision-native architecture that encodes the request and each option separately and scores options symmetrically. It targets null-awareness, permutation invariance, option scalability, and cacheability, reporting near-perfect null detection and no decision flips under tested permutations.

  Jev Models & ReimplementationsArticle#community#research#arxiv

  Community
• JevGPT: Thinking Fast and Slow in Autonomous Research (arXiv 2610.18272)

  

  A dual-system architecture for autonomous research that couples fast evidence processing with deliberative planning: System Two sets evidence objectives, System One locates support. On fixed-corpus QA and document ranking it reports leading performance with lower cost than comparable agents.

  Jev Models & ReimplementationsArticle#community#research#arxiv

  Community
• Releasing the Inner Jev: A Simple Recipe for Open Decision Models (arXiv 2610.17205)

  

  Shows that open instruction-tuned models already read decisions from answer-letter logits without training, and that LoRA fine-tuning with a decision head lifts them past Jev: Gemma 4 31B goes from 79.6 to 84.4 on the new 2,352-question OpenDecisions set and scores 81.5 on JevBench v1.7.

  Jev Models & ReimplementationsArticle#community#research#arxiv

  Community
• RSAJEV: Training-Free Abstaining Prototype Memory for Eliminating Silent Hallucination in JEV-Based Remote Sensing Classification (arXiv 2610.15742)

  

  Documents a failure mode in letter-bound remote sensing classification: 97.71% OA on UCM in vocabulary but 7.35%–96.40% cross-dataset accuracy and inverted confidence (AUROC 0.38). RSAJEV replaces the letter readout with training-free prototype retrieval, reaching 89.43% on the UCM cross-dataset gate.

  Jev Practices & PatternsArticle#community#research#arxiv

  Community
• FastJEV: Understanding Redundancy for Compact JEV Inference (arXiv 2610.11379)

  

  A training-free method that studies redundancy in candidate evaluation for JEV-style multimodal decisions. Shared context anchoring, candidate prefix sharing, and decision-guided pruning cut candidate depth by 43.75%–45.83% while retaining 93.66%–97.52% of task scores.

  Jev Practices & PatternsArticle#community#research#arxiv

  Community
• OpenJev-RLCD: A Working RLCD Implementation (arXiv 2609.38850)

  24GitHub stars

  A working RLCD implementation for reasoning models: the model samples a rationale, and a strictly proper scoring rule grades the answer distribution it commits to afterward. With Qwen3-1.7B it matches or beats SFT, RFT/STaR, and GRPO in accuracy and beats all in selective prediction.

  Jev Models & ReimplementationsArticle#community#research#arxiv

  CommunityZimmyGao/openjev-rlcdPython
• Chinese-Jev: Bringing System One Model to Chinese-Language Tasks (arXiv 2609.36965)

  

  A System One model for Chinese-language decisions trained on a 10-million-example corpus and fine-tuned for medicine, legal, and finance. Pre-training exceeds closed-source Jev by 1.24% on general tasks with a 20.3x speedup; domain fine-tuning beats Jev in medicine by 4.0%.

  Jev Models & ReimplementationsArticle#community#research#arxiv

  Community
• From Text Decisions to Pixels: An Study of Jev-Style Visual Choice Model (arXiv 2609.29283)

  

  Presents PixelJev, a native-image decision interface that maps an image, a task instruction, and a runtime candidate set to a structured choice and candidate-conditioned probabilities. 64-shot source adaptation raises Pets accuracy from 60.13% to 92.40% across optimization seeds.

  Jev Models & ReimplementationsArticle#community#research#arxiv

  Community
• NumericJev: Jev-like LLM Numerical Decoding with Multiway Decision Trees (arXiv 2609.28587)

  9GitHub stars

  A training-free algorithm that gets numerical output from any LLM with a Jev-like structured-choice interface by recursively refining a range through a multiway decision tree. Range-normalized MAE is 1.84% versus 5.18% for direct choice, and code is available on GitHub.

  Jev Models & ReimplementationsArticle#community#research#arxiv

  CommunityBring-AI/jev-numericPython
• Visual Jev: Accurate and Efficient Decisions from Shared Visual Context (arXiv 2609.25845)

  45GitHub stars

  Encodes an image and public context once, runs isolated question suffixes as a batch, and reads candidate probabilities from the backbone's language-model head. Answer-supervised post-training lifts equal-weight macro accuracy from 70.6% to 76.1% across four benchmarks.

  Jev Models & ReimplementationsArticle#community#research#arxiv

  Communityguanxuyu-sv/Visual-JevPython
• Open-Jev Judgments on CallScreenBench: Calibrated One-Pass Scam Screening with a Small Language Model (arXiv 2609.23959)

  

  Tests one-pass scam-call screening on 41 held-out scenarios producing 577 per-turn decisions: a three-seed ensemble of LoRA-tuned Qwen3-4B reaches AUROC .974 with calibration error .052 and no false alarms on legitimate calls, at 64.5 ms per decision on one consumer GPU.

  Jev Benchmarks & EvaluationsArticle#community#research#arxiv

  Community
• VideoJev: System One Model for Video Understanding and Interaction (arXiv 2610.18615)

  

  Casts video understanding and interaction as structured decisions by replacing autoregressive answer decoding with a shared head that scores temporal intervals and textual options. VideoJev-4B and VideoJev-35B-A3B improve mean mIoU by 6.7 and 10.8 points on temporal grounding with 2.8–3.1x speedups.

  Jev Models & ReimplementationsArticle#community#research#arxiv

  Community
• System Switch: When Should a Fast Decision Model Stop and Think? (arXiv 2610.09683)

  1GitHub stars

  Studies a fast learned actor in closed-loop Doom that hands control to a reasoning vision-language model only when a gate opens. On 900 held-out questions, deferring the least confident 30% of decisions gains +0.13 with doomLaya's option order, but no closed-loop variant reaches the exit.

  Jev Practices & PatternsArticle#community#research#arxiv

  Communitydexmac221/doomgemmaPython
• FunDM: Cheap & Label-Free Decision Models from Frozen Language Models (arXiv 2610.17175)

  0GitHub stars

  Trains a small decision head label-free to recover about 99% of a frozen language model's multiple-choice accuracy using two-thirds of its transformer layers. Its +1T variant reaches 75.0% mean accuracy across eight benchmarks versus 75.7% for the full model, with higher batched vLLM throughput.

  Jev Models & ReimplementationsArticle#community#research#arxiv

  CommunityUjjawal-K-Panchal/FunDMPython
• AnyJev Technical Report (arXiv 2610.00831)

  1.3kGitHub stars

  Reads a typed decision from one prefill of a pretrained instruction-tuned model by restricting the next-token distribution to option tokens, then corrects label and position bias with no gradient steps. Averaging over cyclic rotations lowers order-flip rates and raises accuracy on 11 of 11 models.

  Jev Models & ReimplementationsArticle#community#research#arxiv

  Communitynokia-applied-research/AnyJevPython
• Calibrated Typed Decisions for Entity, Relation, and Event Extraction (arXiv 2610.17113)

  

  CalOn is a unified 0.6B-parameter encoder that jointly encodes text and type definitions to extract entities, relations, and event triggers and arguments across datasets and schemas. Across 40 benchmarks it outperforms the evaluated baselines on most and leads all reported relation extraction benchmarks.

  Jev Models & ReimplementationsArticle#community#research#arxiv

  Community
• The Company a Question Keeps: Auditing Open Jev-Style Models for Retrieval (arXiv 2610.14631)

  

  An audit of request independence in seven open Jev-style checkpoints, using 276 three-passage states built from 92 TREC retrieval queries. Paired interventions show request expansion flips 9.1%/8.0% of Nimble's judgments and changes up to 21.4% of selection-or-abstention actions.

  Jev Benchmarks & EvaluationsArticle#community#research#arxiv

  Community
• Can Jev be Your Q or Policy in Reinforcement Learning? (arXiv 2610.11692)

  

  A study of whether Jev can serve inside reinforcement learning training rather than as a single-domain black box. Frozen Jev fills reference-policy, exploration-judge, and replay-rater roles, and training with it beats a standard RL learner across nine MiniGrid tasks and three Atari games.

  Jev Practices & PatternsArticle#community#research#arxiv

  Community
• Visual Jev Rewards: Reference-Bound Verification for Multi-Subject Image Generation (arXiv 2610.09328)

  

  Reference-bound Visual Jev rewards verify whether requested attributes, actions, and relations hold for specified reference subjects in multi-subject image generation. Training a Qwen3.5-4B verifier as a GRPO reward raises a GPT-5.4 composite score from 41.78 to 52.50 on a 897-task MICo-Bench subset.

  Jev Practices & PatternsArticle#community#research#arxiv

  Community
• From Probabilities to Decisions: Search and Multi-Teacher Distillation with Jev (arXiv 2610.09188)

  

  A study of using Jev inside Stockfish search and multi-teacher distillation. A bot with Jev's judgment distilled into a compact evaluator climbs above a 2200 Lichess bullet rating, and averaging Jev with Qwen3-32B labels beats spending the whole labeling budget on Qwen alone by 9.6 Elo.

  Jev Practices & PatternsArticle#community#research#arxiv

  Community
• SanSi: A Looped Typed Decision Model for System 1.5 Thinking (arXiv 2610.07730)

  

  SanSi turns a pre-trained looped language model into a typed decision model that revises its hidden state across loops without generating tokens. On 10,027 test decisions from 59 sources it reaches 72.0% accuracy, 13.5 points above a same-shaped non-looped model trained with the same recipe.

  Jev Models & ReimplementationsArticle#community#research#arxiv

  Community
• JevCascade: Readout Stability and Inference-Time Compute Allocation for Prefill-Only Decision Models (arXiv 2610.07716)

  

  JevCascade allocates inference-time compute for prefill-only decision models using readout stability: when only the candidate menu changes, post-intervention accuracy is already determined by the cached first-pass distribution. Menu-only interventions are predicted to within 4.2 points across six model families.

  Jev Practices & PatternsArticle#community#research#arxiv

  Community
• Labels Override Definitions in Jev-Style Typed Decision Models (arXiv 2610.02586)

  

  An analysis of open-weight typed decision models that finds their probabilities mostly follow option labels rather than written definitions. Deleting every definition leaves laya-td accuracy unchanged (0.8559 versus 0.8487), while renaming options to A and B raises accuracy by 0.1511.

  Jev Practices & PatternsArticle#community#research#arxiv

  Community
• Student-Guided Teacher Distillation for Efficient LLM Task Routing: Positioning Against Jev-Style System-1 Classifiers (arXiv 2610.02516)

  

  A student-guided distillation pipeline for routing across 60 LLM task categories: a ModernBERT student retrieves top-k candidates and a DeBERTa-v3 zero-shot NLI teacher reranks only those. The best checkpoint reaches 77.5% teacher agreement, with Coverage@16 of 91-100%.

  Jev Practices & PatternsArticle#community#research#arxiv

  Community
• LLM-as-Jev: LLMs Are Already Jev-Style Decision Models -- When and How to Fine-Tune Them (arXiv 2610.02076)

  

  LLM-as-Jev asks how far off-the-shelf LLMs already go as Jev-style decision models and when fine-tuning is needed. Frozen Qwen3.5-4B and Qwen3-0.6B match or exceed existing training-free readouts on the same 4B backbone, and Thinking Jev adds budgeted test-time reasoning.

  Jev Practices & PatternsArticle#community#research#arxiv

  Community
• From Retrieval to Typed Decisions: Calibrated System One Models from Biomedical Sentence Encoders (arXiv 2610.02486)

  

  SBERT2S1 converts biomedical Sentence-Transformers encoders into typed decision models with bi-encoder cross-head and prior-fused residual variants, alongside BIODECIDE and MEDLINE-S1. Retrieval training helps the prior-fused head in 10 of 15 comparisons after fine-tuning.

  Jev Models & ReimplementationsArticle#community#research#arxiv

  Community
• More Choices, Fewer Decisions: Ordinal-Scale Bias in JEV-like Direct-Decision Models (arXiv 2609.38827)

  4GitHub stars

  An analysis of ordinal-scale bias in JEV 1.13 and three open KEV models: across 36 ordinal datasets, final decisions use only 67-76% of the effective gold support versus 87-102% on four nominal tasks. BA-LoRA post-training raises utilization from about 47% to 86%.

  Jev Practices & PatternsArticle#community#research#arxiv

  CommunityGlax147/jev_ordinal_scale_biaPython
• Dyad: Extending Large Language Models with Native Typed Decision-Making (arXiv 2609.36116)

  

  Dyad augments a pretrained LLM with an environment-conditioned action encoder that scores candidate action descriptions to yield a distribution over typed actions. Training only the encoder helps across four unseen environments; joint training adds a 3.80% absolute gain on ALFWorld with a 9B model.

  Jev Practices & PatternsArticle#community#research#arxiv

  Community
• Koa-decision: Fast and Consistent Structured Decision Making with Generative LLMs (arXiv 2609.36115)

  

  Koa-decision reduces single-step decisions such as classification, endpointing, Boolean checks, and scoring to constrained generation with single-token outputs. On a production intent-routing benchmark it reaches 85.5% accuracy in about half a second, up to roughly 7.5x faster than frontier models.

  Jev Practices & PatternsArticle#community#research#arxiv

  Community
• PACT: Pairwise-Anchored Calibrated Tuning for Single-Token Typed Decisions (arXiv 2609.35865)

  3GitHub stars

  PACT turns contrastive training pairs into four loss terms for single-token typed-decision models. On a frozen 324-item holdout it matches the published recipe's accuracy (84.6% versus 85.2%) while cutting answer flips under relabelling from 13.8% to 9.8%.

  Jev Practices & PatternsArticle#community#research#arxiv

  CommunityBennyLinntu/PACT-Pairwise-Anchored-Calibrated-Tuning-for-Single-Token-Typed-DecisionsPython
• JevSoup: System-One Routing for Training-Free LoRA Composition (arXiv 2609.30922)

  1GitHub stars

  JevSoup is a training-free framework that separates System One expert routing from System Two execution: Jev picks two LoRA experts through structured probabilities and their updates are merged with orthogonal projection. Across 14 PorTAL tasks it gains up to 1.19% task-macro accuracy over external baselines.

  Jev Tools & CLIsArticle#community#research#arxiv

  CommunityLeowang980/JevSoupPython
• Type-Safe Is Not Error-Free: Typed Decision Models Follow the Option Name, Not the Definition Bound to It (arXiv 2609.26758)

  

  An evaluation of Jev and two open-weight typed decision models when option names and definitions conflict. With yes/no names, decision-flip rates are up to 70.4 percentage points higher than the 0/1 control, and mean AUC drops from 93.8% to a below-chance 23.2%.

  Jev Practices & PatternsArticle#community#research#arxiv

  Community
• StartLux-Decision: AutoThink Decision Models with Reinforcement Learning for Calibrated Deliberative Decisions (arXiv 2610.17309)

  

  StartLux-Decision is a family of decision models from 0.8B to 27B parameters pairing single-pass Instant variants with AutoThink versions that reason only when uncertain. On the public subset of Decision Index 0.3 the 27B AutoThink model reaches 73.4.

  Jev Models & ReimplementationsArticle#community#research#arxiv

  Community
• JevOut: Natural Context Can Flip Decision Models (arXiv 2609.30243)

  2GitHub stars

  JevOut shows short background context additions can flip correct decisions in four systems including Jev across seven datasets. Within 64 accepted evaluations per decision, additions redirect 61.4%-73.2% of initially correct decisions toward a wrong option fixed in advance.

  Jev Practices & PatternsArticle#community#research#arxiv

  Communityxzx34/JevOutPython
• How Reliable Are System-One Decisions in Medicine? A Comparative Study of Jev, Jev-like Models, and LLMs (arXiv 2610.18529)

  

  A comparative study of system-one decision models across 15 medical datasets and 8,742 instances, measuring accuracy, decision stability, and abstention. Jev rivals leading models on text-driven tasks and is weaker on numerically driven ones, while most models still fail to recognize missing answers.

  Jev Benchmarks & EvaluationsArticle#community#research#arxiv

  Community
• JevForest: Path Voting for Budgeted Feature Acquisition (arXiv 2610.10615)

  

  An exploratory study of JevForest, a budgeted feature-acquisition policy that aggregates path-dependent proposals from bootstrapped trees and queries Jev for semantic answers. On small held-out samples it beats static and random orderings on AG News but not on TREC.

  Jev Practices & PatternsArticle#community#research#arxiv

  Community
• Estimating Uncoded Crash Factors with Tabular Foundation and System One Models: Kumo Tabular and Jev (arXiv 2610.10321)

  0GitHub stars

  A system that joins coded and narrative views of 5,601,890 Texas crashes from 2017 to 2025 into population estimates: Kumo Tabular reads coded records, Jev reads narrative samples, and human judgments recalibrate the probabilities. Phone use appears in 15,074 injury crashes in narratives versus 7,340 in coded fields.

  Jev Tools & CLIsArticle#community#research#arxiv

  Communitypozapas/kumo-jev-crash-recordsPython
• Emo-Jev: Probabilistic Reasoning for Emotion Classification with Jev (arXiv 2610.08829)

  

  A training-free framework with two implementations that turn emotion classification into Jev judgments: one decomposes tasks into atomic judgments, the other aggregates complementary judgment paths. Across eight datasets standard Jev averages 62.93% macro-F1 versus 67.28% for the strongest LLM baseline.

  Jev Practices & PatternsArticle#community#research#arxiv

  Community
• Same-Number Citation Swaps: Stress-Testing Jev as a Financial Evidence Judge (arXiv 2610.08675)

  

  A controlled evaluation of Jev as a source-support verifier for GPT-4.1-mini calculation traces on financial reports. Holding operands and arithmetic fixed while swapping citations between same-number cells reveals wrong-role citations that pass and valid alternative citations that are withheld.

  Jev Benchmarks & EvaluationsArticle#community#research#arxiv

  Community
• Prune First, Decide Fast: Scalable Semantic Query Processing with JEVDB (arXiv 2610.02046)

  

  A semantic database system that answers filters, joins, classification, and ranking with fast typed decision models and escalates uncertain cases to LLMs. JEVDB-Flash posts the lowest latency on all 21 SemBench queries, and Semantic Bloom Filters remove 87.4% of join candidates on Shelob.

  Jev Tools & CLIsArticle#community#research#arxiv

  Community
• OmniMed-Jev: Calibrating LVLM Confidence for Trustworthy Medical Multimodal Decisions via System One (arXiv 2610.00381)

  1GitHub stars

  A decision-native interface that represents each medical decision as a Choice, Noul, or Score over a runtime candidate set and returns a calibrated distribution over it. Against a matched generative baseline it cuts calibration error by an order of magnitude, with counting the one task where the baseline leads.

  Jev Models & ReimplementationsArticle#community#research#arxiv

  Communitylytang63/OmniMed-JevPython
• A First Glance at Jev for Network Traffic Classification: Accuracy, Processing Time, and Cost (arXiv 2610.00376)

  

  A first empirical study of Jev on application classification for network flows, using ten packet-header features from CESNET-QUICEXT-25. Forty labeled examples raise accuracy from 9.80% to 28.42%, while tree ensembles trained on 8,000 records reach about 67-70%.

  Jev Benchmarks & EvaluationsArticle#community#research#arxiv

  Community
• Counting the Uncounted: Population-Level Surveillance of Documented Pregnancy and Fetal Harm in Police Crash Narratives with a System One Model (Jev) (arXiv 2610.00213)

  0GitHub stars

  A population-scale surveillance study in which Jev reads every Texas police crash narrative from 2017 through 2025, 5,018,079 in total, under an eight-question schema. It estimates 5,467 crashes with a documented pregnancy, including 58 documenting fetal harm.

  Jev Tools & CLIsArticle#community#research#arxiv

  Communitypozapas/pregnancy-crash-narrativesPython
• When the Right Answer Is Missing: An Arithmetic-Dependent Rejection Bottleneck in Jev (arXiv 2609.39496)

  

  A report identifying an arithmetic-dependent rejection bottleneck in Jev: on paired arithmetic problems answer-present accuracy reaches 99% while correct rejection falls to 7%. A development-selected decision threshold lifts rejection from 7% to 79% while retaining 97% answer-present accuracy.

  Jev Practices & PatternsArticle#community#research#arxiv

  Community
• Decide, Don't Generate: Competitive Dimensional ABSA with Jev's Typed Decisions (arXiv 2609.35293)

  7GitHub stars

  A system that decomposes all three tasks of SemEval-2026 Task III Track A into typed Jev decisions aligned with 488 CPU-fitted coefficients. It reaches 1.0645 RMSE on valence-arousal regression and 52.09/44.06 continuous F1 on extraction, above fine-tuned Llama-3.3-70B and GPT-OSS-120B baselines.

  Jev Practices & PatternsArticle#community#research#arxiv

  CommunityZhangYiqun018/jev-dimabsaPython
• NavJev: Efficient Vision-Language Navigation via Action-Centric Visual Compression and Discriminative Action-Semantic Memory (arXiv 2609.34969)

  

  A vision-language navigation framework that replaces multimodal generation with visual compression and typed action selection: Action-Centric Visual Compression builds action representations, Discriminative Action-Semantic Memory keeps them distinct. On R2R-CE it reaches 27.0% SR and 22.4% SPL at 0.65 s per step.

  Jev Models & ReimplementationsArticle#community#research#arxiv

  Community
• JevVibe: Efficient Classification-Guided Secure Code Generation (arXiv 2609.34963)

  

  A diagnosis-guided repair agent whose CWE classification comes from Jev. Jev beats six open-weight models on every classification and ranking metric and runs at 6.27x lower median latency than GPT-5.6-Sol; with Jev diagnosing, repair lifts the detector-measured security pass rate from 63.5% to 70.7%.

  Jev Tools & CLIsArticle#community#research#arxiv

  Community
• Decision Readouts for Text-Mediated Video Anomaly Detection: An Exploratory Evaluation of Jev and Qwen (arXiv 2609.34180)

  

  An exploratory offline evaluation of decision readouts for text-mediated video anomaly detection on 40 videos and 400 anchors from UCF-Crime and XD-Violence. Jev Noul reaches 75.99% average precision on XD captions but shows no corresponding UCF advantage.

  Jev Benchmarks & EvaluationsArticle#community#research#arxiv

  Community
• Jev in Medicine: A Benchmark Evaluation (arXiv 2609.34024)

  

  An evaluation of Jev 1.13 on four medical benchmarks: MetaMedQA, PubMedQA, DiagnosisArena-MCQ, and the NEJM Case Challenges, with GPT-6 Sol as reference. All 8,469 requests returned a valid answer; Jev matched GPT-6 Sol on PubMedQA but trailed on diagnostic cases.

  Jev Benchmarks & EvaluationsArticle#community#research#arxiv

  Community
• Jev Matches 7B Language Models for Speech-Neuroprosthesis Rescoring (arXiv 2609.33538)

  0GitHub stars

  A study posing speech-neuroprosthesis rescoring as a single typed Jev decision. On 978 held-out sentences from a participant with ALS, Jev reaches 7.5% word error versus 7.8% for OPT-6.7b and Qwen2.5-7B, at USD 0.07 per thousand sentences with no GPU needed.

  Jev Benchmarks & EvaluationsArticle#community#research#arxiv

  Communitygabrycina/how-much-language-modelPython
• Same Scores, Different Decisions: Evaluating JEV and Language Models for Legal Document Understanding (arXiv 2609.27678)

  

  An evaluation of Jev and nine language models on ContractNLI with repeated requests that vary visible hypotheses, requested answers, and output order. Corrections and regressions can cancel so accuracy stays unchanged while decisions change; Jev is cheapest and fastest for the joint baseline.

  Jev Benchmarks & EvaluationsArticle#community#research#arxiv

  Community
• Can Jev Judge Radiology Reports? Evaluating a System One Model for Clinical Factuality (arXiv 2609.27607)

  

  An evaluation of Jev as a low-cost judge of agreement with physician-written radiology reports. A single-question configuration reaches Kendall correlations of 0.573 on RadEvalX and 0.398 on RadEvalExpert, and one support question per statement keeps expert agreement while using 43-45% fewer input tokens.

  Jev Benchmarks & EvaluationsArticle#community#research#arxiv

  Community
• JEV-Star: Fast, Low-Cost StarCraft II Control with Language-Model Planning (arXiv 2609.27331)

  50GitHub stars

  A StarCraft II controller combining fast JEV action selection with persistent GPT-6 planning that defeats the strongest non-cheating built-in AI, Lv7. The combined system wins four full games at Lv5-Lv7 at a mean estimated cost of USD 3.71 per game, with a median JEV response time of 0.422 s.

  Jev Tools & CLIsArticle#community#research#arxiv

  Communitysc2musa/Jev_StarPython
• Jev for Scientific Decisions: Evaluating Semantic Choices and Their Consequences (arXiv 2609.24965)

  

  An evaluation of Jev as a semantic decision component in scientific workflows using a harness that assigns arithmetic to code. Across twelve model configurations, twenty source-grounded Choices, and ten scientific cases, Jev matched five configurations at complete semantic correctness.

  Jev Benchmarks & EvaluationsArticle#community#research#arxiv

  Community
• JEVQA - Video Quality from Metadata, Bitstream, and Pixel Features with a General-Purpose Decision Model (arXiv 2609.24395)

  

  A zero-shot video quality model that feeds encoding metadata, bitstream statistics, or pixel features to Jev. On 1,936 AV1, H.264, HEVC, and VP9 encodes, metadata-only reaches a Pearson correlation of 0.737 against VMAF, on par with ITU-T P.1204.1, and added features lift it to 0.824.

  Jev Benchmarks & EvaluationsArticle#community#research#arxiv

  Community
• Calibrated Decisions at Scale: Converting Police Crash Narratives into Probabilistic Crash Variables with a System One Model (Jev) (arXiv 2609.24052)

  

  A system that codes Texas crash narratives as gated, typed Jev decisions returning probabilities and no text: a screen covered 499,500 narratives and 195,857 were coded with a 27-question schema. The typed model attains F1 of 0.908 against human labels, and recalibration cuts calibration error 3.3-fold.

  Jev Practices & PatternsArticle#community#research#arxiv

  Community
• Intent Interpretation at RIC Timescales: Jev Decision Models versus Large Language Models in 6G Open RAN (arXiv 2609.23136)

  

  A comparison of Jev-1.13.0 and two other decision models with LLMs for intent interpretation in 6G Open RAN. Jev meets the 1 s near-real-time budget on 99.8% of calls while two hosted LLMs meet it on 17.9% and 0%, with median interpretation taking 0.286 to 2.35 s.

  Jev Benchmarks & EvaluationsArticle#community#research#arxiv

  Community
• Replacing Large Language Models with Jev Decision Models for Low-Latency Edge Service Orchestration (arXiv 2609.22753)

  

  An integration of Jev's decision API into edge service orchestration that extracts four to eight bounded intent fields per request. Across 33 test conditions Jev cuts median decision latency by 22.7-64.5% versus the fastest LLM, and on a live admission path it keeps 0.91-0.95 of requests exact and on time.

  Jev Tools & CLIsArticle#community#research#arxiv

  Community
• More Features Are Not More Evidence: Limits of Training-Free Human Activity Recognition with Jev (arXiv 2609.36154)

  

  An evaluation of Jev on training-free human activity recognition using 1,800 class-balanced accelerometer windows from WISDM, UCI341, and PAMAP2. Its strongest representation reaches macro-F1 of 0.038, 0.118, and 0.089, versus 0.686 to 0.907 for the supervised models.

  Jev Benchmarks & EvaluationsArticle#community#research#arxiv

  Community

12 more entries carry this tag. Browse all 108 in the directory.