CommunityJev Practices & Patterns
Judgement in the Age of Jev: From Evaluation Scarcity to Evaluation Abundance (arXiv 2610.01231)
A conceptual article that formulates a conditional Jevons hypothesis for machine evaluation: sufficiently large reductions in the marginal cost of usable machine evaluation may increase its organizational consumption where latent demand is substantial and complementary costs do not dominate.
- Format
- Article
- Published by
- Community
- Last verified
- Oct 2026
Highlights
- Formulates a conditional Jevons hypothesis: cheaper machine evaluation may increase organizational consumption of it.
- Prompted by Jev, TypeSafe AI's specialised model for typed probabilistic decisions.
- Distinguishes prediction, machine evaluation, organizational judgement, and authorisation, whose costs need not fall together.
- Notes evaluations can share evidence, criteria, and errors, and can scale mis-specified rubrics.
- Treats the Jevons framing as a technological provocation rather than an established empirical result.
Watch out
arXiv preprint posted October 1, 2026 (cs.CY, cs.AI; 19 pages) by Richard Hill. It is a perspective piece, not an empirical study: the conditional Jevons hypothesis is offered as a research problem, and the article does not measure organizational evaluation costs.
Questions about this entry
Short answers drawn from the linked project or page.
It formulates a conditional Jevons hypothesis for machine evaluation: sufficiently large reductions in the total marginal cost of usable machine evaluation may increase its organizational consumption where latent demand is substantial and complementary costs do not dominate.
Jev, TypeSafe AI's specialised model for typed probabilistic decisions; TypeSafe explicitly invokes William Stanley Jevons to argue that lower-cost machine intelligence can unlock previously uneconomic uses.
As a technological provocation rather than an established empirical result, and the resulting hypothesis is explicitly conditional.
Prediction, machine evaluation, organizational judgement, and authorisation, as functional activities whose costs need not fall together.
Evaluations can share evidence, criteria, and errors; scale mis-specified rubrics; operate on representations from which consequential qualifications have disappeared; and change practical decision rights through thresholds and exception routing.
When cheap machine evaluation substitutes for human evaluative work, when it redistributes or creates demands for judgement, and how it affects the grounds available at consequential organizational commitment.
Organization scholars and practitioners examining evaluation and discernment as constraints under production abundance, and how cheap machine evaluation may change decision rights.
More Jev resources like this
A behavioral diagnosis of why System One decision models choose wrong actions in agent loops. On a frozen benchmark of agent decision states, most wrong actions follow a correct reading of the state, and the more accurate the system, the more of its errors take this form.
Jev Practices & PatternsArticle#community#research#arxiv
Community
Studies a fast learned actor in closed-loop Doom that hands control to a reasoning vision-language model only when a gate opens. On 900 held-out questions, deferring the least confident 30% of decisions gains +0.13 with doomLaya's option order, but no closed-loop variant reaches the exit.
Jev Practices & PatternsArticle#community#research#arxiv
Community
dexmac221/doomgemmaPython
dexmac221/doomgemmaPython4GitHub stars
An analysis of ordinal-scale bias in JEV 1.13 and three open KEV models: across 36 ordinal datasets, final decisions use only 67-76% of the effective gold support versus 87-102% on four nominal tasks. BA-LoRA post-training raises utilization from about 47% to 86%.
Jev Practices & PatternsArticle#community#research#arxiv
Community
Glax147/jev_ordinal_scale_biaPython
Glax147/jev_ordinal_scale_biaPythonAn evaluation of Jev and two open-weight typed decision models when option names and definitions conflict. With yes/no names, decision-flip rates are up to 70.4 percentage points higher than the 0/1 control, and mean AUC drops from 93.8% to a below-chance 23.2%.
Jev Practices & PatternsArticle#community#research#arxiv
Community
An exploratory study of JevForest, a budgeted feature-acquisition policy that aggregates path-dependent proposals from bootstrapped trees and queries Jev for semantic answers. On small held-out samples it beats static and random orderings on AG News but not on TREC.
Jev Practices & PatternsArticle#community#research#arxiv
Community
A report identifying an arithmetic-dependent rejection bottleneck in Jev: on paired arithmetic problems answer-present accuracy reaches 99% while correct rejection falls to 7%. A development-selected decision threshold lifts rejection from 7% to 79% while retaining 97% answer-present accuracy.
Jev Practices & PatternsArticle#community#research#arxiv
Community
From the Jev guides
Original write-ups on what this entry is for.
More than eighty preprints now evaluate, attack, and reproduce the typed-decision class. The broadest board, the coherence gap, the rejection bottleneck, and the attacks that still work.
Jev Practices & Patterns#research#evaluation#calibration
Read article
TypeSafe publishes evals, but the numbers that matter are the ones measured on your task. A tour of the independent benchmarks, field reports, and the recurring finding that question design dominates.
Jev Practices & Patterns#benchmarks#evaluation#calibration
Read article
A Choice can only pick from its options. How rejection options, candidate coverage, and escalation bands keep a narrow taxonomy honest under inputs it never anticipated.
Jev Practices & Patterns#rejection#confidence#patterns
Read article
From the Jev community
Posts from builders shipping with Jev right now.