Skip to content

KITE: Scaling Jev Population Experiments with Sparse Flagship Calibration (arXiv 2609.27535)

KITE queries a typed behavioral kernel once per unique state, then runs populations of any size from the table, reserving an expensive flagship model for sparse paired anchors. On Epstein experiments with 9,070 participants, anchors covering 1.7% of states cut effect error by 41%.

Stars
1
Language
Python
License
MIT
Format
Article
Published by
Community
Last verified
Oct 2026

Highlights

  • Queries a typed behavioral kernel once per unique state, then executes populations with common random numbers.
  • Reserves an expensive flagship model for sparse paired anchors that estimate intervention effects.
  • On Epstein experiments with 9,070 participants, anchors covering 1.7% of states reduced effect error by 41%.
  • On 37 held-out SocSci210 experiments, 0.5–1.5% anchor coverage raised captured decision gain from 0.27 to 0.39.
  • A million agents executed 20 tabulated steps in 0.9 seconds on a laptop.

Watch out

arXiv preprint posted September 23, 2026 (cs.MA, cs.CY; 24 pages) by Hengyu Li. The coverage and error reductions are the author's own measurements on the named experiments, and the architecture is offered as a route to screening candidate interventions before human trials, not as a substitute for them.

Questions about this entry

Short answers drawn from the linked project or page.

Related terms

Glossary definitions related to this entry.

More Jev resources like this

A system that joins coded and narrative views of 5,601,890 Texas crashes from 2017 to 2025 into population estimates: Kumo Tabular reads coded records, Jev reads narrative samples, and human judgments recalibrate the probabilities. Phone use appears in 15,074 injury crashes in narratives versus 7,340 in coded fields.
Jev Tools & CLIsArticle#community#research#arxiv
A population-scale surveillance study in which Jev reads every Texas police crash narrative from 2017 through 2025, 5,018,079 in total, under an eight-question schema. It estimates 5,467 crashes with a documented pregnancy, including 58 documenting fetal harm.
Jev Tools & CLIsArticle#community#research#arxiv
An instrumented spatial predator-prey framework for studying communication and collective dynamics in AI agents, separating the evolving world, request scheduling, controller adapters, and experiment records. A case study reports a signals-on minus signals-off rabbit-abundance difference of -0.0095.
Jev Tools & CLIsArticle#community#research#arxiv
Community
A benchmark providing exact instance-level class probabilities across three simulated text domains: peer review, covert information transfer, and credit risk. Because the data-generating process is defined, exact probabilities and Bayes error are computable, enabling KL-divergence scoring of reported probabilities.
Jev Benchmarks & EvaluationsArticle#community#research#arxiv
Community
A comparison of JEV with LLMs and human coders on seven political science replications. JEV matches or approaches GPT-6 Luna and Qwen3.8-27B on many tasks, but the authors find no cost advantage over GPT-6 Luna at OpenAI's batch prices.
Jev Benchmarks & EvaluationsArticle#community#research#arxiv
Community
An audit of whether Jev's confidence reflects missing knowledge rather than chance, using over 15 public datasets and 6 generated task families with paired interventions. Jev's confidence is calibrated on familiar closed-choice tasks but fails as an indicator of missing knowledge.
Jev Benchmarks & EvaluationsArticle#community#research#arxiv

From the Jev guides

Original write-ups on what this entry is for.

The request shape barely changes across surfaces; the surrounding contract does. When to call the API directly and when a gateway, a Worker binding, or a router entry earns its extra hop.
Jev Tools & CLIs#gateway#vercel#cloudflare
Read article
Taking a decision checkpoint out of Python: what the GGUF and browser WebGPU exports preserve, what they change, and the parity evidence the model cards publish.
Jev Tools & CLIs#open-models#local#onnx
Read article
Jev labels a record that already exists. Code moves, flags, or holds it. How the document, mail, and transfer tools keep the action out of the model.
Jev Tools & CLIs#classification#email#security
Read article
Back to all resources

From the Jev community

Posts from builders shipping with Jev right now.

Follow @typesafeai