What rating did the bullet-chess bot reach?

Placing Jev's judgment inside Stockfish search alongside an opening book and endgame tablebases climbs the bot above a 2200 Lichess bullet rating against other bots.

Why distill Jev instead of calling it live during search?

Live model calls are too slow for search, so the authors distill pairwise judgments into a compact evaluator that can run at every position during the game.

How large is the gain from a second teacher in chess?

Averaging both judges' labels beats spending the whole labeling budget on Qwen alone by 9.6 Elo, with a 95% interval of 4.3 to 14.9, and the gain replicates on fresh openings.

Can a second answer from the same judge replace a second teacher?

No. The abstract reports that a second answer from the same judge is no substitute, and that among the models tested Jev was the strongest partner for Qwen.

How expensive was the reranking distillation?

Jev's labels alone train a reranker that scores as high as Qwen's, built from 21 minutes of API calls instead of 5.1 GPU-hours, and adding Qwen improves ranking quality by at most a few thousandths.

What does search contribute to this setup?

Search supplies the lookahead, distillation makes the judgment cheap enough to use at every position, and an LLM partner pays off in chess, according to the paper's summary of its two tasks.

What decision-model interface does the paper build on?

It studies probability-only models, which TypeSafe calls System One models, that return calibrated probabilities for fixed choices in milliseconds and generate no text.

CommunityJev Practices & Patterns

From Probabilities to Decisions: Search and Multi-Teacher Distillation with Jev (arXiv 2610.09188)

A study of using Jev inside Stockfish search and multi-teacher distillation. A bot with Jev's judgment distilled into a compact evaluator climbs above a 2200 Lichess bullet rating, and averaging Jev with Qwen3-32B labels beats spending the whole labeling budget on Qwen alone by 9.6 Elo.

See highlights

Open arxiv.org

Format: Article
Published by: Community
Last verified: Oct 2026

Tagscommunity research arxiv distillation chess search

Works forJev for Scoring Jev for Ranking Jev for Decision gating

Used inJev for Gaming Jev for Software & DevTools

Highlights

Distills pairwise Jev judgments into a compact evaluator that runs at every position, since live calls are too slow for search.
The bullet-chess bot climbs above a 2200 Lichess rating against other bots with search plus Jev judgment.
Averaging Jev and Qwen3-32B labels beats spending the whole budget on Qwen alone by 9.6 Elo (95% interval 4.3 to 14.9).
In passage reranking, Jev's labels alone train a reranker matching Qwen's, from 21 minutes of API calls versus 5.1 GPU-hours.
A second answer from the same judge is no substitute for a second teacher, and Jev was Qwen's strongest partner among models tested.

Watch out

arXiv preprint dated October 6, 2026 (cs.AI) by Mohamad Yazan Sadoun, Sarah Sharif, and Yaser Mike Banad. Results are self-reported for one chess bot and one reranking setup; the abstract gives no full Elo spread, and the multi-teacher gain is bounded by the tested labeling budgets.

Questions about this entry

Short answers drawn from the linked project or page.

Reactions & coverage

Posts, threads, and videos about this entry from around the web.

X: Natural-language search over Zillow

X: Filtering WIP todos by meaning

X: Seven more SEO and GEO workflows

X: A keystroke oracle that reads intent in ~100 ms

Related terms

Glossary definitions related to this entry.

More Jev resources like this

Calibrated Decision Models for Autonomous Penetration-Testing Harnesses: JEV and Laya as System One Decision Layers for LLM-Driven Pentest Agents (arXiv 2609.28940)

A position and case-study paper on using System One decision models like Jev and the open-source Laya as decision layers in LLM-driven penetration-testing harnesses. It names four decision points, runs an exploratory 13-vulnerability NeuroSploit comparison, and proposes Rave, an unevaluated model.