Skip to content

Article

Crux Digits: Jev examined, and the plot it has not published

Tom Joseph's analysis walks through Jev's typed primitives and finds three claims that survive scrutiny: the parallel sampler, the price and speed, and the RLCD training whose calibration plot is unpublished.
Format
Article
Reading time
3 min
Published by
Community
Author
Tom Joseph
Last verified
Oct 2026

Highlights

  • It stresses the guarantee covers shape, not truth: a constrained model can still pick the wrong category, and a well-typed wrong decision produces no error.
  • TypeSafe reports a 0 percent structured output error rate and a 0 percent tool call error rate, which the piece says follows from the construction.
  • Open-Jev, a LoRA adapter plus scalar decision head on Qwen3.5-9B, reproduced Jev's interface within a week under Apache-2.0 and MIT.
  • The piece notes no reliability diagram, no expected calibration error, no Brier score and no calibration paper have been published.
  • The Octomind rm -rf ~/.ssh test: block probability fell from 0.76 to 0.48 after a fake pre-approval field was planted in tool output.

Watch out

Copy reviewed against the published analysis on 2026-10-17; the captured text ends mid-sentence, so this entry covers the sections retrieved. It is a consultant's analysis, the benchmark and calibration figures discussed are TypeSafe's own, and the injection demonstration is a single test, not a benchmark.

Questions about this entry

Short answers drawn from the linked project or page.

Reactions & coverage

Posts, threads, and videos about this entry from around the web.

Hacker News: Simon Willison's overview of Noul, Choice, and Score, and where a decision model fits.

benwerd53 pointsJev introduces a new shape of LLMRead the thread on Hacker News

X: Diogo Almeida in five minutes

X: LLMs vs. Jev, clearly explained

From the Jev guides

Original write-ups on what this entry is for.

From the Jev AI model community

Posts from builders shipping with Jev right now.

Follow @typesafeai