Post
CommunityJev Practices & Patterns
Inferring Jev's internals from 1,000 calls
Notes from a technical analysis that inferred Jev's internals from roughly 1,000 API calls, probing how probabilities and confidence behave.
- Format
- Post
- Reading time
- 2 min
- Published by
- Community
- Author
- iwashi86
- Last verified
- Sep 2026
Highlights
- Bases its inferences on roughly 1,000 API calls.
- Probes how probabilities and confidence move across requests.
- Published in Japanese with the raw observations attached.
Watch out
Inferences about a closed model, not a published architecture; treat conclusions as hypotheses.
Questions about this entry
Short answers drawn from the linked project or page.
About ten thousand, according to both the post and the essay it summarizes. This entry's own summary says roughly one thousand, so hold the count loosely; the caveat that matters more is that none of this is a published architecture, since TypeSafe ships no weights or research, so every conclusion is black-box inference.
Not in the reported tests. The notes say each question is isolated, with a secret code written into one question not retrievable from another, and that only shared state is visible to all of them. Roughly a hundred questions barely moved request time, because shared context is encoded and cached once.
Carefully, if at all. Adding irrelevant dummy options shifted the relative odds between the original options, and reversing option order slightly changed output probabilities. The returned confidence field is also not a learned score - it is arithmetic on the largest probability in the distribution, so it is not independent evidence.
Treat both as hypotheses. An expected calibration error of 0.0313 and a lower stated probability on hard math are the author's own measurements against a closed API rather than a vendor benchmark, and he flags the sparse mixture-of-experts backbone as his least certain guess, inferred partly from throughput on very long inputs.
A technical article called Jev's Architecture Unmasked, published on archerhume.com and summarized here by a Japanese engineer. The post is a note-taking thread rather than the original, and it links the article at the end, so the inference method lives there rather than in the thread.
The article leans toward reuse. Given the knowledge level Jev shows, it concludes the team most likely repurposed an existing causal decoder LLM rather than developing a new bidirectional encoder. The tokenizer does not match any public model exactly, with custom digit splitting and chunking.
Barely. The write-up found that server time hardly changes whether a question offers two choices or two hundred, and that up to about a hundred questions in one request add little processing time because the shared state is computed once and cached. That is evidence there is no token-by-token generation loop.
Reactions & coverage
Posts, threads, and videos about this entry from around the web.
X: An A/B test against 4,000 personas
X: Ad creatives from filtered assets
X: A shortlist from a competitor swipe file
X: 1,315 posts across eight dimensions
From the Jev guides
Original write-ups on what this entry is for.
From the Jev AI model community
Posts from builders shipping with Jev right now.