jev is insane 🤯 Here is Jev playing subway surfers at super human speed, and also playing 50 games at once. cost less than a cent to do this run. Jev does not replace llms like astra or fable, but opens up an entirely new world of capabilities.
Evaluation & Training
Platt scaling
A two-parameter sigmoid fit on labeled data that maps a model's raw probability onto a better-calibrated one.
- Category
- Evaluation & Training
- Also known as
- —
- Related terms
- 4
- Directory entries
- 2
- Docs
- —
- Added
- 2026-09-28
Definition
On 8,801 sentiment examples, Jev's raw expected calibration error for P(positive) was 0.117. A Platt curve fit on a calibration split cut that to 0.052 on held-out data. Isotonic regression on the same split reached 0.008, because the error was not sigmoid-shaped.
The AITA study used a related idea: a logistic regression learned from Jev's answers on 300 older posts, then adjusted probabilities on the 770 test posts. That chart is not a like-for-like win unless every model is adjusted the same way.
Tagscalibrationevaluation
Related terms
Definitions that connect to this one.
Isotonic regressionA non-decreasing fit from raw confidence to observed accuracy. It can follow a miscalibration that is not a sigmoid.Evaluation & TrainingCalibrationThe property that outcomes given a probability of 0.2 occur about 20% of the time, measured across many predictions.Answers & ConfidenceBrier scoreA score for a full probability vector against one observed label. Lower is better, and a confident wrong answer costs more than a hedge.Evaluation & TrainingConfidenceA 0-1 number on every Choice and Score answer that collapses the probability distribution into one certainty score.Answers & Confidence
From the directory
3GitHub stars
A sentiment study of whether Jev's stated confidence matches accuracy, comparing raw scores with Platt scaling and isotonic regression.
Benchmarks & Evaluations#community#python#evaluation
Community
AnthusAI/Jev-CalibrationPython
AnthusAI/Jev-CalibrationPython3GitHub stars
A 770-post benchmark that scores Jev, Sonnet 5, GPT-5 nano, and two local models on Reddit verdicts with weighted Brier scores.
Benchmarks & Evaluations#community#python#evaluation
Community
dchristopoulos/jev-aitaPython
dchristopoulos/jev-aitaPythonFrom the community
Posts from builders shipping with Jev right now.
Jev plays Subway Surfers
Agentic browsing in Chrome
I built a Chrome extension for agentic browsing using Jev by @typesafeai, fx.sh including AI Gateway by @vercel. Now agents can browse, click, and interact with websites directly in your browser. Cost effective and fassst. Decision-making by Jev.
@CompleteSkeptic
After co-inventing ChatGPT, I kept asking myself: why have superhuman chat models not led to AGI? I’ve spent the last 2 years in stealth building a new way to train models (RLCD), and a new type of frontier AI model that we are releasing today: Jev • 20-200x faster • 40-400x
724 competitor ads, broken down
jev is INSANE. in 40 seconds it broke down 724 live ads from 37 brands. every hook. every format. offer. cta. awareness stage. landing page mismatch. used 9 cents of tokens. (will be avail in @stealads + mcp)
A chat bot with no LLM
I built a chat bot with jev, no LLM at all! Responses are instant, no hallucinations. I hooked it up to web search, wikipedia, weather, todoist and home assistant. Jev decides what tool to call and what args to use based on the prompt. Instant answers cite sources as well!
3,282 posts, eight questions each
I gave Jev 3,282 of my X posts across 100M views and asked it to find what actually works for growth. 4,252,330 tokens $0.1282 for the full 8m 34s run! Each post got 8 questions about the topic, hook, tone, whether it teaches something, etc. How-to posts got 150 median likes Show more
Jev repositories worth a look, in Japanese
やぁ！兄弟たち！ Jevに関するGitHubの実用性と発展性がありそうなリポジトリをまとめたよ！ やはり、高速判断を要するComputerUseや完全自動トレードなんかに対しての活用が多い印象だね！ Jevは公式のウェイトリストも1日ほどで承認されるけど、待たなくてもVercel AI GatewayからModel: Show more