Turns local text and vision models into Jev-style decision models by reading probabilities from prefill logits alone, with SGLang, Transformers, and Apple Silicon MLX backends.
User repository on GitHub
Turn local language models into Jev-style structured decision models. Get results from text and images with prefill alone—no token-by-token decoding required.
Repo stats from the GitHub API, cached Sep 2026.
uv sync --extra sglang
source .venv/bin/activate
python examples/sglang_inference.py --model-path /path/to/modelWatch out
The SGLang quickstart assumes Linux and a supported NVIDIA GPU, and the project is independent and not affiliated with TypeSafe.
Posts, threads, and videos about this entry from around the web.
Hacker News: Jev implemented in 25 lines of Python
bashbjorn400 points · 128 commentsJev in 25 Lines of PythonRead the thread on Hacker NewsHacker News: Kev: a tiny Jev-like family built on Qwen3.5
tosh458 points · 199 commentsKev: Tiny Jev-like family of decision models built on top of Qwen3.5Read the thread on Hacker NewsX: deepseek-v4.1-flash-jev
you can make any open source model behave like jev with just a bit of inference engineering. it's shockingly easy. to prove it, we built a new endpoint we're calling deepseek-v4.1-flash-jev. see the demo below. here's how it's done: sglang (an inference engine) offers a Show more
Reddit: A walkthrough of routing between models with Jev.
NandhaKishorM/layaPython
TianyuCodings/NanoJevPython
nokia-applied-research/AnyJevPythonPosts from builders shipping with Jev right now.
Beating Gemini Flash Lite on an eval
Ran @typesafeai's Jev against an existing classifier eval that previously used Gemini 2.5 Flash Lite. It won both on quality (saturated the eval) and speed (6x)
Browser Use Ultrafast, powered by Jev
Breaking: Browser Use + Jev = Ultrafast ⚡ Findings flights took 7s and cost only $0.0039 🤯 > new action space every step > DOM state space > small LLM fallback to type (this video is at 1x speed btw) Built a tiny open source browser agent. try it below ↓
A really smart switch statement
hype-free explanation of jev: jev does not replace gpt / claude jev is just a *really* smart switch statement like if 2016 ml classifiers got 2026 levels of intelligence it's a new* type of tool that will make a lot of workloads insanely fast, cheap, and accurate * = and by Show more
After co-inventing ChatGPT, I kept asking myself: why have superhuman chat models not led to AGI? I’ve spent the last 2 years in stealth building a new way to train models (RLCD), and a new type of frontier AI model that we are releasing today: Jev • 20-200x faster • 40-400x
When a designer gets Jev
when a designer gets access to Jev
Full Jev video tutorial
Full Jev Tutorial What it is, how you can build with it and what new applications it can unlock → 0:00 Intro → 0:34 Jev explained → 4:06 API setup → 5:59 Demo 1: Voice-controlled browser → 11:33 Demo 2: AI memory → 17:27 Demo 3: YouTube predictor
The case against Jev-scored compaction
This is a terrible compaction strategy that fundamentally doesn't understand how compaction and context management work. Seems like a lot of people are confused so let's break this down. 1. Compaction isn't a filter The role of compaction is to clean up history to keep the Show more
found the perfect use case for @typesafeai Jev: instant compaction in 2026, why is compaction still a summarization prompt? Jev can make it instant by scoring every tool call and dropping what’s irrelevant
