User repository on GitHub
turn any llama-server into a jev system one endpoint
- GitHub stars
- 7
- Forks
- 0
- Primary language
- Python
- License
- gpl-3.0
- Last pushed
- Updated Sep 2026
Repo stats from the GitHub API, cached Sep 2026.
CommunityModels & Reimplementations
verdict
A Python server in front of llama-server that reads one-token label probabilities and exposes them as POST /v1/systemone.
- Category
- Models & Reimplementations
- Format
- —
- Published by
- Community
- Author
- khimaros
- Added
- 2026-09-28
- Last verified
- 2026-09-28
Highlights
- An existing Jev client changes TYPESAFE_BASE_URL. browser-use/jev-ultrafast is the conformance check.
- Option mass is the probability on the label tokens before renormalising, kept as a health signal.
- On a quiet server, eight models reproduced scores exactly. Under load, 5 of 16 prompts differed by up to 3.2e-02.
- A model that fails an alphabet check is refused rather than served.
- The README says gemma-4-e2b reported 1.000 confidence on wrong answers, so raw confidence is not safe to gate on.
Quickstart
bash
PYTHONPATH=python python3 -m llama_verdict.server \
--base-url "$LLAMA_VERDICT_URL" --model "$LLAMA_VERDICT_MODEL" --port 8477Watch out
GPL-3.0-or-later. Independent of TypeSafe and makes no accuracy claim against hosted Jev. Needs a running llama-server. Linking the planned library would carry the GPL.
Reactions & coverage
Posts, threads, and videos about this entry from around the web.
Hacker News: Jev implemented in 25 lines of Python
bashbjorn400 points · 128 commentsJev in 25 Lines of PythonRead the thread on Hacker NewsHacker News: Kev: a tiny Jev-like family built on Qwen3.5
tosh458 points · 199 commentsKev: Tiny Jev-like family of decision models built on top of Qwen3.5Read the thread on Hacker NewsHacker News: Show HN: OpenDecision, a local decision model with a Doom demo.
dwa35926 pointsShow HN: OpenDecision – a 400M zero-shot model makes local decisions, plays DoomRead the thread on Hacker NewsX: deepseek-v4.1-flash-jev
you can make any open source model behave like jev with just a bit of inference engineering. it's shockingly easy. to prove it, we built a new endpoint we're calling deepseek-v4.1-flash-jev. see the demo below. here's how it's done: sglang (an inference engine) offers a Show more
Related terms
Glossary definitions related to this entry.
More like this
39GitHub stars
A local /v1/systemone server that reads label probabilities from a GGUF chat model, with prompt repetition and a confidence shrink toward uniform.
Models & Reimplementations#community#python#open-models
Community
Mushroom-Systems/lichenPython
Mushroom-Systems/lichenPython689GitHub stars
A local server that reads next-token probabilities from a fine-tuned Spark model and returns Choice, Score, and Noul answers with zero generated tokens.
Models & Reimplementations#community#python#open-models
Community
Rizzo-AI-Academy/rizzo-flowPython
Rizzo-AI-Academy/rizzo-flowPython1.1kGitHub stars
A local yes/no decision model that speaks Jev's wire format on a laptop CPU, refusing Choice and Score until those question types ship.
Models & Reimplementations#community#python#open-models
Community
feder-cr/jevPython
feder-cr/jevPythonFrom the guides
Original write-ups that draw on this entry.
A base URL is the whole client change. What still works when Ollaya, Lichen, verdict, Rizzo Flow, or jevos answers POST /v1/systemone on your machine.
Models & Reimplementations#open-models#local#api
Read article
From the community
Posts from builders shipping with Jev right now.
Jev lands on OpenRouter
Jev by @typesafeai is now on OpenRouter, in beta. Jev is a System One model. Instead of generating text, it takes your app's state plus a typed question and returns a typed decision with a probability attached. There is no JSON prompting, parsing layer, and nothing to validate Show more
700 leads scored for $0.09
JEV is INSANE. We gave it 700 high-intent leads and personalised outreach messages. In 40 seconds, it predicted how each message would perform, assigned a confidence score and detected lead-message mismatches. All for just $0.09. JEV can also score leads, analyse buying Show more
Beating Gemini Flash Lite on an eval
Ran @typesafeai's Jev against an existing classifier eval that previously used Gemini 2.5 Flash Lite. It won both on quality (saturated the eval) and speed (6x)
Browser Use Ultrafast, powered by Jev
Breaking: Browser Use + Jev = Ultrafast ⚡ Findings flights took 7s and cost only $0.0039 🤯 > new action space every step > DOM state space > small LLM fallback to type (this video is at 1x speed btw) Built a tiny open source browser agent. try it below ↓
A really smart switch statement
hype-free explanation of jev: jev does not replace gpt / claude jev is just a *really* smart switch statement like if 2016 ml classifiers got 2026 levels of intelligence it's a new* type of tool that will make a lot of workloads insanely fast, cheap, and accurate * = and by Show more
@CompleteSkeptic
After co-inventing ChatGPT, I kept asking myself: why have superhuman chat models not led to AGI? I’ve spent the last 2 years in stealth building a new way to train models (RLCD), and a new type of frontier AI model that we are releasing today: Jev • 20-200x faster • 40-400x
When a designer gets Jev
when a designer gets access to Jev