Skip to content

Jev Repos & SDKs

The Open Reimplementations: Local Models That Speak System One

Closed weights have not stopped the ecosystem from rebuilding the shape in the open. API-compatible servers, retrained heads on small models, and inference-time tricks that skip generation entirely.
Published
Category
Jev Repos & SDKs
Resources cited
12
Reading time
4 min
Tags#open-models#research#local#sdk

Jev is a closed model, and that has not stopped the ecosystem from rebuilding its shape in the open. The projects fall into three groups, and knowing which group you are looking at tells you what the numbers mean.

API-compatible servers

The first group speaks the System One wire protocol, so the official SDKs work unchanged.

Kev releases 0.8B, 4B, and 9B weights on Hugging Face with training code and evaluation data, and its API matches TypeSafe's, so the official Python SDK can point at a local server. The 4B and 9B fit a 32 GB Mac in bf16, and a web playground permutes option order for testing. OpenJev takes the same approach with a documented limit worth reading: a Choice can carry at most 128 options against Jev's 255. openjev-sglang wraps the same interface around SGLang on a B200, with radix caching and breakable prefill graphs, and deploys to Modal with a scale-to-zero server. Simple Jev Project builds its JSON from next-token logits, so nothing is generated and output_tokens is always zero; its public demo needs no key, with a 2k-token context and 2 requests per second.

Retrained heads on small models

The second group keeps a small pretrained model and trains the decision interface on top.

NanoJev is built on Qwen3-0.6B with decision heads and one shared step-400 checkpoint across Maze, Snake, ViZDoom Basic, and Predict Position. On its held-out tests it scores 128/128 on ViZDoom Basic against 56/128 for Jev, and 27/128 against 11/128 on Predict Position, with checkpoints and data published. Laya uses ModernBERT-large (421M) for English and mmBERT-base (322M) for 100+ languages, answering in one forward pass at 33 ms for a single question and 7.2 ms per question batched on a T4. decider trains Qwen3.5-2B and 35B-A3B variants and states plainly that nothing was distilled from Jev; its v10 adds 384 steps of calibration-aware RL that lifted sampled browser play from 83% to 93%. OpenJev (Verdict) reports 77.10% against Laya's 76.60% and Jev's 72.70% on 2,000 held-out decisions, with inference-only fixes that cut hard-tier calibration error from 0.298 to 0.118.

Von is the smallest serious option at 395M parameters, answering in under 25 ms on CUDA, ROCm, MPS, or CPU — and its README is also the best reminder to read past the headline, since a 91.23% adversarial claim sits next to its own 49-task table reporting 72.0% macro. PocketJev pushes the same idea on-device: MLX plus Qwen3-VL-2B reads A/B/C logits on an iPhone for 2 to 26 choices, with no image-upload path.

Inference-time tricks

The third group changes nothing about the weights and everything about the decoding.

SemIf reads direct typed logits instead of generating: 21 binary criteria in 1.023 s versus 5.332 s and 111 output tokens for an autoregressive JSON array on one RTX 3090, with CUDA, llama.cpp, and Apple Silicon backends. JEVfire does the same on vLLM: a 28-field fresh-prefix task ran in 496.9 ms against 5,113.1 ms for constrained JSON on the same 27B model, 10.29x faster, and its browser Mario demo cleared World 1-1 at 71 ms mean inference on an M4 Max.

The Hub is the new center of gravity

The projects above live on GitHub, but most of their weights now live on Hugging Face, and the Hub has quietly become the ecosystem's shelf. Search system-one and you get 799 model repositories: the Laya family with three checkpoints in one repo, Julia 1 at 144.3M parameters, AutoTrust's JEV-27B, JEV-27B-VL, and JEV-9B students, and a long tail of community deciders. Two demos and two leaderboards sit beside them.

This changes what a "reimplementation" means to evaluate. A GitHub README documents a method; a model card documents an artifact — its license, its download count, and its measured behavior. The distinction matters because the same project can appear twice: the Laya toolkit is a GitHub project, while Laya on Hugging Face is the weights that answer you, and the two have different limits. The full tour, including what no download includes, is in What is actually on Hugging Face.

The third group has grown exports, too. Jev-Style v3 publishes GGUF builds that run under llama.cpp, and Julia 1's ONNX build runs in a browser through WebGPU with published parity evidence. For the mechanics of each target, see exporting decision models.

How to read the claims

  • Match the task. Browser play, ViZDoom kills, and JevBench tasks are not interchangeable.
  • Separate self-reported numbers from reproduced ones. Most of these READMEs say which they are; believe the ones that do.
  • Check the wire compatibility before porting. Option limits, score levels, and usage accounting differ.
  • Treat calibration claims as the hardest to reproduce. Accuracy is easier to move than calibration error.
  • Check what the comparison measured: a fine-tuned checkpoint against a zero-shot baseline is not a model comparison, and the Hub cards now state which one they ran.

The repos & SDKs category collects these projects alongside the client libraries for languages TypeSafe does not ship officially.

From the Jev directory

The resources behind this article.

9.3kGitHub stars
Apache-licensed, locally runnable Jev-style decision models (0.8B, 4B, 9B on Qwen3.5) with released weights, training code, a System One-compatible server, frozen eval suites, and a playground.
Jev Practices & Patterns#community#python#open-models
721GitHub stars
An Apache-licensed System One decision server that reads Choice, Score, and Noul probabilities from DiffusionGemma 26B-A4B through vLLM on NVIDIA or MLX on Apple silicon, so TypeSafe SDKs work unchanged.
Jev Repos & SDKs#community#python#open-models
333GitHub stars
A server that implements the TypeSafe/Jev HTTP API with Qwen3.6-35B-A3B on SGLang 0.5.19, deployed on Modal with radix caching and breakable prefill CUDA graphs, plus a separate FastAPI process.
Jev Repos & SDKs#community#python#open-models
608GitHub stars
A local server and Python package that runs open models with Hugging Face Transformers or PyTorch and returns Choice, Score, and Noul answers read from next-token logits instead of generated JSON.
Jev Repos & SDKs#community#python#open-models
2.6kGitHub stars
An open 0.6B replica of Jev that turns states and questions into full probability distributions without decoding answer tokens, trained and evaluated on Maze, Snake, and ViZDoom.
Jev Repos & SDKs#community#python#open-models
33.3kGitHub stars
Open multilingual System 1 decision models with published checkpoints for choice, score and noul questions, plus a router that dispatches each request to the right checkpoint in one forward pass.
Jev Repos & SDKs#community#python#open-models
1.2kGitHub stars
An independent open reproduction of the System One model class: Qwen3.5-based 2B and 35B mixture-of-experts models that return typed Choice, Score, and Noul probabilities in one forward pass, with nothing distilled from Jev.
Jev Practices & Patterns#community#python#open-models
110GitHub stars
An encoder-side reproduction of Jev built on a retrained GLiClass ModernBERT base (151M): it evaluates multiple typed questions in one non-autoregressive forward pass, returning choices, ordinal scores, and probabilities under 35 ms.
Jev Practices & Patterns#community#python#open-models
917GitHub stars
An open, non-autoregressive System One model with published weights and a TypeSafe-compatible /v1/systemone API; the 395M-parameter OptionMarker checkpoint scores discrete and ordinal questions locally.
Jev Repos & SDKs#community#python#open-models
1GitHub stars
An experimental iOS app that turns an on-device Qwen3-VL model into a multiple-choice decision tool: it reads next-token logits for A/B/C and scores 2-26 supplied options without generating any text.
Jev Cookbooks#community#swift#ios
4.8kGitHub stars
An independent baseline that reads typed option probabilities straight from a frozen Qwen3.5-4B's logits in one forward pass, reproducing Jev's interface pattern with open models rather than Jev's undisclosed model or training.
Jev Practices & Patterns#community#python#open-models
75GitHub stars
An independent CUDA and vLLM take on parallel typed decisions: it scores verified single-token labels with the model's own head and assembles JSON in code.
Jev Practices & Patterns#community#python#javascript
Back to all articles

More Jev articles

How Pydantic AI, Mastra, TanStack AI, DSPy, Spring AI, and LiteLLM expose Jev: where the typed decision sits in the loop, what each integration returns, and which big frameworks are only adjacent.
Jev Integrations & Adapters#agents#frameworks#integrations
Read article
Tool menus can outgrow the context that reads them. The catalog's Jev-based routers and gates narrow the list: benchmarked tool search, per-tool scoring, fail-closed approvals, and WebMCP in the browser.
Jev Agents & MCP#mcp#tool-routing#agents
Read article

From the Jev AI model community

Posts from builders shipping with Jev right now.

Follow @typesafeai