Skip to content

Jev Models & Reimplementations

Serving System One Locally

A base URL is the whole client change. What still works when Ollaya, Lichen, verdict, Rizzo Flow, or jevos answers POST /v1/systemone on your machine.
Published
Category
Jev Models & Reimplementations
Resources cited
8
Reading time
4 min
Tags#open-models#local#api

Hosted Jev is one endpoint. A growing set of local servers speak the same POST /v1/systemone shape, so the change in a client is the base URL. Weights, training, and how to read their benchmarks are covered in the open reimplementations. This is the serving question: what still works when the model is on your machine.

What "compatible" means

Ollaya is the broadest host. It pulls open decision models by name and serves /v1/systemone and /v1/models. Setting TYPESAFE_BASE_URL=http://localhost:11435 is the documented switch for the official SDK. Its recommended winnow:e4b is listed at 0.722 accuracy on typed decisions against Jev's 0.738, at 89 ms for five questions on an RTX 4090. Without an NVIDIA GPU the README points you at laya, which is the CPU path.

Lichen and verdict are narrower: each sits on a GGUF you already have and reads the probability of label tokens instead of generating text. Lichen's own table on 231 public JevBench items has gemma-4-26B-A4B at 207 correct against 200 for Jev 1.13, with a median 93 ms on one laptop GPU. The README also says the edge is not significant (p = 0.09), and the server does not check API keys. Verdict's conformance check is an unmodified jev-ultrafast client pointed at TYPESAFE_BASE_URL. It records option mass before renormalising, and it refuses a model that cannot use its alphabet. It also says a small Gemma build reported confidence 1.000 on wrong answers, so a local gate on raw confidence is not safe until you fit one.

Rizzo Flow fine-tunes Spark-X2.5 and serves the same endpoint on llama.cpp. On the typed-decisions set at Q8_0 its README lists accuracy 0.648, Brier 0.205, and ECE 0.112, against 0.574 for the untuned 4B and 0.727 for Jev's dataset-card accuracy. It says the probabilities are uncalibrated unless you fit them yourself.

What is not a full swap

jevos speaks the wire format and then refuses anything that is not a Noul, with HTTP 422. On 2,000 unseen yes/no items it reports accuracy 0.815 against 0.927 for Jev. Three questions that share one state take about 165 ms on CPU, and optional criteria are accepted and ignored. Use it when every question is yes or no. Do not point a Choice or Score client at it and expect a soft fallback.

@receptron/laya is not a server. It is a Node package that runs Convai's Laya checkpoint through ONNX Runtime, with answers the README says match the Python reference to four decimal places. Three questions take about 140 ms on a warm Apple-silicon CPU. The state truncates at 512 tokens on the English checkpoint. Call systemOne from your process, or serve Laya through Ollaya if you want the HTTP shape.

System One Connector is the agent-side piece: one evaluate tool that can target hosted Jev or TYPESAFE_BASE_URL for a local Laya or CLM server. A non-empty TYPESAFE_API_KEY selects that route even when the local server does not check keys.

How to read a local number

  • Separate wire compatibility from quality. A client that parses the JSON is not evidence the answers match Jev.
  • Read the hardware column. Lichen's 93 ms is a local GPU. Jev's 665 ms in that table includes the network.
  • Treat calibration as unfitted unless the README shows a held-out fit. Rizzo Flow and verdict both say so.
  • Check the question types. jevos is Noul only. Lichen caps a choice at 62 labels. Laya's Node build recommends about 20 options.

The open-model servers of this season

The older tools above now sit beside a second wave that ships weights and a server together. Interfaze Lev serves TypeSafe's own POST /v1/systemone from a 4B LoRA adapter over Qwen3.5-4B, with held-out weighted accuracy of 0.807 after calibration; the card says real-time use needs a CUDA GPU, with CPU falling back to seconds per call. OpenDecider Nano serves the same route from a 400M encoder, runs at 17 ms per question on an L40S, and even ships a browser build.

Drex DLM serves /v1/systemone from an 8B diffusion backbone, with Python, llama.cpp, and Ollama paths, and one trap worth knowing: on Apple Silicon the Metal tensor path has to stay disabled for long inputs. Strands Decider exposes the same route from a 2B LoRA checkpoint, with a card that warns the local server has no authentication at all. AutoTrust's students are the counterexample: JEV-9B and its siblings route System 1 through their own POST /v1/decide rather than the systemone shape, so the official SDKs do not drop in unchanged.

Hosting an export

A third path skips the server entirely. Jev-Style v3's GGUF runs under llama.cpp once you build the project's pinned jev-score binary, at 0.53 GB for the Q4_K_M file. Julia 1's ONNX build runs in a browser through WebGPU, which means no endpoint at all, and no way to call it from a server-side client. Liquid d1-3B is the same trade in Python: a system_one() method with no HTTP decision route, so a local wrapper is your job. For the parity evidence each export publishes, see exporting decision models.

The models category collects these servers next to the weight projects. If the decision has to leave the machine, stay on the hosted API and keep the base URL pointed at TypeSafe.

From the Jev directory

The resources behind this article.

1.3kGitHub stars
A local daemon that pulls open decision models and serves them on TypeSafe's /v1/systemone, so a Jev client switches hosts with TYPESAFE_BASE_URL.
Jev Models & Reimplementations#community#rust#open-models
58GitHub stars
A local /v1/systemone server that reads label probabilities from a GGUF chat model, with prompt repetition and a confidence shrink toward uniform.
Jev Models & Reimplementations#community#python#open-models
8GitHub stars
A Python server in front of llama-server that reads one-token label probabilities and exposes them as POST /v1/systemone.
Jev Models & Reimplementations#community#python#open-models
904GitHub stars
A local server that reads next-token probabilities from a fine-tuned Spark model and returns Choice, Score, and Noul answers with zero generated tokens.
Jev Models & Reimplementations#community#python#open-models
1.4kGitHub stars
A local yes/no decision model that speaks Jev's wire format on a laptop CPU, refusing Choice and Score until those question types ship.
Jev Models & Reimplementations#community#python#open-models
956GitHub stars
A Node and TypeScript package that runs Convai's Laya checkpoint through ONNX Runtime, with the same system_one shape as the Python reference.
Jev Repos & SDKs#community#typescript#open-models
353GitHub stars
A single-binary MCP tool named evaluate that sends Noul, Choice, and Score questions to hosted Jev or a local System One server.
Jev Agents & MCP#community#go#mcp
23.2kGitHub stars
Browser Use's ultrafast agent: Jev picks an operation and an element from an indexed action space in one request, and a small LLM writes text only when the action is TYPE_TEXT.
Jev Tools & CLIs#community#python#browser
Back to all articles

Related Jev articles

Training recipes, looped architectures, and language ports: what the open side of the typed-decision class shipped this month, and how to pick by runtime and calibration instead of the leaderboard.
Jev Models & Reimplementations#open-models#training#local
Read article
Hundreds of repositories carry the system-one tag, but the ecosystem is a dozen ideas in different sizes. A tour of the families, the licenses, and what a download does not include.
Jev Models & Reimplementations#open-models#hugging-face#local
Read article

From the Jev AI model community

Posts from builders shipping with Jev right now.

Follow @typesafeai