Skip to content

Jev glossary

EcosystemLocal model server

Local decision server

A process on your machine that answers typed questions from local weights, so the state does not leave the host.
Category
Ecosystem
Also known as
Local model server
Reading time
1 min
Related terms
4
Directory entries
6
Docs
Not listed
Added
2026-09-28

Definition

Local servers trade the hosted API's operations for a model you run. Ollaya pulls several open checkpoints. Rizzo Flow downloads a fine-tuned Spark model. Lichen and verdict read a GGUF through llama.cpp. jevos is a yes/no model aimed at a laptop CPU.

The state stays on the machine only if nothing else forwards it. Jeview is the opposite pattern: a local proxy that still calls TypeSafe. A local server also drops hosted rate limits and picks up your GPU, RAM, and license constraints.

Tagslocalopen-models

From the Jev directory

Directory entries that go deeper on this term.

1.3kGitHub stars
A local daemon that pulls open decision models and serves them on TypeSafe's /v1/systemone, so a Jev client switches hosts with TYPESAFE_BASE_URL.
Jev Models & Reimplementations#community#rust#open-models
904GitHub stars
A local server that reads next-token probabilities from a fine-tuned Spark model and returns Choice, Score, and Noul answers with zero generated tokens.
Jev Models & Reimplementations#community#python#open-models
58GitHub stars
A local /v1/systemone server that reads label probabilities from a GGUF chat model, with prompt repetition and a confidence shrink toward uniform.
Jev Models & Reimplementations#community#python#open-models
1.4kGitHub stars
A local yes/no decision model that speaks Jev's wire format on a laptop CPU, refusing Choice and Score until those question types ship.
Jev Models & Reimplementations#community#python#open-models
65GitHub stars
A local gateway that forwards /v1/systemone to TypeSafe, stores each call in SQLite, and draws the calls on a live map.
Jev Tools & CLIs#community#javascript#local
8GitHub stars
A Python server in front of llama-server that reads one-token label probabilities and exposes them as POST /v1/systemone.
Jev Models & Reimplementations#community#python#open-models

From the Jev AI model community

Posts from builders shipping with Jev right now.

Follow @typesafeai