Jev Local Inference

An Apache-2.0 0.8B decision model that returns calibrated probabilities for yes/no, choice and score questions on CPU. Distributed as GGUF for llama.cpp and served behind a Jev-style /v1/systemone API, so existing Jev clients mostly need only a new base URL.

A local Jev-compatible server that reads Choice, Score and Noul answers from the logits of any MLX checkpoint or OpenAI-compatible endpoint with no training, serving POST /v1/systemone as a drop-in for the official TypeSafe SDK.

A training-free runtime that turns dense Qwen3 or Qwen3.5 checkpoints into a Jev-style Noul, Choice and Score service, sharing one state prefill across isolated questions and reading each answer from candidate-token logits.

Jev-compatible decision models with vision input: LoRA fine-tunes of Qwen3.5 at 4B and 9B serving Choice, Score and Noul on the /v1/systemone wire format, with screenshots and photos placed beside text in the state. Runs on your own NVIDIA GPU; weights are non-commercial.

A local-inference walkthrough that compares Kev, SemIf, Von, and OpenJev on consumer hardware, including Brier scores and a fake-probabilities warning.