Jev Inference

An independent, Jev-inspired System One engine written in C# and .NET 10: a pinned Laya/mmBERT checkpoint runs through pure C# CPU and CUDA kernels with Native AOT, returning typed Choice, Score and Boolean decisions to .NET applications. Probabilities are explicitly uncalibrated.

Self-hosted Python SDK and System One-compatible API for runtime-defined Choice, Boolean and Score decisions on pinned open models, across Torch, vLLM, MLX, llama.cpp and WebGPU. Each result records probabilities, token usage, timing, model revision and prompt version, with committed row-level benchmarks.

ggml's announcement that llama.cpp server supports decision models through a /v1/systemone endpoint: send a state and typed questions, get a probability per option from one forward pass. It lists six GGUF decision models from Julia-1 (144M) to OpenJev (27B) with single-question latencies.