Jev Local Models

Independent measurements of typed-decision models: Jev (TypeSafe API) against Laya (open weights) on 40 Chinese support-ticket classifications, plus a local-first cascade that matches Jev's accuracy at about 1.8x the speed.

A flicker-free terminal coding agent built in Rust for local models: Ollama's native API and OpenAI-compatible servers are first-class targets, cloud providers are optional, and it ships as one ~14MB binary.

Nish Tahir's tutorial on how decision models like Jev work: mask an LLM's vocabulary to the option tokens, read the softmax as a probability, then measure calibration and add temperature scaling, using Qwen3-1.7B.

Ollaya's documentation index for its local decision-model runtime: quickstart, the full CLI reference from run to mcp, native and TypeSafe-compatible API endpoints, Modelfiles, and MCP plus agent-skill guidance.

Ollaya's searchable registry of open decision models you can run locally: 21 models with capability filters, and cards showing authors, sizes, tags, update dates, and typed-decision scores with RTX 4090 latency.