How is this different from calling hosted Jev?

It matches the System One wire shape locally so answers never leave the machine, scoring from local logprobs instead of TypeSafe cloud; pick the model per request or use jev-latest.

What hardware and setup does first boot need?

Go plus C toolchain with CGO enabled and internet on first run for llama.cpp libs and models, then MODEL or KRONK_PROCESSOR=cpu to limit memory or force CPU.

Can I run only one model to save memory?

Yes. Set MODEL=minicpm5-2b to load a single preset; default serves oido-rlhf-minicpm5-2b and oido-rlhf-qwen3.5-4b together.

What is production-ready versus demo defaults?

Defaults run with auth off for local trials; for real deployment set API_KEY, set DOCS=false, and follow the production notes for TLS, limits, metrics, and shutdown.

How do I build and start the server?

Clone the repo, run go build -o oido-systemone . then ./oido-systemone, and wait for the listening log line; it serves on http://localhost:8080 with Swagger at /docs, or use docker compose up -d.

Which question types can I mix?

Yes/no (noul), choice, and score questions can be mixed in one request, and you can pick the model per request or use the jev-latest alias so TypeSafe SDKs work unchanged.

How do I force CPU or limit memory?

Run MODEL=minicpm5-2b ./oido-systemone to load a single preset instead of both, or KRONK_PROCESSOR=cpu ./oido-systemone to force CPU; the GPU backend is otherwise picked automatically with CPU as fallback.

CommunityJev Tools & CLIs

Oido Systemone

Local Go server for POST /v1/systemone running MiniCPM5-2B or Qwen3.5-4B in-process, answering in one forward pass with no text generation.

See highlights

Open github.com

Stars: 0
Language: Go
License: MIT
Published by: Community
Author: Djancyp
Last verified: Oct 2026

Djancyp/oido-systemone

User repository on GitHub

View on GitHub

Local, drop-in server for TypeSafe's System One API (POST /v1/systemone). Runs MiniCPM5-2B or Qwen3.5-4B in-process via Kronk/llama.cpp, on GPU or CPU. One Go binary, no Docker. Yes/no, choice an score answers from a single forward pass. Swagger, Prometheus metrics, rate limiting and TLS built in.

Forks: 0
Last pushed: Updated Sep 2026

Repo stats from the GitHub API, cached Oct 2026.

About this project

Self-Hosted TypeSafe System One API, on Local Models. Quickstart | Docs | API | GPU | Docker | Production. oido-systemone is a local, drop-in server for TypeSafe's System One API (POST /v1/systemone). It runs a GGUF model (MiniCPM5-2B or Qwen3.5-4B) in-process through Kronk and llama.cpp, so answers never leave your machine. Every answer is one forward pass and one token: a softmax over option-letter logprobs. No text is generated. One Go binary. Docker optional, no external API.

Quoted from the project's README. Read the full README.

Tagscommunity github

Works forJev for Scoring

Used inJev for Software & DevTools

Languages: Go

Highlights

One Go binary with optional Docker; GPU backends picked automatically with CPU fallback and no external API.
Mixes noul, choice and score in one request; jev-latest alias lets TypeSafe SDKs work unchanged.
Each answer is one forward pass and one token as softmax over option-letter logprobs; Swagger UI at /docs.
Includes API key, TLS, rate limiting, /healthz, Prometheus /metrics, and graceful shutdown for production.

Watch out

First run downloads libs and models into ~/.kronk/ and needs Go plus C toolchain; models carry their own licenses. Copy reviewed against the repository README on 2026-10-04, not from running it.

Questions about this entry

Short answers drawn from the linked project or page.

More Jev resources like this

Paca

1.9k

A Go-based team workspace with optional Jev AI for agent auto-routing, task auto-fill, auto-assign, and automation condition nodes.

Jev Tools & CLIs#community#go#agents

Community

Paca-AI/pacaGo

brier

Open local decision model on Qwen3-4B with LoRA adapters that answers choice, score, and noul questions with probabilities, calibrated confidence, and conformal sets, offline with no per-call cost.

Jev Tools & CLIs#community#github

Community

Mangaba-ai/brierPython

jeff

Go CLI for Jev with noul, choice, score, eval, rank, and models commands: rank sends one Score question per item per weighted YAML dimension in a single request and sums weight times score in code, while threshold flags turn a failed gate into exit code 10 for scripts and CI.

Jev Tools & CLIs#community#cli#go

Community

saembit/jeff-cliGo

paper-radar-jev

Python CLI that pulls recent arXiv papers, scores relevance with TypeSafe and writes daily Markdown and JSON rankings with resume-safe storage.

Jev Tools & CLIs#community#github

Community

LYchoon/paper-radar-jevPython

rwkv-jev

RWKV-7 decision-model server exposing a Jev-compatible /v1/systemone endpoint, with constrained decoding over answer tokens and zero output tokens.

Jev Tools & CLIs#community#github

Community

XingQiPan/rwkv-jevPython

jev

Minimal Go client for Jev using only the standard library, with typed Choice, Noul, and Score questions plus local confidence thresholds.

Jev Tools & CLIs#community#github

Community

drpaneas/jevGo

From the Jev guides

Original write-ups on what this entry is for.

Jev on the Gateways: Vercel, Workers AI, and OpenRouter

Oct 12, 2026

The request shape barely changes across surfaces; the surrounding contract does. When to call the API directly and when a gateway, a Worker binding, or a router entry earns its extra hop.

Jev Tools & CLIs#gateway#vercel#cloudflare

Read article

Exporting Decision Models: GGUF, ONNX, and Device Runtimes

Oct 10, 2026

Taking a decision checkpoint out of Python: what the GGUF and browser WebGPU exports preserve, what they change, and the parity evidence the model cards publish.

Jev Tools & CLIs#open-models#local#onnx

Read article

Records at Rest: Documents, Inboxes, and Risk Queues

Sep 28, 2026

Jev labels a record that already exists. Code moves, flags, or holds it. How the document, mail, and transfer tools keep the action out of the model.

Jev Tools & CLIs#classification#email#security

Read article

Back to all resources

From the Jev community

Posts from builders shipping with Jev right now.

Follow @typesafeai