User repository on GitHub
Blazing fast, self-hosted structured decisions for open models with a TypeSafe AI compatible API, written in Rust.
- Forks
- 4
- Last pushed
- Updated Oct 2026
Repo stats from the GitHub API, cached Oct 2026.
CommunityJev Demos & Experiments
Sys1
Rust server that exposes a System One compatible API at /v1/systemone for self-hosted Laya checkpoints with token-based batching.
- Stars
- 53
- Language
- Rust
- License
- APACHE-2.0
- Published by
- Community
- Author
- alvarobartt
- Last verified
- Oct 2026
About this project
Blazing fast structured decisions for System One open-models self-hosted with a TypeSafe AI compatible API, written in Rust. tokio, axum and serde, the usual suspects. SDPA on CPU, Metal, and CUDA. Flash Attention on Ampere, Ada Lovelace, and Hopper. Blazing fast inference for ModernBERT and Qwen3.5. Multimodal decisions from text, images, and video when supported by the model. Rust and Cargo 1.98.1, mandatory. ffmpeg and ffprobe 6.1.1 or higher for video inputs.
Quoted from the project's README. Read the full README.
Works forJev for Classification
Used inJev for Software & DevTools
- Languages
- Rust
Highlights
- System One compatible API backed by candle, with dynamic token-based batching.
- SDPA on CPU, Metal and CUDA, plus Flash Attention on Ampere, Ada Lovelace and Hopper.
- Installs via cargo install sys1 with per-accelerator features and runs with a model id flag.
- Answers at /v1/systemone or /v1/decide with the documented choice, score and noul shapes.
Watch out
Only the listed Laya checkpoints are documented, and CPU, Metal and CUDA builds use different features. Copy reviewed against the repository README on 2026-10-04, not from running it.
Questions about this entry
Short answers drawn from the linked project or page.
This is a Rust server on tokio, axum and candle for serving Laya checkpoints locally. Use it when you want Jev-shaped requests against your own hardware instead of a hosted endpoint.
The English checkpoint covers English text, guardrails and email triage, the multilingual one covers 100+ languages at about 2.2x speed, and typed-decisions targets typed-decision workflows.
Install with cargo install sys1 using the cpu, metal, or cuda features, adding flash-attn for Ampere, Ada or Hopper. Then run sys1 with a model id and query localhost at /v1/systemone or /v1/decide.
Yes. The documented request shape takes a state plus choice, score and noul questions, and the curl example runs unchanged against the local port.
Rust and Cargo 1.98.1 are mandatory; ffmpeg and ffprobe 6.1.1+ are needed for video inputs, nvcc for CUDA, and xcode plus xcodebuild -downloadComponent MetalToolchain for Metal. Build with cargo install sys1 --features cpu, metal, or cuda.
It can make decisions from text, images, and video when the model supports it. The Cloudflare/clef and clef-flash models handle text, image, and video, while the Laya checkpoints cover English text and a multilingual variant is roughly 2.2x faster.
Dynamic token-based batching, SDPA on CPU, Metal, and CUDA, and Flash Attention on Ampere, Ada Lovelace, and Hopper. Inference is tuned for ModernBERT and Qwen3.5, using tokio, axum, serde, and candle.
More Jev resources like this
32GitHub stars
Jev-protocol random baseline that answers noul, choice, and score questions from fast pseudorandom numbers without reading the prompt.
Jev Demos & Experiments#community#jevbest#catalog-import
Community
karminski/Jev-QuantumRust
karminski/Jev-QuantumRust12GitHub stars
Local decision engine that answers letter-choice questions from one forward pass: shared prefill, one batched decode, and softmax over option letters with no text generation or repair.
Jev Demos & Experiments#community#jevbest#catalog-import
Community
emnlmn/snapRust
emnlmn/snapRust3GitHub stars
A local markdown mirror of the TypeSafe documentation plus Lume, a Rust search tool that indexes it with BM25 and a tag graph, so pattern-style queries such as intent routing can walk to the right page without a network round trip.
Jev Demos & Experiments#community#jevbest#catalog-import
Community
DeepBlueDynamics/typesafe-arenaRust
DeepBlueDynamics/typesafe-arenaRust4GitHub stars
A Rust CLI of Jev experiments, led by a PHI screener that judges four separate 45 CFR 160.103 metrics per file and an English part-of-speech tagger that batches only the unresolved words into one request.
Jev Demos & Experiments#community#jevbest#catalog-import
46GitHub stars
Open 150M encoder that reproduces the typed noul, choice, and score interface in one forward pass, trainable on a free GPU and runnable locally for nothing.
Jev Demos & Experiments#community#jevbest#catalog-import
941GitHub stars
Library that adds schema-guaranteed typed outputs to existing autoregressive LLMs without changing weights, served through SGLang or a hosted API.
Jev Demos & Experiments#community#jevbest#catalog-import
Community
TypeLLM/TypeLLMPython
TypeLLM/TypeLLMPythonFrom the Jev guides
Original write-ups on what this entry is for.
A game tick is a state plus a legal action list. How Clash Royale, Minecraft, and the earlier Mario, Pokémon, StarCraft, and drone loops ask Jev one step at a time.
Jev Demos & Experiments#gaming#agents#control
Read article
From the Jev community
Posts from builders shipping with Jev right now.