Skip to content

ifReflex.cpp

Native C++ server on llama.cpp that answers System One choice, score, and noul questions locally in one prefill pass with zero generated tokens.

Stars
1
Language
C++
License
MIT
Published by
Community
Author
DreamBlooms
Last verified
Oct 2026

About this project

Any LLM. Structured decisions. No generation. No GPU. Native C++ inference for System One decision models, built on llama.cpp. You send a piece of state and a map of typed questions; it answers every one in a single forward pass and returns the full probability distribution over your exact options — no prose, no parsing, no "As an AI language model". Answers are read straight off the model's next-token logits, so output cost is zero generated tokens.

Quoted from the project's README. Read the full README.

Highlights

  • Prefill-only inference reads answers from next-token logits, with full distributions and no prose to parse.
  • One binary covers reflex, SemIf, RWKV-Jev, and stock instruct GGUFs behind a Jev-compatible HTTP API.
  • State prefix decoded once per request and reused across requests via a bounded LRU cache.
  • Prompt styles, chat templates, diffusion mode, permutations, and staged depends_on questions supported.

Watch out

Local inference needs a compatible GGUF and enough RAM, and matching the wire contract does not mean matching hosted accuracy. Copy reviewed against the repository README on 2026-10-04, not from running it.

Questions about this entry

Short answers drawn from the linked project or page.

More Jev resources like this

Native Swift 6 package that evaluates @Generable structs and enums through System One decision models in 15-150 ms, with on-device Laya, self-hosted laya-serve, and TypeSafe Jev cloud backends.
Jev Models & Reimplementations#community#github
6GitHub stars
Python helper that turns judgment calls into one-liners like likely, classify and rate, defaulting to Jev while also running on local or OpenAI-compatible backends.
Jev Models & Reimplementations#community#github
9GitHub stars
Self-hosted CPU-only server that speaks the /v1/systemone wire format for the KEV decision model, packaged as one container with ONNX Runtime and a health check.
Jev Models & Reimplementations#community#github
Laya multilingual server exposing POST /v1/systemone and GET /v1/models for noul, choice and score questions, usable with the official TypeSafe SDK.
Jev Models & Reimplementations#community#github
5GitHub stars
Python CLI that audits files and package trees against plain-English JSON rule packs in one System One forward pass, locally with kev or remotely with Jev.
Jev Models & Reimplementations#community#github
4GitHub stars
Zero-dependency Node package wrapping the Laya decision model for offline typed answers, usable as a CLI service, in-process library, or browser build.
Jev Models & Reimplementations#community#github

From the Jev guides

Original write-ups on what this entry is for.

Jev takes text only; Clef-omni adds image, audio, and video input and Liquid d1 adds images, each keeping the same typed-answer shape. Where that matters, where it does not, and the costs the vendors underplay.
Jev Models & Reimplementations#multimodal#open-models#decision-model
Read article
One model in September, a dozen by October. Clef, Liquid d1, Perplexity, and OpenAI all ship the same typed-answer shape now. How to read the rival benchmarks and pick on your own task.
Jev Models & Reimplementations#decision-model#benchmarks#pricing
Read article
Hundreds of repositories carry the system-one tag, but the ecosystem is a dozen ideas in different sizes. A tour of the families, the licenses, and what a download does not include.
Jev Models & Reimplementations#open-models#hugging-face#local
Read article
Back to all resources

From the Jev community

Posts from builders shipping with Jev right now.

Follow @typesafeai