Skip to content

Bev

Local HTTP API that scores 2-255 candidate options per field with a redistributed ternary GGUF, returning typed Choice, Noul, and Score answers as structured JSON.

Stars
12
Language
Python
License
MIT
Published by
Community
Author
Reza2kn
Last verified
Oct 2026

About this project

7.21 GB model file · 7.28 GiB measured CPU RAM · 8.18 GiB observed Mac Metal process RSS · 8.30 GiB observed NVIDIA VRAM. Bev runs Jevfire-style decision scoring on Prism ML's Ternary-Bonsai-2-27B. Give it context and a finite set of choices; it scores every candidate, selects an answer, and returns structured JSON through a local HTTP API.

Quoted from the project's README. Read the full README.

Highlights

  • One next-token scoring step per field over allowed labels, with candidate probabilities and token IDs returned.
  • Serves on loopback 127.0.0.1:18781 with interactive docs; data dir defaults under home and BEV_ROOT overrides it.
  • Requires the pinned Prism llama.cpp fork and the 7.21 GB model file; CPU-only hosts should start with 16 GB RAM.
  • Fields evaluate independently; Noul returns P(true) and Score returns a probability-weighted rubric position.

Watch out

Persian benchmark used the Linux CUDA path on synthetic data and does not establish general reliability; scores are relative preferences, not calibrated confidence. Copy reviewed against the repository README on 2026-10-04, not from running it.

Questions about this entry

Short answers drawn from the linked project or page.

More Jev resources like this

Open 150M encoder that reproduces the typed noul, choice, and score interface in one forward pass, trainable on a free GPU and runnable locally for nothing.
Jev Demos & Experiments#community#jevbest#catalog-import
941GitHub stars
Library that adds schema-guaranteed typed outputs to existing autoregressive LLMs without changing weights, served through SGLang or a hosted API.
Jev Demos & Experiments#community#jevbest#catalog-import
45GitHub stars
Drop-in service that exposes Upstage Solar models through the System One shape, accepting state plus noul, choice, or score questions.
Jev Demos & Experiments#community#jevbest#catalog-import
38GitHub stars
Research recipe that fuses two frozen open readers into Jev-style yes/no judgments with a fit-free router, confidence gate, and candidate sets.
Jev Demos & Experiments#community#jevbest#catalog-import
62GitHub stars
Simulation study that drives one xArm7 apple-to-plate task with Jev, a large reasoning model, and a small model through identical incremental controls.
Jev Demos & Experiments#community#jevbest#catalog-import
40GitHub stars
Open research toolkit that encodes an image once and answers multiple typed choice, noul, and score questions from a shared distribution, plus a local 0.6B text-decision model.
Jev Demos & Experiments#community#jevbest#catalog-import

From the Jev guides

Original write-ups on what this entry is for.

A game tick is a state plus a legal action list. How Clash Royale, Minecraft, and the earlier Mario, Pokémon, StarCraft, and drone loops ask Jev one step at a time.
Jev Demos & Experiments#gaming#agents#control
Read article
Back to all resources

From the Jev community

Posts from builders shipping with Jev right now.

Follow @typesafeai