Skip to content

Jev directory

Open Bonsai Jev

An independent reimplementation of the OpenJev mechanism on PrismML's 1.75-bit Bonsai weights: typed decisions read straight off the next-token distribution of a 5.95 GB 27B model in one forward pass.
Stars
8
Language
Python
License
MIT
Reading time
3 min
Published by
Community
Author
nicolailassen
Last verified
Oct 2026

openjev's mechanism, Bonsai's weights: typed decisions read straight from one forward pass of a 1.75-bit 27B model. Credit to TheoLeeCJ (SemIf/OpenJev) and PrismML.

Forks
3
Last pushed
Updated Sep 2026

Repo stats from the GitHub API, cached Oct 2026.

Highlights

  • Reads the probability of A versus B straight off the next-token distribution; nothing is generated and nothing is parsed.
  • README badges headline WANLI-256 at 74.6% and 5.95 GB of weights; the visible table shows the 1.7B at 52.0% over a 33.3% chance baseline.
  • Runs on CPU, Metal, CUDA or Vulkan; the sample output reports a llama.cpp backend and a 1.852 s forward pass.
  • Code is MIT and the Bonsai weights are Apache 2.0, used as published with nothing retrained or requantized.
  • Credits TheoLeeCJ's SemIf/OpenJev for the mechanism and PrismML for the low-bit weights, and states it is unaffiliated with any of them.

Quickstart

bash
./openjev/score.sh -q "Is the user angry?" --state '{"msg":"this is broken AGAIN and nobody replies"}'
{"choice": "true", "probabilities": {"true": 0.991651, "false": 0.008349}, "label_mass": 0.994205, "backend": "llama.cpp"}

Watch out

Copy reviewed against the repo README on 2026-10-15; the pasted README was truncated inside the decision-quality results table, so only the 1.7B row and headline badge numbers are quoted. The repo states its prompt differs from SemIf's, so its numbers are not directly comparable to SemIf's.

Questions about this entry

Short answers drawn from the linked project or page.

From the Jev guides

Original write-ups on what this entry is for.

From the Jev AI model community

Posts from builders shipping with Jev right now.

Follow @typesafeai