Skip to content

Jev glossary

PatternsLogit scoring

Logit readout

Reading the next-token probability of each declared label, then renormalising, so no answer text is generated.
Category
Patterns
Also known as
Logit scoring
Reading time
1 min
Related terms
4
Directory entries
8
Docs
Not listed
Added
2026-09-28

Definition

Lichen, verdict, and Rizzo Flow all answer by scoring label tokens in one forward pass. Lichen lists options twice in rotated order and shrinks confidence when the two readings disagree. Verdict keeps the probability mass that landed on the labels before renormalising, because a tiny mass can still rank options after it is scaled to 1.

The mechanism is not Jev's. These projects say so. Output tokens in their sample responses are zero. Accuracy and calibration still depend on the GGUF you loaded and on any temperature or shrink you fitted.

Tagspatternsopen-models

From the Jev directory

Directory entries that go deeper on this term.

58GitHub stars
A local /v1/systemone server that reads label probabilities from a GGUF chat model, with prompt repetition and a confidence shrink toward uniform.
Jev Models & Reimplementations#community#python#open-models
8GitHub stars
A Python server in front of llama-server that reads one-token label probabilities and exposes them as POST /v1/systemone.
Jev Models & Reimplementations#community#python#open-models
904GitHub stars
A local server that reads next-token probabilities from a fine-tuned Spark model and returns Choice, Score, and Noul answers with zero generated tokens.
Jev Models & Reimplementations#community#python#open-models
A pi coding-agent extension that ranks long-term memory files against the current context with a yes/no classifier read from native token logits. It triggers on cold start, post-compaction and an on-demand tool, and offers a prior, not a verdict.
Jev Integrations & Adapters#community#github#python
A CPU port of SemIf with a web UI: JEV-CPU loads Qwen3-0.6B in float32 and reads a decision from its option logits in about a second, across eight domains from support to incident severity, with no GPU.
Jev Models & Reimplementations#community#catalog-import#madewithjev
Community
3GitHub stars
A training-free runtime that turns dense Qwen3 or Qwen3.5 checkpoints into a Jev-style Noul, Choice and Score service, sharing one state prefill across isolated questions and reading each answer from candidate-token logits.
Jev Models & Reimplementations#community#qwen#local-inference

2 more matching entries in the full directory.

From the Jev AI model community

Posts from builders shipping with Jev right now.

Follow @typesafeai