Skip to content

Jev directory

Jev — Logits-Based Decision API

A small HTTP service that adds a decision interface to any chat model: POST /v1/decision evaluates a finite set of candidate labels in one forward pass, reads next-token logits and returns structured JSON without model.generate() or output decoding.
Stars
0
Language
Python
Reading time
2 min
Published by
Community
Author
siyehua
Last verified
Oct 2026

siyehua/jev

User repository on GitHub

View on GitHub

给任意的模型增加decision决策接口

Forks
0
Last pushed
Updated Oct 2026

Repo stats from the GitHub API, cached Oct 2026.

Languages
Python
Platforms
API
Capabilities
Open sourceRuns locally

Highlights

  • Adds a dedicated POST /v1/decision interface while keeping chat and generation separate.
  • Evaluates a finite label set via one forward pass, reading next-token logits — no model.generate() and no decoded output tokens.
  • Backend: Hugging Face Transformers causal LM, default Qwen/Qwen2.5-0.5B; strategy label_logits; FastAPI + Uvicorn.
  • SPEC.md §7.6 limit: probabilities are softmax-normalized relative label scores, not calibrated probabilities of real-world correctness.
  • Implements SPEC.md v0.1 as an MVP; the Chinese description says it adds a decision interface to arbitrary models.

Quickstart

bash
pip install -r requirements.txt

python run.py --host 127.0.0.1 --port 8000
# model loads once at startup; ready when you see "service ready"

Watch out

README and GitHub metadata reviewed 2026-10-17; the digest truncates the curl example mid-request, so the full request and response schema is not captured. The project itself warns that returned probabilities are relative label scores, not calibrated probabilities.

Questions about this entry

Short answers drawn from the linked project or page.

From the Jev guides

Original write-ups on what this entry is for.

From the Jev AI model community

Posts from builders shipping with Jev right now.

Follow @typesafeai