Skip to content
JevDirectory.org
CommunityRepos & SDKs475 starsVerified 2026-09-22

Simple Jev Project

A local server and Python package that runs open models with Hugging Face Transformers or PyTorch and returns Choice, Score, and Noul answers read from next-token logits instead of generated JSON.

Category
Repos & SDKs
Published by
Community
Author
featherless-ai
Added
2026-09-22
Tagscommunitypythonopen-modelsclassificationsdk

Highlights

  • The server builds JSON responses from next-token logits, so nothing is generated and usage.output_tokens is always zero.
  • A public demo API needs no login or key, with a 2k-token context limit and 2 requests per second; Featherless paid plans raise the limits.
  • Backends cover a Hugging Face server, a native Laya Typed Decisions encoder with a 1,024-token-per-question default, and RFDT fine-tuning scripts.
  • usage.input_tokens counts unique token prefixes and shares the common context across the questions in a request.
  • Ships a playground and documentation at simple-jev.featherless.ai plus a shared common/ module for validation, prompt planning, and scoring.

Quickstart

bash
git clone https://github.com/featherless-ai/simple-jev.git
cd simple-jev
python3 -m venv .venv && source .venv/bin/activate
python -m pip install -e './hf-server'
python hf-server/hf_server.py --model Qwen/Qwen3.5-0.8B --device cpu --dtype float32

Watch out

Apache-2.0. Needs Python 3.12+ and downloaded weights; the demo API is limited to 2k tokens and 2 RPS, and calibration varies by model.

More like this

14.3kGitHub stars
Open multilingual System 1 decision models with published checkpoints for choice, score and noul questions, plus a router that dispatches each request to the right checkpoint in one forward pass.
Repos & SDKs#community#python#open-models
Communitylaya
425GitHub stars
An open, non-autoregressive System One model with published weights and a TypeSafe-compatible /v1/systemone API; the 395M-parameter OptionMarker checkpoint scores discrete and ordinal questions locally.
Repos & SDKs#community#python#open-models
Communityvon
300GitHub stars
An Apache-licensed System One decision server that reads Choice, Score, and Noul probabilities from DiffusionGemma 26B-A4B through vLLM on NVIDIA or MLX on Apple silicon, so TypeSafe SDKs work unchanged.
Repos & SDKs#community#python#open-models
Communityopenjev
Back to all resources

From the community

Posts from builders shipping with Jev right now.

Follow @typesafeai

700 leads scored for $0.09

Beating Gemini Flash Lite on an eval

Browser Use Ultrafast, powered by Jev

A really smart switch statement

hype-free explanation of jev: jev does not replace gpt / claude jev is just a *really* smart switch statement like if 2016 ml classifiers got 2026 levels of intelligence it's a new* type of tool that will make a lot of workloads insanely fast, cheap, and accurate * = and by Show more

Diogo Almeida
Diogo Almeida
TypeSafe AI
@CompleteSkeptic

After co-inventing ChatGPT, I kept asking myself: why have superhuman chat models not led to AGI? I’ve spent the last 2 years in stealth building a new way to train models (RLCD), and a new type of frontier AI model that we are releasing today: Jev • 20-200x faster • 40-400x

Reply

When a designer gets Jev

Full Jev video tutorial