How much does this differ from the other awesome-jev lists?

Two ways. Entries carry receipts, so each links to the exact file and line containing the API endpoint, SDK import, model identifier or evaluate call, and the 54 repos that matched a search but produced no code evidence are parked in data/leads.json instead of being quietly listed. Second, the performance claims were re-measured rather than repeated.

Which vendor claims actually held up?

Mixed. Consistency held best of the five models: 60 rephrased questions produced zero answer flips. The documented input-token rate was confirmed on 1,154,813 tokens. The 100 ms latency claim did not reproduce, the 445x cost claim reproduced at 88x against the model tested, and eliminates hallucination is overstated since 36 of 1,200 answers were wrong while highly confident.

Is Jev actually deterministic enough to treat as a typed object?

Close, not bit-exact, per the author's table. Asking the same question five times never flipped an answer and maximum probability drift was 0.09, but only 12 of 30 runs were bit-identical. Two other models in the comparison flipped outright, with drift of 0.81 and 0.98.

Do I have to take the measurements on trust?

The harness is open, and the author says the point is that you can disagree in code. Per-dataset accuracy, calibration curves and the failure cases sit in the benchmark directory, and the pages are generated from data/repos.json by a build script rather than hand-edited.

What is the license and how many entries are there?

CC0-1.0, with 788 entries of which 765 cleared the code-verification bar and 54 matched a search but produced no code evidence and sit in data/leads.json. Stars were read on 2026-09-20 and measure attention, not quality.

How do I reproduce the benchmark?

The harness is open under benchmark/. It ran 2,390 labelled questions through Jev and four comparison models, and the README says you can disagree with the measurements in code.

What did the under-100ms claim turn out to be?

It was not reproduced: server-side median was 248 ms and the fastest single call 189 ms, with none under 100 ms across 40 sequential calls and a 456 ms end-to-end median. The order-of-magnitude speedup appears only when batching 50 questions into one call, about 5 ms per question.

CommunityJev Guides & Articles

Awesome Jev Verified

CC0 curated list of Jev-based open-source projects where every entry links to the line of code that calls the API, and the marketing claims about accuracy, latency and cost are replaced with the author's own measurements.

See highlights

Open github.com

Stars: 6
Language: JavaScript
License: CC0-1.0
Published by: Community
Author: punk2898
Last verified: Oct 2026

punk2898/awesome-jev-verified

User repository on GitHub

View on GitHub

A curated list of open-source Jev projects where every entry links to the line of code that calls Jev, and every performance number comes from an independent 2,390-question benchmark.

Forks: 0
Last pushed: Updated Sep 2026

Repo stats from the GitHub API, cached Oct 2026.

About this project

Jev is not a chat model. You hand it state plus typed questions, and it hands back constrained answers with probabilities: There are already more than a dozen awesome-jev lists, and several are good — they are credited in Lists & resources. This one is built differently in two ways.

Quoted from the project's README. Read the full README.

Tagscommunity jevbest catalog-import

Works forJev for Classification

Used inJev for Software & DevTools

Languages: JavaScript

Highlights

Inclusion requires finding an actual Jev call in the source at a pinned commit; 765 of 788 entries cleared it and the rest are parked in data/leads.json.
Ran 2,390 labelled questions through Jev and four comparison models, with per-dataset accuracy, calibration curves and failure cases in the benchmark harness.
Multiple-choice ECE 0.124 is called overconfident, and 36 answers were wrong while at least 90% confident, so hallucination is overstated.
The under-100 ms claim did not reproduce; the order-of-magnitude speedup only appears when batching 50 questions into one call.

Watch out

The list states plainly that a listing means only that the repository contained code calling Jev, and is not a review of quality, security, licensing or whether the project runs. Many entries were days old, and the categories are produced by the model itself with low-confidence calls flagged for review rather than settled by a human. Only the top entries per section appear inline and attention counts are labelled as such. Copy reviewed against the repository README on 2026-10-04, not from running it.

Questions about this entry

Short answers drawn from the linked project or page.

More Jev resources like this

jev-cookbook

335

Chinese-language Jev cookbook with runnable Jupyter notebooks covering the three primitives, 18 official recipes, evaluation method, voice smart-home demo, and local Laya fine-tuning.

Jev Guides & Articles#community#jevbest#catalog-import

Community

datawhalechina/jev-cookbookPython

jev-hub

Static aggregation site and JSON dataset collecting Jev posts, demos, long-form pieces, and discussions from X with original links and author credit and no rehosted content.

Jev Guides & Articles#community#jevbest#catalog-import

Community

mizzlelover/jev-hubCSS

awesome-jev-usecases

Community index of shipped Jev decision-model projects across workflow, bulk, realtime, verify, harness and voice patterns, with official docs, SDKs and per-link rubric scoring.

Jev Guides & Articles#community#jevbest#catalog-import

Community

anandi1989/awesome-jev-usecases

awesome-jev-usecases

Community catalog of real Jev use cases, working architectures, and hard-won guidance, organized by decision shape with runnable examples and a ready-made question catalog.

Jev Guides & Articles#community#jevbest#catalog-import

Community

aliaihub/awesome-jev-usecases

jev-directory

Browsable directory pairing 50 runnable judge-model evals with exact prompts against more than a thousand community builds, each linked to its project and source post.

Jev Guides & Articles#community#jevbest#catalog-import

Community

everyai-com/jev-directoryHTML

awesome-jev-live

275

Self-rebuilding Jev index organized by evidence grade, with one ranked pick per category, multilingual guides, and links through to full cards and sources.

Jev Guides & Articles#community#jevbest#catalog-import

Community

wh000wh000/awesome-jev-livePython

From the Jev guides

Original write-ups on what this entry is for.

Data Retention, Residency, and the Decision-Only Advantage

Oct 12, 2026

The typed-answer shape removes a category of data risk, not all of it. Zero data retention per surface, the legal set to read, and the controls that remain yours to run.

Jev Guides & Articles#privacy#compliance#legal

Read article

The Unofficial Jev Hosts and Playgrounds

Oct 11, 2026

TypeSafe serves Jev from one API. A second tier of independent sites wraps it with their own keys, credits, and playgrounds. How to read the disclaimers before you paste a key.

Jev Guides & Articles#ecosystem#trust#hosting

Read article

How Jev's Launch Landed

Oct 11, 2026

The first ten days produced three receptions that rarely meet: a Product Hunt launch, a 620-point Hacker News thread, and a r/LocalLLaMA that doubted the framing. Reading them together.

Jev Guides & Articles#launch#community#reception

Read article

Back to all resources

From the Jev community

Posts from builders shipping with Jev right now.

Follow @typesafeai