Skip to content

Jev directory

Jev Practices & Patterns

296 curated Jev entries. How to design Jev states, questions, and confidence gates the right way, from the official patterns to the failure modes worth designing around.

By format

296
  • Docs18
  • Repos & sites199
  • Videos7
  • Posts16
  • Articles56

Updated

All 296 Jev Practices & Patterns

Search the full category, or filter by format and tag.

Showing 193–240 of 296 resources

0GitHub stars
A reproducible English benchmark running one review-classification rubric through jev-latest and gpt-5.6-luna, publishing per-field accuracy, macro F1, latency and API-reported cost alongside the raw responses and run manifest.
Jev Practices & Patterns#community#jevbest#catalog-import
0GitHub stars
A small Node.js TypeScript CLI for trying Jev on synthetic support text: one urgency question, three questions in a single request, or a latency comparison. No web server and no UI.
Jev Practices & Patterns#community#jevbest#catalog-import
1GitHub stars
Measures whether Jev can catch malicious agent skills on MalSkillBench, with a cascade arm that sends only the uncertain band to an LLM. Per-sample records, thresholds and calibration are all kept.
Jev Practices & Patterns#community#jevbest#catalog-import
0GitHub stars
A Japanese-language repository that continuously researches TypeSafe's Jev and System One models and organises the findings as Markdown slides, a presentation script and a standalone article.
Jev Practices & Patterns#community#jevbest#catalog-import
A fork of the SHADE-Arena public split that evaluates TypeSafe Jev as a monitor for covert agent sabotage, against Gemini 2.5 Flash and Pro. Thirteen hand-built transcripts across three tasks, 353 tool calls, and a full LaTeX report.
Jev Practices & Patterns#community#jevbest#catalog-import
1GitHub stars
jev-certify turns Jev's probabilities into a bounded claim: conformal risk control picks a routing threshold with a finite-sample guarantee on silently misrouted queries, and prediction-powered inference audits it with about 40 hand labels. Measured on 2,412 Jev 1.13 decisions over CLINC150.
Jev Practices & Patterns#community#jevbest#catalog-import
0GitHub stars
A measurement study that scores Jev against gpt-5.4-mini and gpt-5.6-luna on four public classification sets, then against recorded outcomes on a few thousand real pipeline decisions. Every per-item answer and the scoring code are committed.
Jev Practices & Patterns#community#jevbest#catalog-import
0GitHub stars
A public benchmark that scores Jev 1.13.0 on the Brazilian ENEM 2025 exam against open autoregressive baselines, reporting accuracy per subject area plus Expected Calibration Error, with a second pass that lets the model reject an item.
Jev Practices & Patterns#community#jevbest#catalog-import
1GitHub stars
CLI that normalizes messy Japanese addresses to postal codes using Japan Post KEN_ALL and JIGYOSYO master data, asking Jev only for the steps rules and lookups cannot settle, and printing the probability behind each decision.
Jev Practices & Patterns#community#jevbest#catalog-import
Study of whether a calibrated judgment primitive can tell agent-written wiki pages from human ones, using the collusion.wiki corpus, Jev's Noul against a local Qwen, and a threshold sweep that finds no separating cutoff.
Jev Practices & Patterns#community#jevbest#catalog-import
A single untitled Python file, one commit, no stars: an attempt to see how well Jev predicts financial markets, in a repository whose own description concedes that it does not do that well.
Jev Practices & Patterns#community#jevbest#catalog-import
A MuJoCo pick-and-place pilot that runs Jev, Claude Haiku and hand-written reactive rules through the same episodes and publishes the comparison, including the parts that did not flatter Jev.
Jev Practices & Patterns#community#jevbest#catalog-import
0GitHub stars
Static chart pages comparing Jev against 110 other language models on Thai standardized exams: cost and speed plotted against accuracy, plus a page on whether its stated confidence predicts correctness.
Jev Practices & Patterns#community#jevbest#catalog-import
0GitHub stars
A pre-registered adversarial evaluation of jev: nine experiments, 28 predictions fixed before any request was sent, and a report plus prompting guide regenerated from the measured logs.
Jev Practices & Patterns#community#jevbest#catalog-import
13GitHub stars
Local decision models that return Jev-shaped typed distributions instead of generated text: freeze a backbone, cache candidate features once, train a roughly 0.8M-parameter decision head, calibrate per primitive.
Jev Practices & Patterns#community#awesomejev#catalog-import
1GitHub stars
Jev run against a community reconstruction of Indonesia's SNBT 2025 entrance exam: 159 remembered questions across seven subtests, 156 scored, with every request payload and response kept.
Jev Practices & Patterns#community#awesomejev#catalog-import
88GitHub stars
WindTunnel is a benchmark harness for browser agents. It runs the same tasks on the same self-hosted Docker sites across every interaction mode, WebMCP, code execution, DOM, accessibility tree and screenshots, and scores the resulting application state instead of judging the run.
Jev Practices & Patterns#community#jevbest
63GitHub stars
Self-hosted workbench that screens JSONL or CSV into keep, review and reject partitions, then fine-tunes your own model and reports loss and perplexity on a held-out split.
Jev Practices & Patterns#community#awesomejev
An independent poker eval against TexasSolver: Jev matches solver top actions on easy spots but shoves the nuts into traps and needs explicit hand-rank text to fold to shown flushes.
Jev Practices & PatternsArticle#community#evaluation#calibration
Community
Hands-on QA automation examples with Jev: Playwright failure classification, guardrails, RAG, API calls from Postman, and decision-focused testing.
Jev Practices & PatternsVideo#community#video#tutorial
Community
A roughly 10,000-call black-box investigation that reconstructs Jev's likely architecture: a shared state prefix, isolated question branches, and direct probability readouts.
Jev Practices & PatternsArticle#community#analysis#architecture
Community
A critical technical read of Jev's launch claims that digs into the calibration and eval numbers and asks what the architecture keeps secret.
Jev Practices & PatternsArticle#community#evaluation#calibration
Community
An independent evaluation of Jev in three retrieval stacks, with recalculated recall, latency, and cost against DeepSeek, GPT-4o-mini, and GPT-5-mini baselines.
Jev Practices & PatternsArticle#community#search#reranking
Community
A video walkthrough of the control-system pattern: a request becomes structured state, Jev returns typed decisions, and code keeps the expensive model out of every loop.
Jev Practices & PatternsVideo#community#x#video
Community
A video comparison of local Laya against cloud Jev on a Tetris agent, where the open-weights model made decisions 11 times faster on a 16 GB MacBook Air.
Jev Practices & PatternsVideo#community#x#video
Community
Scott Chacon runs hosted Jev against two local decision models, laya and kev, in a Tetris match and a GitHub Settings filter, with a public test repo.
Jev Practices & PatternsVideo#community#video#open-models
Community
A skeptical computer-use test of Jev with a public test repository, from Builder.io's Steve.
Jev Practices & PatternsVideo#community#video#computer-use
Community
A local-inference walkthrough that compares Kev, SemIf, Von, and OpenJev on consumer hardware, including Brier scores and a fake-probabilities warning.
Jev Practices & PatternsVideo#community#video#open-models
Community
A head-to-head benchmark that prices 200 products from descriptions with Jev against GPT-5.6 Luna and GPT-4.1-Nano.
Jev Practices & PatternsVideo#community#video#benchmarks
Community
A Japanese experiment that builds a rules-based gomoku harness and replays a full Jev-versus-Jev game log to measure real per-move latency.
Jev Practices & PatternsArticle#community#article#games
Community
A skeptical Japanese replication that approximates Jev's speed by reading first-token logits from small LLMs, with Gemma3 and a Mario benchmark.
Jev Practices & PatternsArticle#community#article#open-models
Community
Vercel's Pranit reports benchmarking the fx auto-mode safety classifier with Jev: about 5 to 18 times faster and more accurate than GPT-5.6 Luna.
Jev Practices & PatternsPost#community#x#benchmark
Community
A pointer to Diogo Almeida's independent working note on building a Jev harness for coding agents, including why harnesses already make these calls badly.
Jev Practices & PatternsPost#community#x#coding-agent
Community
An internal benchmark report: Jev zero-shot came within about 5 points of recall of a fine-tuned model at matched precision, at roughly $70 a month.
Jev Practices & PatternsPost#community#x#benchmark
Community
A gomoku harness that does tactical work locally before asking Jev, shrinking 225 possible moves to about 40 candidates per turn.
Jev Practices & PatternsPost#community#x#video
Community
Published evaluations of four automation workflows, security incidents, agent trace observability, invoice processing, and customer service, comparing Jev and frontier LLMs as structured workflows versus single prompts.
Jev Practices & PatternsDocs#official#benchmarks#evaluation
Official
38GitHub stars
Side-by-side benchmark of TypeSafe Jev, Qwen 3.8 27B on Cerebras, and a local Needle 3 across seven synthetic workloads, recording validated outputs, mistakes, latency, tokens, and estimated cost. Raw exports and per-scene limitations are published.
Jev Practices & Patterns#community#typescript#benchmarks
10GitHub stars
CLI that fits a per-question confidence threshold to a target accuracy on your own labeled data, verifies it on a held-out split, estimates how much traffic still needs an LLM, and re-checks locked thresholds in CI. It publishes no Jev results of its own.
Jev Practices & Patterns#community#python#calibration
10GitHub stars
Reranking benchmark that gave Jev, Cohere Rerank 4 Pro, ZeroEntropy zerank-2, and DeepSeek the same thirty BM25 candidates across eight English datasets, publishing saved responses, scoring code, and paired-bootstrap intervals. Jev's rubric scored 0.692 nDCG@10 against Cohere Pro's 0.691.
Jev Practices & Patterns#community#python#search
108GitHub stars
A personal-assistant agent with 100 mocked tools that measures how many steps a task takes when the LLM picks the tool versus when Jev picks it before every model step.
Jev Practices & Patterns#community#typescript#agents
3GitHub stars
Blind security benchmarks for Jev on public corpora: 662 prompt-injection messages and 200 matched vulnerable-code pairs, with raw per-sample results and a TUI dashboard.
Jev Practices & Patterns#community#go#benchmarks
An exploratory study of zero-shot ham, spam, and phishing classification with Jev: enriched email context raised main-set accuracy from 93.62% to 98.64%, within 0.23 points of a trained TF-IDF baseline.
Jev Practices & Patterns#community#python#evaluation
1.2kGitHub stars
An independent open reproduction of the System One model class: Qwen3.5-based 2B and 35B mixture-of-experts models that return typed Choice, Score, and Noul probabilities in one forward pass, with nothing distilled from Jev.
Jev Practices & Patterns#community#python#open-models
4.8kGitHub stars
An independent baseline that reads typed option probabilities straight from a frozen Qwen3.5-4B's logits in one forward pass, reproducing Jev's interface pattern with open models rather than Jev's undisclosed model or training.
Jev Practices & Patterns#community#python#open-models
A benchmark that runs Jev on all 6,257 text traces of Who&When Pro to attribute agent failures, scoring it with the official pinned scorer against the paper's GPT-5.4, Claude Sonnet 4.6, GLM-5, and Qwen3.5-122B baselines.
Jev Practices & Patterns#community#python#benchmarks
9.3kGitHub stars
Apache-licensed, locally runnable Jev-style decision models (0.8B, 4B, 9B on Qwen3.5) with released weights, training code, a System One-compatible server, frozen eval suites, and a playground.
Jev Practices & Patterns#community#python#open-models
A graded relevance evaluation of Jev as a reranker: 9,831 labelled pairs from 164 queries over a 33,047-item skills catalog, comparing Jev score reranks with BM25, bge-m3, and rank fusion.
Jev Practices & Patterns#community#python#search
An independent calibration study of Jev over three public benchmarks and 900 rule-generated support tickets, publishing every raw Gateway response and the quantization limits of returned probabilities.
Jev Practices & Patterns#community#python#calibration

Index of all 296 entries

Start here with the Jev AI model

Featured entries in practices & patterns.

The box question type: one bounding box per question, returned as four edges that are fractions of the image, plus confidence, with no criteria field and no not-found value.
Jev Practices & PatternsDocs#official#docs#vision
Official
Published evaluations of four automation workflows, security incidents, agent trace observability, invoice processing, and customer service, comparing Jev and frontier LLMs as structured workflows versus single prompts.
Jev Practices & PatternsDocs#official#benchmarks#evaluation
Official
9.3kGitHub stars
Apache-licensed, locally runnable Jev-style decision models (0.8B, 4B, 9B on Qwen3.5) with released weights, training code, a System One-compatible server, frozen eval suites, and a playground.
Jev Practices & Patterns#community#python#open-models

Jev AI model articles

Original guides that go deeper on Jev practices & patterns.

Jev's compaction tools keep or drop tool calls instead of summarizing them — the thresholds they fire at, the savings they report, and why 1.14's opt-in 262k context doesn't settle the choice.
Jev Practices & Patterns#compaction#long-context#coding-agents
Read article
Per-tick buy/sell calls on Monad, a five-sleeve Hyperliquid desk, Nifty-50 rankers, and Polymarket confidence gates: how the catalog's trading repos wire Jev in without asking it to predict prices.
Jev Practices & Patterns#trading#markets#gates
Read article
How the box question type turns a crop into a decision: four fractional edges, a presence Noul for missing targets, the cut-off problem, and two patterns worth building.
Jev Practices & Patterns#vision#box#patterns
Read article

From the Jev community

Watch walkthroughs, read the threads, and see what builders are posting.

YouTube: A podcast segment on TypeSafe AI, its $40M raise, and the Jevons paradox behind the name.

YouTube: Gary Explains the catch: Jev understands natural language but answers with structured values and confidence.

YouTube: Sam Witteveen on System 1 thinking, then Choice, Score, and Noul demos, and chained actions.

Hacker News: Pipeable onesie CLI with shell-safety exit codes and a calibrate mode over labelled commands.

frodikarlsson3 pointsShow HN: onesie – An expressive Unix-pipeable CLI for System One models like JevRead the thread on Hacker News

Hacker News: Spoken-language learning with video scenes branching on TypeSafe Jev.

j_rcht1 pointShow HN: Worklaude – learn by speaking; video scenes branch on TypeSafe JEVRead the thread on Hacker News

Hacker News: OpenAI's Luna Decisions API framed as a fast follow to TypeSafe's Jev wave.

matt_d6 pointsOpenAI Answers TypeSafe's Jev with a Decision API Built on LunaRead the thread on Hacker News

Hacker News: Nikola Balić on what made the Jev launch easy to try and easy to share.

nkko2 pointsWhat TypeSafe Got Right with the Jev LaunchRead the thread on Hacker News