Jev glossary
Evaluation & TrainingPareto frontier
Cost/quality frontier
Plotting accuracy against cost and time on log scales, where up and to the left is better; cascades are designed to sit there.
- Category
- Evaluation & Training
- Also known as
- Pareto frontier
- Reading time
- 1 min
- Related terms
- 4
- Directory entries
- 21
- Docs
- evals.typesafe.ai
- Added
- 2026-09-24
Definition
The workflow evals chart accuracy against cost and time on log scales with up-and-to-the-left marked better. The SDE cascade cookbook uses the same framing, reporting that on an internal sweep the cascade sat up-and-left of every single model.
The frontier is a decision tool: a cascade or a Jev workflow is worth its complexity only if it moves the operating point, which is why the cookbooks publish both quality and price next to each other.
Tagsevaluationcost
Related terms
Definitions that connect to this one.
SDE cascadeA two-stage extraction cascade: a mini model extracts, a Noul battery verifies, and a confidence gate escalates to a reasoning model.PatternsWorkflow evalsTypeSafe's published evaluations of four automation workflows, comparing Jev and frontier LLMs as structured workflows versus single prompts.Evaluation & TrainingBenchmark claimsTypeSafe's headline multipliers (193.6x faster, 444.6x cheaper, a 238x lower input price) come from its own workflow comparisons.Evaluation & TrainingToken pricingJev's published rate: $42 per billion input tokens, with output tokens free.API & Models
From the Jev directory
Directory entries that go deeper on this term.
Published evaluations of four automation workflows, security incidents, agent trace observability, invoice processing, and customer service, comparing Jev and frontier LLMs as structured workflows versus single prompts.
Jev Practices & PatternsDocs#official#benchmarks#evaluation
Official
A two-stage extraction cascade: a mini model extracts, a Noul battery verifies each field in one request, and a 0.7 gate escalates to a reasoning model, sitting on the cost/quality frontier.
Jev CookbooksDocs#official#cookbook#extraction
Official
DeepInfra's case for splitting agent work between a cheap execution model and a frontier planner, citing the LangChain benchmark that cut cost 74% while only 7% of calls reached the frontier model.
Jev Guides & ArticlesArticle#community#analysis#routing
Community
A Claude Code plugin that picks the model tier and thinking effort for every turn with Jev and weighs each switch against what it costs, since moving a long conversation to another model rewrites its prompt cache and can cost more than it saves.
Jev Integrations & Adapters#community#catalog-import#logicrw
Measured cost, latency, accuracy and raw output from the live Jev API across twelve realistic use cases, plus twelve other decision models on the same 633 items. Reproducible with your own key; the whole measured Jev run cost under one cent.
Jev Benchmarks & Evaluations#community#catalog-import#cobanov
Community
wallerchen/jev-measuredPython
wallerchen/jev-measuredPythonA benchmark for typed decision models such as Jev, built from seven policy-labelled generators and nine evaluation suites. It reports accuracy as medians across paraphrases, calibration against a matched noise floor, and realized cost under asymmetric cost matrices.
Jev Benchmarks & EvaluationsArticle#community#research#arxiv
Community
15 more matching entries in the full directory.
From the Jev AI model community
Posts from builders shipping with Jev right now.