Jev glossary
API & Models64k context
Context window
The 64k-token budget covering state plus all questions, with a 32k sub-budget for state plus the longest question.
- Category
- API & Models
- Also known as
- 64k context
- Reading time
- 1 min
- Related terms
- 4
- Directory entries
- 2
- Docs
- docs.typesafe.ai
- Added
- 2026-09-24
Definition
Jev ingests the state once and evaluates every question against it in parallel. The 64k budget covers the state plus all questions combined, while 32k applies to the state plus the single longest question.
The two budgets are what make speculative fan-out practical: many questions fit in one request as long as no single question is enormous. Accuracy still falls as state grows with irrelevant detail, so the limit is not a target.
Tagsapilimits
Related terms
Definitions that connect to this one.
StateThe content a request asks Jev to evaluate: a string, a named object, or an array of messages, shared by every question in the request.Core ConceptsSpeculative fan-outAsk every question the system might need in one request (including ones only some branches use), and let code discard the rest.PatternsPrimitive limitsThe hard caps to design around: 255 Choice options, 2 to 10 Score levels, and a 64k context covering state plus questions.PrimitivesContext rotThe accuracy loss that comes from padding state with detail unrelated to the question; filter state before sending it.Core Concepts
From the Jev directory
Directory entries that go deeper on this term.
The model card for jev-1.13.0: $42 per billion input tokens with free output, a 64k context, 250k tokens per second, and how to list the models your account can call.
Jev Guides & ArticlesDocs#official#docs#models
Official
Ask everything the system might need in one request, then let code throw away what it does not use. The ticket-triage example sends a category plus four speculative questions in parallel.
Jev Practices & PatternsDocs#official#patterns#batching
Official
From the Jev AI model community
Posts from builders shipping with Jev right now.