Skip to content
JevDirectory.org
Patterns

Parallel questions

Batching many questions into one request instead of many calls, which is dramatically cheaper and faster with identical answers.

Category
Patterns
Also known as
—
Related terms
4
Directory entries
5
Docs
docs.typesafe.ai
Added
2026-09-24

Definition

Every question in a request is evaluated in parallel against the same state, and the answer to one question never becomes context for another. The parallel-questions cookbook batches a 13-question regulatory briefing into one call and reports 12.2x lower cost and 10x lower latency with no change in answers.

Coding agents fall into the one-question-per-call habit more than people do, which is why TypeSafe's agent skill explicitly tells agents to put many questions in each call.

Tagspatternsbatching

From the directory

A 13-question regulatory briefing that shows batching every question into one call is 12.2x cheaper and 10x faster with no change in answers.
Cookbooks & DemosDocs#official#cookbook#batching
Official
The three TypeSafe question types, the typed answers they return, how to choose between them, and how to ask several in a single call.
Practices & PatternsDocs#official#primitives#choice
Official
Ask everything the system might need in one request, then let code throw away what it does not use. The ticket-triage example sends a category plus four speculative questions in parallel.
Practices & PatternsDocs#official#patterns#batching
Official
Semantic search over GitHub's Terms of Service: one request ranks all 218 lines with a Choice while a Noul checks whether the document contains an answer at all, including when it should say no.
Cookbooks & DemosDocs#official#cookbook#search
Official
Reconstruct Markdown from unformatted text in two requests: 16 Noul line-pair questions stitch split sentences, then 62 questions classify each block's type and companions.
Cookbooks & DemosDocs#official#cookbook#formatting
Official

From the community

Posts from builders shipping with Jev right now.

Follow @typesafeai

Support answers in a Mac app

A local Jev build with room to get faster

jev-review: a local-first score loop for coding agents

built `jev-review` @typesafeai it's an experimental, local-first MCP plugin that gives coding agents a score quality feedback loop across different metrics. agents call jev while they work, get scored, make improvements, and repeat the loop try below 👇

Diogo Almeida
Diogo Almeida
TypeSafe AI
@CompleteSkeptic

After co-inventing ChatGPT, I kept asking myself: why have superhuman chat models not led to AGI? I’ve spent the last 2 years in stealth building a new way to train models (RLCD), and a new type of frontier AI model that we are releasing today: Jev • 20-200x faster • 40-400x

Reply

The X algorithm, rebuilt with Jev

Hard-coded rules moved to Jev

A chief of staff for bots