Skip to content
JevDirectory.org
Patterns

Speculative fan-out

Ask every question the system might need in one request — including ones only some branches use — and let code discard the rest.

Category
Patterns
Also known as
—
Related terms
4
Directory entries
5
Docs
docs.typesafe.ai
Added
2026-09-24

Definition

The fan-out pattern sends many questions in a single call and lets code decide what is relevant. The ticket-triage example asks a Choice category plus four speculative Score and Noul judgments, then escalates bugs above severity 1.5 with reproduction above 0.6 and flags refunds above 0.7.

Questions run in parallel, so adding them barely changes response time; the cost is the input tokens for each speculative question on every call. Fan out on questions several branches can reuse rather than on everything a workflow might ask.

Tagspatternsbatching

From the directory

Ask everything the system might need in one request, then let code throw away what it does not use. The ticket-triage example sends a category plus four speculative questions in parallel.
Practices & PatternsDocs#official#patterns#batching
Official
Architectural patterns for System One systems: speculative fan-out, confidence-gated routing, composite scoring, and intent routing.
Practices & PatternsDocs#official#patterns#architecture
Official
Semantic search over GitHub's Terms of Service: one request ranks all 218 lines with a Choice while a Noul checks whether the document contains an answer at all, including when it should say no.
Cookbooks & DemosDocs#official#cookbook#search
Official
Reconstruct Markdown from unformatted text in two requests: 16 Noul line-pair questions stitch split sentences, then 62 questions classify each block's type and companions.
Cookbooks & DemosDocs#official#cookbook#formatting
Official
A 13-question regulatory briefing that shows batching every question into one call is 12.2x cheaper and 10x faster with no change in answers.
Cookbooks & DemosDocs#official#cookbook#batching
Official

From the community

Posts from builders shipping with Jev right now.

Follow @typesafeai

Post scoring with SuperX

Jev + SuperX = virality solved ✅ Every post gets 61 questions in ~1s for $0.0004 🤯 > fitted on 9,481 real posts from 207 creators > picks the viral post 2 in 3 times > never rewards reply bait So: write, score, rewrite, stop when it peaks. Free, no signup. try it below ↓

Rob Hallam
Rob Hallam
@robj3d3

I spent the last 8 hours building a viral post classifier with Jev. It's now better at spotting viral posts than I am. And it's as good as Fable 5.1, but 100x faster.

Image
Reply

A canvas you control by pointing and speaking

Jev plays Smash Bros. against itself

A keystroke oracle that reads intent in ~100 ms

A second-hand shopping agent

Predictive spreadsheets

Another crazy @typesafeai Jev example: Predictive spreadsheets Spreadsheets recalculate numbers, not meaning. Jev reads intent. Type "Urgency" at the top of a column and, as you type, it figures out you want each row rated from "no follow-up needed" to "urgent" in ~100 ms.

nader dabit
nader dabit
Cognition
@dabit3

Also have been playing with @typesafeai Jev, insane! So many immediate use cases and new apps are possible. What a time to be a builder! Sharing some experiments here starting with: Keystroke oracle / predictive launcher: Your launcher ranks by aliases, fuzzy match, and

Reply