Jev Batching
4 curated entries tagged batching.
All 4 Jev Batching
Filter these entries by what they are called or what they do.
No entries match those filters.
None of the entries shown here match. 0 more carry this tag — browse all 4 in the directory.
- Ask everything the system might need in one request, then let code throw away what it does not use. The ticket-triage example sends a category plus four speculative questions in parallel.Jev Practices & PatternsDocs#official#patterns#batchingOfficial
- Semantic search over GitHub's Terms of Service: one request ranks all 218 lines with a Choice while a Noul checks whether the document contains an answer at all, including when it should say no.Jev CookbooksDocs#official#cookbook#searchOfficial
- Reconstruct Markdown from unformatted text in two requests: 16 Noul line-pair questions stitch split sentences, then 62 questions classify each block's type and companions.Jev CookbooksDocs#official#cookbook#formattingOfficial
- A 13-question regulatory briefing that shows batching every question into one call is 12.2x cheaper and 10x faster with no change in answers.Jev CookbooksDocs#official#cookbook#batchingOfficial
Jev articles
Original guides that mention Batching.
Jev bills input tokens and gives output away, and questions in one call run in parallel. Why the state is where the money is, and how to size a request before you ship it.
Jev Practices & Patterns#pricing#cost#api
Read article
Jev bills input tokens and gives output away, and questions in one request run in parallel. The design consequence is simple: ask more per call, then decide in code.
Jev Cookbooks#batching#patterns#search
Read article