Skip to content

The Cost of a Decision: Token Pricing and the Break-Even Point

Jev bills input tokens and gives output away, and questions in one call run in parallel. Why the state is where the money is, and how to size a request before you ship it.

Published
Category
Jev Practices & Patterns
Resources cited
6
Reading time
3 min
Tags#pricing#cost#api#batching

Jev's pricing model is unusual and it changes the design conversation. Once you understand that input tokens are the cost and that questions in one call run in parallel, a lot of "should we be doing this" becomes "how do we ask it." The API reference and the models page are the source numbers; this is how to reason with them.

Input is the bill, output is free

A Jev answer is a small set of floats under the question ids you sent, and Jev does not generate tokens to produce them. That is the whole reason output is free and the reason the one-request-many-questions design is not a micro-optimization but the default.

So the cost of a decision is roughly the size of the state plus every question, measured in input tokens. Shrinking either one is the only real lever.

The state is where the money is

A long document passed whole is hundreds or thousands of tokens; the same document pre-split with only the relevant field passed is a fraction of that. The pre-parsed extraction cookbook is a cost story as much as a quality one: parsing in code is free, and passing the parsed values keeps the request small.

The practical rule is to send the material a question judges and nothing else. Do not ship the whole ticket history to classify the last message.

Questions are cheap; round trips are not

Every question added to a request costs its own tokens, but asking five questions in one call beats five calls on every axis that matters — one latency, one state, and no duplicated context. The parallel questions cookbook batches them deliberately.

The break-even is straightforward: a second call re-sends the entire state. If both questions share the state, batching them is closer to free than to a doubling.

Estimate before you ship

Work out, on a representative request, the token count of the state and the questions together, multiply by your daily volume, and compare it to whatever the current pipeline costs. The catalog's deployments are candid about where the line falls: a per-tick game loop and a 126-call browser test both live or die on this number, and the testing article walks through how they kept it down.

DesignWhat you pay forWhen it wins
One broad question per callFull state re-sent every callNever, unless states are tiny and rarely shared
Many atomic questions, one callState once, questions onceAlmost always
Pre-parsed fields in stateOnly the fields judgedLarge documents
Ask everything the branch needsA few unused answersBranchy logic with a fast path

Do not pay to be told yes

A cheap pattern that wastes money is asking a question whose answer you could have computed. Do not ask Jev whether an amount is over a limit, whether a date is in the past, or whether a list is empty. Those are code. Reserve the spend for the judgments code cannot make, which the use-case map frames as the boundary between deterministic control and model judgment.

The output being free is a design constraint

Because you never pay for output, there is no incentive to ask one question that returns a paragraph. Ask the ten atomic questions you actually need and assemble the answer in code. The composite scoring and fan-out patterns exist because the billing model rewards them.

Read the current per-model input price, count your tokens, batch your questions, and move every arithmetic decision into code. That is the entire cost model.

From the Jev directory

The resources behind this article.

The raw HTTP contract behind every SDK: POST a state plus typed noul, choice, and score questions to /v1/systemone, and get one answer per question, with error codes and retry guidance.
Jev Guides & ArticlesDocs#official#docs#api
Official
The model card for jev-1.13.0: $42 per billion input tokens with free output, a 64k context, 250k tokens per second, and how to list the models your account can call.
Jev Guides & ArticlesDocs#official#docs#models
Official
A 13-question regulatory briefing that shows batching every question into one call is 12.2x cheaper and 10x faster with no change in answers.
Jev CookbooksDocs#official#cookbook#batching
Official
Regex finds candidate emails, phone numbers, and amounts; Jev picks the requested span so code copies a verbatim value that cannot be invented, with no free-text extraction required.
Jev CookbooksDocs#official#cookbook#extraction
Official
Explore TypeSafe use cases by industry and turn promising ideas into concrete software workflows.
Jev Practices & PatternsDocs#official#use-cases
Official
Break a judgment into atomic Score questions, normalize each by its top level, and combine them with weights you control in code, as in the resume example's four scored dimensions.
Jev Practices & PatternsDocs#official#patterns#score
Official
Back to all articles

More Jev articles

Most Jev accuracy problems are state problems. What belongs in a state, what is a pre-made judgment to leave out, and why naming the slice you ask about matters more than the wording.
Jev Practices & Patterns#state#design#primitives
Read article
A Noul returns one number and no separate confidence. How to read the value, pin its boundary with criteria, split compound questions, and set a per-action threshold that matches the cost of being wrong.
Jev Practices & Patterns#noul#primitives#confidence
Read article

From the Jev community

Posts from builders shipping with Jev right now.

Follow @typesafeai