Jev glossary
Evaluation & TrainingComplementary probabilities
Structural invariants
Arithmetic identities you might assume (complementary probabilities summing to 1, agreement across question types) are not guaranteed.
- Category
- Evaluation & Training
- Also known as
- Complementary probabilities
- Reading time
- 1 min
- Related terms
- 5
- Directory entries
- 1
- Docs
- docs.typesafe.ai
- Added
- 2026-09-24
Definition
Two documented examples: the same refund question asked as a Noul read 0.22 while a Choice put yes at 0.01, and a question with its negation as two Nouls read 0.72 and 0.47, summing to 1.19 rather than 1.
The guardrail is not to rely on expected invariance. Word each question to mean directly what you want, do not carry a threshold tuned on a Noul over to a Choice, and do not hold the model to arithmetic identities between separate questions.
Tagslimitationsdesign
Related terms
Definitions that connect to this one.
JaggednessThe documented set of jev-1.13 failure modes (literal reading, counting, dates, indirection, context rot), each with a guardrail.Evaluation & TrainingThresholdThe value your code compares against a score, a Noul probability, or a confidence to turn an answer into an action.Answers & ConfidenceNoulThe yes/no primitive: one probability from 0 to 1, where the value is the answer and no separate confidence is returned.PrimitivesChoicePick one option from a set you define; returns the selected option, a probability for every option, and confidence.PrimitivesProbability distributionThe floats summing to 1 across your options or levels that every Choice and Score answer returns under probabilities.Answers & Confidence
From the Jev directory
Directory entries that go deeper on this term.
A maintained list of jev-1.13's known failure modes, literal reading, unreliable counting, dates as text, indirection, context rot, and contradictory criteria, each with a guardrail.
Jev Practices & PatternsDocs#official#docs#evaluation
Official
From the Jev AI model community
Posts from builders shipping with Jev right now.