Jev glossary
Answers & ConfidenceConfidence score
Confidence
A 0-1 number on every Choice and Score answer that collapses the probability distribution into one certainty score.
- Category
- Answers & Confidence
- Also known as
- Confidence score
- Reading time
- 1 min
- Related terms
- 5
- Directory entries
- 38
- Docs
- docs.typesafe.ai
- Added
- 2026-09-24
Definition
Confidence is a statistic computed from the distribution the answer already returns: concentrated probability means a confident answer, a spread-out distribution means an uncertain one. TypeSafe returns it so you can threshold without doing the math yourself, and Noul answers do not carry one because the probability is the answer.
You are never locked into TypeSafe's definition: the full probabilities come back on every answer, so a different measure can be computed when your domain calls for one.
Tagsconfidencecore
Related terms
Definitions that connect to this one.
CalibrationThe property that outcomes given a probability of 0.2 occur about 20% of the time, measured across many predictions.Answers & ConfidenceProbability distributionThe floats summing to 1 across your options or levels that every Choice and Score answer returns under probabilities.Answers & ConfidenceConfidence gateA threshold on confidence that decides whether code acts, confirms first, or escalates to a person or a bigger model.Answers & ConfidenceConfidence floorA baseline below which code never acts on an answer, regardless of what the answer says.Answers & ConfidenceUncertaintyThe honest "I'm not sure" signal that lets a system defer instead of guessing, exposed through probabilities and confidence.Answers & Confidence
From the Jev directory
Directory entries that go deeper on this term.
How TypeSafe reports certainty, how it differs from probability, and how to use it architecturally to gate and route decisions.
Jev Practices & PatternsDocs#official#confidence#routing
Official
The three TypeSafe question types, the typed answers they return, how to choose between them, and how to ask several in a single call.
Jev Practices & PatternsDocs#official#primitives#choice
Official
The Python response models: SystemOneResponse groups answers by id, and records the model name, token usage, and request id.
Jev Repos & SDKsDocs#official#docs#sdk
Official
A 3D robot that understands without generating text: one TypeSafe call per turn with nine typed questions, then code decides whether to act, ask, or shrug.
Jev CookbooksPlayground#community#playground#embodied-agent
Community
CLI that fits a per-question confidence threshold to a target accuracy on your own labeled data, verifies it on a held-out split, estimates how much traffic still needs an LLM, and re-checks locked thresholds in CI. It publishes no Jev results of its own.
Jev Practices & Patterns#community#python#calibration
Community
abhixhek/jevcalPython
abhixhek/jevcalPythonA Ruby client for TypeSafe's System One API that returns typed Noul, Choice, and Score answers, validates obvious input mistakes before spending a request, and pools HTTP connections across threads.
Jev Repos & SDKs#community#ruby#sdk
Community
joshmn/typesafe-sdkRuby
joshmn/typesafe-sdkRuby32 more matching entries in the full directory.
From the Jev AI model community
Posts from builders shipping with Jev right now.