Jev Observability

LangWatch Instant Evals ships a TypeSafe Jev classifier that batches Noul, Score, and Choice judgments on production traces in one POST per text.

Datadog's walkthrough of one Jev rubric that scores every criterion in a single request, then runs as online evals on live spans and as offline experiments.

CLI that collapses Loki log batches and asks Jev six typed questions in one call, then maps the answers in code to suppress, watch, review, notify, page or an auto-remediation candidate.

An open-source, local-first memory layer that captures session history across Claude Code, Cursor, Codex, OpenCode, Cline, and 20+ other harnesses, then has Jev judge bounded, redacted trace projections for reusable lessons a person reviews.

Use Jev as a Braintrust judge scorer, then inspect selected answers, confidence, and probabilities alongside the scorer answer. Includes tracing for your own calls.