Skip to content

Moderating a site with Jev

Tom Nick's write-up before jevdit.com: irony detection on 100 German soccer tweets, with Jev 1.13.0 next to Opus, Astra, and Laya.

Format
Article
Published by
Community
Author
Tom Nick
Last verified
Sep 2026

Highlights

  • 100 German soccer tweets. Jev 1.13.0 scored 79/100 on a single run.
  • Claude Opus 5.5 scored 385/400 across four runs, mean 96.25%. The human average cited is 83.3%.
  • GPT-6 Luna mean 82.75%. Claude Sonnet 5 mean 74.75%. Laya Multilingual 53/100 on one run.

Watch out

27 September 2026. Jev and Laya have one run; the chat models have four. The hosted site is a separate entry.

Questions about this entry

Short answers drawn from the linked project or page.

Reactions & coverage

Posts, threads, and videos about this entry from around the web.

YouTube: Building a contextual brand-safety scorer on Jev from scratch.

X: A website slop detector that checks 35 tells in 243 ms

X: Breaking, golden nugget, or slop

X: A filter for reply-guy comments

Related terms

Glossary definitions related to this entry.

More Jev resources like this

Opper hosts Kev 4B and typesafe/jev-latest on the same /v1/systemone compat route and compares accuracy, tokens, and latency on 362 post-release questions.
Jev Guides & ArticlesArticle#community#article#open-models
Community
Datadog's walkthrough of one Jev rubric that scores every criterion in a single request, then runs as online evals on live spans and as offline experiments.
Jev Guides & ArticlesArticle#community#article#evaluation
Community
Sam Reghenzi's product-taxonomy benchmark: a Jev Choice at every level versus a gpt-5.2 agent that descends the tree and can be sent back by a judge.
Jev Guides & ArticlesArticle#community#article#evaluation
Community
Alex Molas argues that a probability fit on TypeSafe's data is not calibrated on yours, so Jev's numbers should be treated as scores.
Jev Guides & ArticlesArticle#community#article#calibration
Community
Privatemode's write-up of typed decisions from GLM-5.3-Flash in one forward pass, with latency, cost, and accuracy set next to Jev and Laya.
Jev Guides & ArticlesArticle#community#article#evaluation
Community
OpenRouter's Banking77 run: 3,080 support utterances, 77 intents, Jev 1.13 against Claude Opus 5 on the same one-line criteria, with latency, cost, and a confidence cascade.
Jev Guides & ArticlesArticle#community#article#evaluation
Community

From the Jev guides

Original write-ups on what this entry is for.

The typed-answer shape removes a category of data risk, not all of it. Zero data retention per surface, the legal set to read, and the controls that remain yours to run.
Jev Guides & Articles#privacy#compliance#legal
Read article
TypeSafe serves Jev from one API. A second tier of independent sites wraps it with their own keys, credits, and playgrounds. How to read the disclaimers before you paste a key.
Jev Guides & Articles#ecosystem#trust#hosting
Read article
The first ten days produced three receptions that rarely meet: a Product Hunt launch, a 620-point Hacker News thread, and a r/LocalLLaMA that doubted the framing. Reading them together.
Jev Guides & Articles#launch#community#reception
Read article
Back to all resources

From the Jev community

Posts from builders shipping with Jev right now.

Follow @typesafeai