CommunityJev Guides & Articles
Moderating a site with Jev
Tom Nick's write-up before jevdit.com: irony detection on 100 German soccer tweets, with Jev 1.13.0 next to Opus, Astra, and Laya.
- Format
- Article
- Published by
- Community
- Author
- Tom Nick
- Last verified
- Sep 2026
Highlights
- 100 German soccer tweets. Jev 1.13.0 scored 79/100 on a single run.
- Claude Opus 5.5 scored 385/400 across four runs, mean 96.25%. The human average cited is 83.3%.
- GPT-6 Luna mean 82.75%. Claude Sonnet 5 mean 74.75%. Laya Multilingual 53/100 on one run.
Watch out
27 September 2026. Jev and Laya have one run; the chat models have four. The hosted site is a separate entry.
Questions about this entry
Short answers drawn from the linked project or page.
It is below the 83.3% single-human average the post cites, and only the 97% majority-vote line clears it. It does beat every other decision model tested, including Jeeves 9B at 68% and Laya Multilingual at 53%, so the honest read is best-in-class among classifiers, not good enough to skip human review.
Not repeatable. Jev 1.13.0 and Laya have one run each, the GPT and Claude entries are means of four, Gemini and DeepSeek means of three. So the 79% versus 96.25% gap is real in direction but the narrow spreads between adjacent models should not be read as an ordering.
The site auto-moderates, and the interesting mechanism is rule changes: you open a post arguing for new subreddit rules and Jev decides whether enough people back them. The write-up does not document an appeal path, an escalation tier, or what a user sees when their content is rejected.
The author's own figures: about $15 per 30-day month for 10,000 posts and comments a day. He then extrapolates that rate to the 4.4 billion posts and comments Reddit reported for its year, landing near $18,000 a month, which is his projection rather than a measured or contracted number.
Tom Nick wrote it on 27 September 2026. Jevdit is a prototype social network where Jev moderates content, built around the argument that anonymous posting without moderation quickly fills a site with content no family-friendly blog would print.
The piece argues computers can now understand language well enough to tell whether someone genuinely hates on someone or is only joking, which is what moderation needs. It cites a paper on sarcasm detection in German soccer tweets, and the author reran the test against newer SOTA models and some decision models including Jev.
According to the write-up, SOTA models are now on average better at understanding a joke than a human neighbour. Jev was not as good yet, but clearly outperformed the other decision models on the same irony test.
Reactions & coverage
Posts, threads, and videos about this entry from around the web.
YouTube: Building a contextual brand-safety scorer on Jev from scratch.
X: A website slop detector that checks 35 tells in 243 ms
X: Breaking, golden nugget, or slop
X: A filter for reply-guy comments
More Jev resources like this
Opper hosts Kev 4B and typesafe/jev-latest on the same /v1/systemone compat route and compares accuracy, tokens, and latency on 362 post-release questions.
Jev Guides & ArticlesArticle#community#article#open-models
Community
Datadog's walkthrough of one Jev rubric that scores every criterion in a single request, then runs as online evals on live spans and as offline experiments.
Jev Guides & ArticlesArticle#community#article#evaluation
Community
Sam Reghenzi's product-taxonomy benchmark: a Jev Choice at every level versus a gpt-5.2 agent that descends the tree and can be sent back by a judge.
Jev Guides & ArticlesArticle#community#article#evaluation
Community
Alex Molas argues that a probability fit on TypeSafe's data is not calibrated on yours, so Jev's numbers should be treated as scores.
Jev Guides & ArticlesArticle#community#article#calibration
Community
Privatemode's write-up of typed decisions from GLM-5.3-Flash in one forward pass, with latency, cost, and accuracy set next to Jev and Laya.
Jev Guides & ArticlesArticle#community#article#evaluation
Community
OpenRouter's Banking77 run: 3,080 support utterances, 77 intents, Jev 1.13 against Claude Opus 5 on the same one-line criteria, with latency, cost, and a confidence cascade.
Jev Guides & ArticlesArticle#community#article#evaluation
Community
From the Jev guides
Original write-ups on what this entry is for.
The typed-answer shape removes a category of data risk, not all of it. Zero data retention per surface, the legal set to read, and the controls that remain yours to run.
Jev Guides & Articles#privacy#compliance#legal
Read article
TypeSafe serves Jev from one API. A second tier of independent sites wraps it with their own keys, credits, and playgrounds. How to read the disclaimers before you paste a key.
Jev Guides & Articles#ecosystem#trust#hosting
Read article
The first ten days produced three receptions that rarely meet: a Product Hunt launch, a 620-point Hacker News thread, and a r/LocalLLaMA that doubted the framing. Reading them together.
Jev Guides & Articles#launch#community#reception
Read article
From the Jev community
Posts from builders shipping with Jev right now.