Skip to content
JevDirectory.org
Evaluation & TrainingCounting

Unreliable counting

Jev does not count reliably — characters, occurrences, or list items — and error grows with the size of the thing counted.

Category
Evaluation & Training
Also known as
Counting
Related terms
4
Directory entries
1
Docs
docs.typesafe.ai
Added
2026-09-24

Definition

The model recognizes the shape of an answer rather than tallying. Before asking a counting question, the docs suggest asking why a model is needed at all: if a regex or parser can find the unit, the count belongs in code.

When the count does need judgment, iterate in code over candidates, ask one Noul per item, and sum the answers yourself — the pattern the jaggedness page demonstrates with a fruit-name count.

Tagslimitationsdesign

From the directory

A maintained list of jev-1.13's known failure modes, literal reading, unreliable counting, dates as text, indirection, context rot, and contradictory criteria, each with a guardrail.
Practices & PatternsDocs#official#docs#evaluation
Official

From the community

Posts from builders shipping with Jev right now.

Follow @typesafeai

A job crawler that reads careers pages with Jev

700 live ads in 40 seconds

1,891 ads in 19 seconds

ESTA HERRAMIENTA ACABA DE ROMPER TODO EL MERCADO DEL AD SPY Maxfusion ha cogido JEV, el modelo nuevo de TypeSafe, y le ha metido la ad library entera de una marca → 1.891 anuncios clasificados → 19 segundos → 0,12 $ Y no es un resumen: cada anuncio etiquetado por etapa del Show more

Ori Silver
Ori Silver
@OriSilver

JEV makes competitor research feel like a cheat code We fed it Resilia’s ad library and it classified 1,891 ads in 19 seconds for $0.12 Customer journey stage, ad style, and a full account deep dive Coming soon to the maxfusion MCP

Reply

Game levels generated in real time

900 images in 40 seconds

Intent-based search in Gmail

Jev is really good at intent-based search! How it looks in Gmail: (for a huge inbox you'd prob let semantic search / embeddings pull first but still much better experience)

nader dabit
nader dabit
Cognition
@dabit3

Another crazy @typesafeai Jev example: Predictive spreadsheets Spreadsheets recalculate numbers, not meaning. Jev reads intent. Type "Urgency" at the top of a column and, as you type, it figures out you want each row rated from "no follow-up needed" to "urgent" in ~100 ms.

Reply