Skip to content

Jev directory

Jev History Corpus: Post-Cutoff Knowledge Canary

A synthetic question-answer corpus about the Jev family of decision models, published as a diagnostic for fine-tuning pipelines. Version 1.0 ships 10,389 training pairs and 265 held-out evaluation questions drawn from 58 source units, so a training run can be scored before and after.
Reading time
3 min
Published by
Community
Added
Nov 2026

Highlights

  • Version 1.0 contains 10,389 training pairs and 265 held-out evaluation questions from 58 source units.
  • Built from 2,616 extracted fact records; every training fact is covered by at least one pair.
  • Question types include numbers, comparison, definition, limitation, mechanism, recipe, why, timeline, and unknown.
  • Released under apache-2.0 with train, meta, and eval subsets loadable through load_dataset.
  • Subject matter postdates September 2026, so a model with an earlier pretraining cutoff should score near zero before training.

Questions about this entry

Short answers drawn from the linked project or page.

From the Jev guides

Original write-ups on what this entry is for.

From the Jev AI model community

Posts from builders shipping with Jev right now.

Follow @typesafeai