Jev directory
CommunityJev Demos & Experiments
Jev Evidence Triage
A Python demo that screens PubMed abstracts for one systematic review question using Jev. Six narrow questions per abstract go to Jev in a single call, with rule-based tiers and confidence gates deciding include, exclude, or human review.
- Stars
- 0
- Reading time
- 2 min
- Published by
- Community
- Added
- Nov 2026
Highlights
- Screens PubMed abstracts for one review question on FMT or live bacterial products and checkpoint inhibitor outcomes in cancer.
- Sends six narrow Jev questions per abstract in a single call.
- Three tiers: rules in code, then Jev, then confidence gates in code.
- Ships 24 fictional sample abstracts (SYN-0001 to SYN-0024) with planted traps and human gold labels.
- 39 offline tests pass on Python 3.10.22 and 3.12.3 against typesafe-sdk 0.7.4.
Questions about this entry
Short answers drawn from the linked project or page.
Create a virtualenv, install requirements, then run python -m jev_triage triage --mock --out out/mock. Mock answers come from a keyword stub tuned to the sample, not from Jev.
A TYPESAFE_API_KEY environment variable, set per RUNBOOK.md step 2. Then run python -m jev_triage check --model jev-1.13.0, followed by the triage and evaluate commands.
Six narrow questions per abstract, all sent in a single Jev call. The questions and thresholds live in jev_triage/protocol.py, the only file to edit for a new review.
The report module writes triage.jsonl, CSV queues, and summary.md. The evaluate command adds scoring against labels, a threshold sweep, reliability bins, and an option-order check.
Live runs search and fetch from PubMed through NCBI E-utilities. The bundled sample is 24 fictional abstracts written for the demo, with human labels in data/gold_labels.csv.
No. The optional pre-read only feeds the human review queue and never decides. Every decision lives in the Tier 0 rules and Tier 2 gates in jev_triage/route.py.
No. The mock answers come from a keyword stub tuned to the sample, so they say nothing about Jev's behavior. Use a live run with a key to see real Jev output.
From the Jev guides
Original write-ups on what this entry is for.
From the Jev AI model community
Posts from builders shipping with Jev right now.