Skip to content

Jev directory

openJev-verdict-2.0

A ModernBERT-based open decision model that evaluates Choice, Score, and Noul schemas in one non-autoregressive pass; Verdict 2.0 reports 77.10% accuracy on 2,000 held-out enterprise decisions.
Stars
295
Language
Python
Reading time
3 min
Published by
Community
Author
Heman10x-NGU
Last verified
Sep 2026

Calibrated 151M Non-Autoregressive Decision Engine beating TypeSafe Jev & Laya on LocalLLaMA/typed-decisions (77.10% acc, 0.0636 Brier, 0.0144 ECE)

Forks
47
Last pushed
Updated Sep 2026

Repo stats from the GitHub API, cached Oct 2026.Homepage

About this project

This repository contains code and references for two distinct models: Verdict (the 151M model evaluated on JevBench): General-purpose decision model based on ModernBERT-base and GLiClass. The public checkpoint is hosted at heman10x/rlcd-modernbert-151m, now updated to v1.4 via inference engine fixes.

Quoted from the project's README. Read the full README.

Highlights

  • Verdict 2.0 uses 149.6M parameters and reports 77.10% accuracy, ahead of Laya's 76.60% and Jev's 72.70% on 2,000 held-out decisions.
  • The 151M Verdict checkpoint is evaluated on 231 public JevBench tasks; inference fixes lifted hard-tier ECE from 0.298 to 0.118.
  • The v1.4 update is inference-only - weights are byte-identical - adding auto-loaded calibrators, NLI-style candidate templating, and a 512-token context budget.
  • Decisions run in roughly 20 to 25 ms and return calibrated confidence; a WebGPU demo tests customer-service, security, and invoice decisions in Chrome or Edge.

Quickstart

python
from transformers import AutoTokenizer

tokenizer = AutoTokenizer.from_pretrained("heman10x/openJev-verdict-2.0")

Watch out

GitHub reports a non-standard license (NOASSERTION) although the README states Apache 2.0. Results are project-local, Verdict 2.0 weights ship as Git LFS pointers, and the project is independent of TypeSafe.

Questions about this entry

Short answers drawn from the linked project or page.

Reactions & coverage

Posts, threads, and videos about this entry from around the web.

X: An open 151M-parameter decision engine

X: Standard One SH (StandardThinking)

LinkedIn: What multimodal decision models actually change, and what they do not.

LinkedInJevDirectory.org

From the Jev guides

Original write-ups on what this entry is for.

From the Jev AI model community

Posts from builders shipping with Jev right now.

Follow @typesafeai