Skip to content

Jev directory

Chinese Decision

A Chinese-language decision model that returns a probability for each fixed candidate option in one forward pass, with no generated text or chain of thought. It is a LoRA fine-tune of Qwen3.5-0.8B on 13,048,000 CJ-Dataset rows, benchmarked on CJ-Bench against Chinese-Jev.
Stars
27
Language
Python
License
MIT
Reading time
2 min
Published by
Community
Author
yanqiangmiffy
Last verified
Oct 2026

Highlights

  • One forward pass returns a probability per option from the candidate-letter logits A-Z; no autoregressive generation and no chain of thought.
  • Three question types: noul (yes/no), choice (single choice) and score (ordered levels returning an expected value).
  • README comparison on CJ-Bench: 72.24% general-domain accuracy, above closed Jev at 68.35% and Chinese-Jev General at 69.20%.
  • Calibrated without temperature scaling: overall ECE 1.07% on CJ-Bench, 2.46% average across medical, legal and finance; medical accuracy 88.86%.
  • 0.8B parameters, about 70 ms median per item on one A800 and 6.7 GB peak VRAM; a Q8 GGUF build runs on CPU, and MIT covers the release.

Watch out

README reviewed 2026-10-17; it is in Chinese and the digest truncates the news section mid-sentence, so the training and release story is incomplete. All benchmark numbers — CJ-Bench accuracy, ECE, latency — are the project's own comparisons against Chinese-Jev and closed Jev, not independent evaluations.

Questions about this entry

Short answers drawn from the linked project or page.

From the Jev guides

Original write-ups on what this entry is for.

From the Jev AI model community

Posts from builders shipping with Jev right now.

Follow @typesafeai