CommunityJev Practices & Patterns
Emo-Jev: Probabilistic Reasoning for Emotion Classification with Jev (arXiv 2610.08829)
A training-free framework with two implementations that turn emotion classification into Jev judgments: one decomposes tasks into atomic judgments, the other aggregates complementary judgment paths. Across eight datasets standard Jev averages 62.93% macro-F1 versus 67.28% for the strongest LLM baseline.
- Format
- Article
- Published by
- Community
- Last verified
- Oct 2026
Highlights
- Emo-Jev-D decomposes classification into task-specific atomic judgments and composes their probabilities.
- Emo-Jev-SC builds multiple judgment paths from complementary perspectives into a consensus decision.
- Evaluated on eight datasets covering sentiment, emotion, sarcasm, and humor detection.
- Standard Jev averages 62.93% macro-F1 versus 67.28% for the strongest LLM baseline.
- Jev shows lower observed latency and generally lower cost than the LLMs compared.
Watch out
arXiv preprint posted September 27, 2026 (cs.CL) by Yazhou Zhang and Junhao Yu. Standard Jev trails the strongest LLM baseline on macro-F1, and the abstract does not state the two Emo-Jev implementations' own scores, so the training-free framing is supported by latency and cost observations rather than a headline accuracy win.
Questions about this entry
Short answers drawn from the linked project or page.
Emo-Jev-D decomposes classification into task-specific atomic judgments and composes their probabilities into a final prediction; Emo-Jev-SC constructs multiple judgment paths from complementary perspectives and aggregates their predictions into a consensus decision.
Jev returns probabilistic decisions given an input and predefined questions; Emo-Jev adds a training-free reasoning layer over those judgments and is evaluated against direct Jev classification.
Eight datasets spanning sentiment analysis, emotion recognition, sarcasm detection, and humor detection.
Direct Jev classification and five state-of-the-art LLMs under input/output and chain-of-thought reasoning.
Standard Jev achieves 62.93% average macro-F1 versus 67.28% for the strongest LLM baseline, while showing lower observed latency and generally lower cost.
No. The abstract reports standard Jev below the strongest LLM baseline on average macro-F1 while noting lower latency and cost, and it does not give the two Emo-Jev implementations' own scores.
Builders who want probabilistic text classification over predefined labels without training, and who weigh latency and cost alongside peak accuracy.
Related terms
Glossary definitions related to this entry.
More Jev resources like this
7GitHub stars
A system that decomposes all three tasks of SemEval-2026 Task III Track A into typed Jev decisions aligned with 488 CPU-fitted coefficients. It reaches 1.0645 RMSE on valence-arousal regression and 52.09/44.06 continuous F1 on extraction, above fine-tuned Llama-3.3-70B and GPT-OSS-120B baselines.
Jev Practices & PatternsArticle#community#research#arxiv
Community
ZhangYiqun018/jev-dimabsaPython
ZhangYiqun018/jev-dimabsaPython4GitHub stars
An analysis of ordinal-scale bias in JEV 1.13 and three open KEV models: across 36 ordinal datasets, final decisions use only 67-76% of the effective gold support versus 87-102% on four nominal tasks. BA-LoRA post-training raises utilization from about 47% to 86%.
Jev Practices & PatternsArticle#community#research#arxiv
Community
Glax147/jev_ordinal_scale_biaPython
Glax147/jev_ordinal_scale_biaPython3GitHub stars
PACT turns contrastive training pairs into four loss terms for single-token typed-decision models. On a frozen 324-item holdout it matches the published recipe's accuracy (84.6% versus 85.2%) while cutting answer flips under relabelling from 13.8% to 9.8%.
Jev Practices & PatternsArticle#community#research#arxiv
A theoretical study of recalibrating many related yes/no questions that each have few labels, motivated by decision models such as Jev. It derives minimax compound-risk rates and shows pooled isotonic fitting with one per-question correction achieves them, while tuning questions separately loses a factor.
Jev Practices & PatternsArticle#community#research#arxiv
Community
JevCascade allocates inference-time compute for prefill-only decision models using readout stability: when only the candidate menu changes, post-intervention accuracy is already determined by the cached first-pass distribution. Menu-only interventions are predicted to within 4.2 points across six model families.
Jev Practices & PatternsArticle#community#research#arxiv
Community
10GitHub stars
An open, local-first alternative to Jev that reproduces the Choice, Score, and Noul interface on commodity zero-shot NLI models with temperature scaling and conformal abstention, and runs offline with no API key.
Jev Practices & Patterns#community#python#calibration
Community
rupeshpoojary9/poorjevPython
rupeshpoojary9/poorjevPythonFrom the Jev guides
Original write-ups on what this entry is for.
More than eighty preprints now evaluate, attack, and reproduce the typed-decision class. The broadest board, the coherence gap, the rejection bottleneck, and the attacks that still work.
Jev Practices & Patterns#research#evaluation#calibration
Read article
TypeSafe publishes evals, but the numbers that matter are the ones measured on your task. A tour of the independent benchmarks, field reports, and the recurring finding that question design dominates.
Jev Practices & Patterns#benchmarks#evaluation#calibration
Read article
A Choice can only pick from its options. How rejection options, candidate coverage, and escalation bands keep a narrow taxonomy honest under inputs it never anticipated.
Jev Practices & Patterns#rejection#confidence#patterns
Read article
From the Jev community
Posts from builders shipping with Jev right now.