Jev directory
CommunityJev Models & Reimplementations
Decision-2.0-Sol-2B
The 2B model in vLLM Semantic Router's Decision 2.0 family: a 1.88B fine-tune of the earlier Decision-1.0-Sol-2B checkpoint with a 16,384-token context, reporting JevArena 52.1 and a 7.2 ms median per request.
- Reading time
- 2 min
- Published by
- Community
- Author
- vLLM Semantic Router
- Last verified
- Oct 2026
- Capabilities
- Open sourceSelf-hostedRuns locally
Highlights
- 1.88B parameters with a 16,384-token context, Apache-2.0, fine-tuned from vllm-sr/Decision-1.0-Sol-2B.
- Card reports JevArena 52.1, top of the four same-size models compared.
- +6.3 JevArena and +4.2 Decision Index over Decision 1.0 Sol; human-labelled transfer 51.3.
- Median 7.2 ms per single-question request on a single GPU, all question types in one forward pass.
- Same-size table: Decider 2B 49.5, This-That 1.2 46.1, Decision 1.0 Sol 45.8, Bosun v3.1 1.7B 42.1.
Quickstart
python
import json
from transformers import AutoModel
model = AutoModel.from_pretrained("vllm-sr/Decision-2.0-Sol-2B", trust_remote_code=True)
result = model.system_one(
state="The order arrived damaged yesterday. The customer has a receipt and asks for a replacement today.",
questions={
"route": {"type": "choice", "instructions": "Which team should handle this request?",
"criteria": {"returns": "Refunds, replacements and damaged deliveries", "billing": "Payments, invoices and charges"}},
"receipt": {"type": "noul", "instructions": "Does the customer have a receipt?"}},
)
print(json.dumps(result["answers"], indent=2))Watch out
Card reviewed 2026-10-17; the scores, the 7.2 ms median and the advantage over Decision 1.0 Sol are the publisher's own reproduction with the official 0.2.1 kit, and competitor rows are a public board snapshot. No GPU is named for the timing.
Questions about this entry
Short answers drawn from the linked project or page.
The 2B model of Decision 2.0 from vLLM Semantic Router, a 1.88B fine-tune of the earlier vllm-sr/Decision-1.0-Sol-2B checkpoint that answers choice, yes/no and score questions and returns probabilities rather than text.
It is a direct fine-tune of that checkpoint and the card reports +6.3 JevArena and +4.2 Jev Decision Index over it; Decision 1.0 Sol scored 45.8 and 25.3 where Decision 2.0 Sol scores 52.1 and 29.5.
JevArena 52.1, top of the four same-size models compared, with human-labelled transfer 51.3 and Jev Decision Index 29.5. All figures are self-reported, with competitor rows from a public board snapshot.
A median of 7.2 ms per single-question request on a single GPU, with choice, yes/no and score questions answered together in one forward pass. The card does not specify the GPU.
1.88B parameters and a 16,384-token context, released under Apache-2.0 and listed with the zero-shot-classification pipeline tag.
Install transformers 5.17 or newer with torch and safetensors, load with AutoModel.from_pretrained('vllm-sr/Decision-2.0-Sol-2B', trust_remote_code=True) and call system_one with a state and questions dictionary.
Decider 2B at 49.5, This-That 1.2 at 46.1, Decision 1.0 Sol at 45.8 and Bosun v3.1 1.7B at 42.1 on JevArena. Those rows are the public board's frozen values from 2026-09-28.
Reactions & coverage
Posts, threads, and videos about this entry from around the web.
Hacker News: ASTGL replay chose local Laya routing over hosted Jev on one Mac Studio setup.
Jmeg8r15 pointsDoes an open-weight decision model beat a hosted one? Jev vs. LayaRead the thread on Hacker NewsReddit: A walkthrough of routing between models with Jev.
X: Standard One SH (StandardThinking)
Facebook: Intake Router keeps diagnosis out of the answer space at the front desk.
FacebookClinicnotes
More Jev resources like this
The 9B entry in vLLM Semantic Router's Decision 2.0 family: a 7.94B decision model with a 16,384-token context that answers choice, yes/no and score questions in one pass, reporting 68.1 JevArena and 18.4 ms median single-question latency.
Jev Models & Reimplementations#community#open-models#local
Community
The 4B model in vLLM Semantic Router's Decision 2.0 family: a 4.21B fine-tune of Qwen3.5-4B-Base that answers choice, yes/no and score questions in one forward pass, with a self-reported JevArena 63.6 and a 12.9 ms median per request.
Jev Models & Reimplementations#community#open-models#local
Community
The 0.6B model in vLLM Semantic Router's Decision 2.0 family: a 0.60B fine-tune of Qwen3-0.6B-Base with an 8,192-token context that returns probabilities for choice, yes/no and score questions from one forward pass.
Jev Models & Reimplementations#community#open-models#local
Community
The 0.8B model in vLLM Semantic Router's Decision 2.0 family: a 0.75B fine-tune of Decision-1.0-Eos-0.8B with a 16,384-token context, reporting JevArena 53.9 and a 6.0 ms median per single-question request.
Jev Models & Reimplementations#community#open-models#local
Community
The vLLM Semantic Router project's 29.37B decision model on Qwen3.8-27B: a probability per supplied option with zero generated tokens, 74.0 on JevArena and 56.5 on Jev Decision Index 0.2.1.
Jev Models & Reimplementations#community#open-models#local
Community
A small distilled sibling of Perplexity's pplx-decider-v1.2: a Qwen3.5-4B decider that reads a state plus typed choice, noul and score questions in one pass, keeping most of the 27B model's Decision Index.
Jev Models & Reimplementations#community#open-models#multimodal
Community
From the Jev guides
Original write-ups on what this entry is for.
From the Jev AI model community
Posts from builders shipping with Jev right now.