Skip to content

Omo Jevlike Router

A Jev-style one-pass skill router for OmO agents: a frozen Qwen2.5-0.5B with a tiny option-attention head scores the whole skill catalog per prompt, and an extension shrinks the system prompt to the top-K skills, failing open.

Stars
3
Language
Python
License
MIT
Published by
Community
Last verified
Oct 2026

islee23520/omo-jevlike-routerArchived

User repository on GitHub

View on GitHub

Jev-style one-pass skill router for OmO: shrink the skill catalog in your system prompt with one forward pass (frozen Qwen2.5-0.5B + jevlike head, fail-open extension)

Forks
0
Last pushed
Updated Sep 2026

Repo stats from the GitHub API, cached Oct 2026.

About this project

A Jev-style one-pass skill router for OmO. On every agent start, a small local model (frozen Qwen2.5-0.5B + a tiny option-attention head, jevlike) scores your entire skill catalog against the user's prompt in a single forward pass. An OmO extension then shrinks the block of the system prompt to the top-K skills before your expensive main model sees it. Smaller prompts, fewer wasted skill reads, sub-100 ms routing on a warm cache — and fail-open: if the router is unreachable, OmO behaves exactly as before.

Quoted from the project's README. Read the full README.

Languages
Python
Platforms
API
Capabilities
Open sourceSelf-hostedRuns locally

Highlights

  • On a held-out test of 132 turns: top-1 27.3%, recall@24 84.1%, versus recall@12 74.2% and recall@32 90.2%.
  • Warm routing latency is roughly 50-70 ms; the first full-catalog call takes about 9 s for cache warm-up.
  • The README documents an earlier evaluation bug and the corrected numbers reported by the fixed evaluator.
  • Scores arbitrary option lists via POST /score {context, options}; the OmO extension rewrites only the available_skills block.

Watch out

The repository is archived, so it is no longer maintained; routing quality is bounded by the session data you extract. MIT licensed.

Questions about this entry

Short answers drawn from the linked project or page.

Reactions & coverage

Posts, threads, and videos about this entry from around the web.

Facebook: Intake Router keeps diagnosis out of the answer space at the front desk.

FacebookClinicnotes

YouTube: Jev explained for routing and judging, with a comparison against LLMs.

Hacker News: Vercel on using Jev for defined decisions and GPT-6 Astra when the job also has to write or use tools.

flashbrew4 pointsTypeSafe AI Jev vs. GPT-6 AstraRead the thread on Hacker News

Hacker News: ASTGL replay chose local Laya routing over hosted Jev on one Mac Studio setup.

Jmeg8r15 pointsDoes an open-weight decision model beat a hosted one? Jev vs. LayaRead the thread on Hacker News

Related terms

Glossary definitions related to this entry.

More Jev resources like this

1.9kGitHub stars
A Go-based team workspace with optional Jev AI for agent auto-routing, task auto-fill, auto-assign, and automation condition nodes.
Jev Tools & CLIs#community#go#agents
130GitHub stars
An open recipe for a 27B multimodal decision model trained with full-weight SFT on 73,000 examples over one H200, serving choice, noul and score on /v1/systemone with per-checkpoint provenance and released calibration plots.
Jev Models & Reimplementations#community#calibration#qwen
4GitHub stars
CLI and Python library that runs declarative YAML judgment tasks - classify, route, score, verify - natively on Jev Choice/Score/Noul, on any OpenAI-compatible backend, or on local keyword rules, with confidence gates, fallbacks and per-decision cost records.
Jev Tools & CLIs#community#yaml#classification
3GitHub stars
A training-free runtime that turns dense Qwen3 or Qwen3.5 checkpoints into a Jev-style Noul, Choice and Score service, sharing one state prefill across isolated questions and reading each answer from candidate-token logits.
Jev Models & Reimplementations#community#qwen#local-inference
The vLLM Semantic Router project's 29.37B decision model on Qwen3.8-27B: a probability per supplied option with zero generated tokens, 74.0 on JevArena and 56.5 on Jev Decision Index 0.2.1.
Jev Models & Reimplementations#community#open-models#local
Community
33kGitHub stars
Alibaba's multi-agent platform, which implements native TypeSafe Jev classification through JevClassifierModel for binary, choice and score routing across agent pipelines. Python 3.11+, Apache-2.0, with a FastAPI agent service and web UI.
Jev Integrations & Adapters#community#multi-agent#framework

From the Jev guides

Original write-ups on what this entry is for.

The request shape barely changes across surfaces; the surrounding contract does. When to call the API directly and when a gateway, a Worker binding, or a router entry earns its extra hop.
Jev Tools & CLIs#gateway#vercel#cloudflare
Read article
Taking a decision checkpoint out of Python: what the GGUF and browser WebGPU exports preserve, what they change, and the parity evidence the model cards publish.
Jev Tools & CLIs#open-models#local#onnx
Read article
Jev labels a record that already exists. Code moves, flags, or holds it. How the document, mail, and transfer tools keep the action out of the model.
Jev Tools & CLIs#classification#email#security
Read article
Back to all resources

From the Jev community

Posts from builders shipping with Jev right now.

Follow @typesafeai