CommunityJev Tools & CLIs
Replacing Large Language Models with Jev Decision Models for Low-Latency Edge Service Orchestration (arXiv 2609.22753)
An integration of Jev's decision API into edge service orchestration that extracts four to eight bounded intent fields per request. Across 33 test conditions Jev cuts median decision latency by 22.7-64.5% versus the fastest LLM, and on a live admission path it keeps 0.91-0.95 of requests exact and on time.
- Format
- Article
- Published by
- Community
- Last verified
- Oct 2026
Highlights
- Integrates Jev's decision-oriented API into edge service orchestration to cut request overhead.
- Extracts four to eight bounded intent fields per request with a shared validator, admission policy, and scheduler.
- Across 33 test conditions Jev reduces median decision latency by 22.7-64.5% relative to the fastest LLM.
- On four-field contracts Jev's API fees per correct decision are 59.7-80.9% lower, at a cost of a few exact-match points.
- On the live admission path Jev keeps 0.91-0.95 of requests exact and on time at loads where the LLMs fall below 0.1.
Watch out
arXiv preprint posted September 19, 2026 and updated September 26, 2026 (cs.DC, cs.NI) by Delong Li and co-authors; 20 pages. The measured workload is 8,280 verified requests with modeled execution plus one real OCR service, wide contracts mark the limit of the substitution, and caching repeated descriptions gives the interpreters nearly the same latency.
Questions about this entry
Short answers drawn from the linked project or page.
Natural-language service requests can require a language-model decision before execution starts, consuming part of the request's latency budget; the integration aims to reduce that overhead while retaining service completion.
The integration extracts four to eight bounded intent fields and applies a shared validator, admission policy, and scheduler, accounting for decision waiting throughout the request timeline.
Jev, two self-hosted decision models, and three hosted LLMs on 8,280 verified requests and on a live admission path with modeled execution and a real optical character recognition service.
Across 33 test conditions Jev reduces median decision latency by 22.7-64.5% relative to the fastest LLM, and this latency barely moves with input size, contract width, or catalog size.
On four-field contracts Jev's API fees per correct decision are 59.7-80.9% lower at a cost of a few exact-match points, while wide contracts mark the limit of the substitution.
Receiving the service catalog with each request, Jev names unseen services as accurately as known ones.
Jev keeps 0.91-0.95 of requests exact and on time at loads where the LLMs fall below 0.1, and since caching repeated descriptions gives the interpreters nearly the same latency, Jev's gain lies in fresh decisions.
More Jev resources like this
A semantic database system that answers filters, joins, classification, and ranking with fast typed decision models and escalates uncertain cases to LLMs. JEVDB-Flash posts the lowest latency on all 21 SemBench queries, and Semantic Bloom Filters remove 87.4% of join candidates on Shelob.
Jev Tools & CLIsArticle#community#research#arxiv
Community
A comparison of Jev-1.13.0 and two other decision models with LLMs for intent interpretation in 6G Open RAN. Jev meets the 1 s near-real-time budget on 99.8% of calls while two hosted LLMs meet it on 17.9% and 0%, with median interpretation taking 0.286 to 2.35 s.
Jev Benchmarks & EvaluationsArticle#community#research#arxiv
Community
Jev-Mem is an agentic memory architecture that gives a System-One control plane charge of memory typing, query routing, retrieval budgets, graph traversal, candidate scoring, and adaptive stopping, invoking System Two only for complex reasoning and synthesis. On LoCoMo it scores 0.777.
Jev Tools & CLIsArticle#community#research#arxiv
Community
JEV-IDS is an open experimental network intrusion detector that serializes one flow per request and asks Jev for a binary attack probability and a finite-choice traffic category. On a 300-flow NSL-KDD pilot it reports F1 0.859 and novel-attack recall 0.838.
Jev Tools & CLIsArticle#community#research#arxiv
Community
COGNIT-Guard is a safety guardrail that pairs a calibration-tuned CPU gatekeeper with confidence-gated escalation to an NPU-resident 322M direct-decision model, Laya-322M. It reports 98.85% accuracy and 0.42% benign false-positive rate on DUCS-Bench, with experience replay recovering out-of-distribution accuracy.
Jev Tools & CLIsArticle#community#research#arxiv
Community
JevSoup is a training-free framework that separates System One expert routing from System Two execution: Jev picks two LoRA experts through structured probabilities and their updates are merged with orthogonal projection. Across 14 PorTAL tasks it gains up to 1.19% task-macro accuracy over external baselines.
Jev Tools & CLIsArticle#community#research#arxiv
Community
Leowang980/JevSoupPython
Leowang980/JevSoupPythonFrom the Jev guides
Original write-ups on what this entry is for.
The request shape barely changes across surfaces; the surrounding contract does. When to call the API directly and when a gateway, a Worker binding, or a router entry earns its extra hop.
Jev Tools & CLIs#gateway#vercel#cloudflare
Read article
Taking a decision checkpoint out of Python: what the GGUF and browser WebGPU exports preserve, what they change, and the parity evidence the model cards publish.
Jev Tools & CLIs#open-models#local#onnx
Read article
Jev labels a record that already exists. Code moves, flags, or holds it. How the document, mail, and transfer tools keep the action out of the model.
Jev Tools & CLIs#classification#email#security
Read article
From the Jev community
Posts from builders shipping with Jev right now.