CommunityJev Tools & CLIs
JevVibe: Efficient Classification-Guided Secure Code Generation (arXiv 2609.34963)
A diagnosis-guided repair agent whose CWE classification comes from Jev. Jev beats six open-weight models on every classification and ranking metric and runs at 6.27x lower median latency than GPT-5.6-Sol; with Jev diagnosing, repair lifts the detector-measured security pass rate from 63.5% to 70.7%.
- Format
- Article
- Published by
- Community
- Last verified
- Oct 2026
Highlights
- Classifies 1,916 CyberSecEval examples over a controlled 50-way CWE classification task.
- Jev outperforms all six open-weight baselines on every classification and ranking metric.
- Versus GPT-5.6-Sol, Jev leads Top-3 and Top-5 accuracy and a nearly identical MRR at 6.27x lower median latency.
- Estimated API cost is 55.9x lower than GPT-5.6-Sol.
- Repair guided by Jev raises the security pass rate from 63.5% to 70.7%, versus 66.1% for LLM-guided repair.
Watch out
arXiv preprint posted September 28, 2026 (cs.CR, cs.AI) by Arshak Rezvani, Sasha Behrouzi, and Ahmad-Reza Sadeghi. The comparison with GPT-5.6-Sol depends on the metric, since GPT-5.6-Sol still leads Top-1 accuracy and Macro-F1, and the repair results apply to code generated by Qwen2.5-Coder-32B-Instruct.
Questions about this entry
Short answers drawn from the linked project or page.
A controlled 50-way Common Weakness Enumeration classification task over 1,916 CyberSecEval benchmark examples, feeding a diagnosis-guided repair agent.
Asking an autoregressive model to generate a CWE label and extracting it from the response raises questions about output validity, speed, cost, and accuracy; Jev selects directly from a declared candidate set and returns a probability for each.
Jev outperforms all six open-weight autoregressive baselines on every classification and ranking metric.
GPT-5.6-Sol achieves higher Top-1 accuracy and Macro-F1, while Jev achieves higher Top-3 and Top-5 accuracy and a nearly identical MRR at 6.27x lower median API latency and 55.9x lower estimated API cost.
With Jev providing the diagnosis, the agent increases the detector-measured security pass rate from 63.5% before repair to 70.7%, compared with 66.1% for LLM-guided repair.
Code generated by Qwen2.5-Coder-32B-Instruct.
That JevVibe is effective at improving the security of generated code, with Jev providing reliable and efficient CWE classification.
Reactions & coverage
Posts, threads, and videos about this entry from around the web.
YouTube: Kubernetes admission control with a decision model, fail-closed.
Hacker News: SafeDep Gryph plus Jev checks for compromised coding-agent behavior.
2 pointsDetecting Compromised AI Coding Agents with Jev and GryphRead the thread on Hacker NewsHacker News: Show HN: Agent Chaperone screens tool calls and results with Jev before the agent sees them.
sepehrsafari5 pointsShow HN: Agent Chaperone – Screen AI agent tool calls and results with JevRead the thread on Hacker NewsX: Secret detection with Jev, tested
More Jev resources like this
JEV-IDS is an open experimental network intrusion detector that serializes one flow per request and asks Jev for a binary attack probability and a finite-choice traffic category. On a 300-flow NSL-KDD pilot it reports F1 0.859 and novel-attack recall 0.838.
Jev Tools & CLIsArticle#community#research#arxiv
Community
COGNIT-Guard is a safety guardrail that pairs a calibration-tuned CPU gatekeeper with confidence-gated escalation to an NPU-resident 322M direct-decision model, Laya-322M. It reports 98.85% accuracy and 0.42% benign false-positive rate on DUCS-Bench, with experience replay recovering out-of-distribution accuracy.
Jev Tools & CLIsArticle#community#research#arxiv
Community
169GitHub stars
Pi extension that supervises a coding agent with Jev judgments: it holds risky tool calls, checks writes against project Markdown rules, and feeds most issues back to the agent as a steer instead of interrupting you. The conscience is beta and off by default.
Jev Tools & CLIs#community#typescript#guardrails
Community
DevMortimer/pi-wardenTypeScript
DevMortimer/pi-wardenTypeScript67GitHub stars
A security hook for coding agents that asks Jev three typed questions before every tool call and scans tool results for prompt injection, with adapters for Claude Code, Codex, Copilot CLI, Gemini CLI, Cursor, pi, OpenCode and ACP.
Jev Tools & CLIs#community#javascript#agents
Community
leepokai/jev-guardJavaScript
leepokai/jev-guardJavaScriptAn empirical comparison of Jev as a typed judge for retrospective agent-trace security against four generative judges on 5,219 trajectories. Jev averages positive-class F1 77.8 versus 74.1 for GLM-5.2, leading on two of four benchmark collections.
Jev Benchmarks & EvaluationsArticle#community#research#arxiv
Community
A position and case-study paper on using System One decision models like Jev and the open-source Laya as decision layers in LLM-driven penetration-testing harnesses. It names four decision points, runs an exploratory 13-vulnerability NeuroSploit comparison, and proposes Rave, an unevaluated model.
Jev Practices & PatternsArticle#community#research#arxiv
Community
From the Jev guides
Original write-ups on what this entry is for.
The request shape barely changes across surfaces; the surrounding contract does. When to call the API directly and when a gateway, a Worker binding, or a router entry earns its extra hop.
Jev Tools & CLIs#gateway#vercel#cloudflare
Read article
Taking a decision checkpoint out of Python: what the GGUF and browser WebGPU exports preserve, what they change, and the parity evidence the model cards publish.
Jev Tools & CLIs#open-models#local#onnx
Read article
Jev labels a record that already exists. Code moves, flags, or holds it. How the document, mail, and transfer tools keep the action out of the model.
Jev Tools & CLIs#classification#email#security
Read article
From the Jev community
Posts from builders shipping with Jev right now.