Article
CommunityJev Practices & Patterns
Jev-Guided Strategy Bandit: Multi-Dimensional Judge Feedback for Query-Efficient Jailbreak Attacks (arXiv 2610.19971)
A jailbreak framework that uses multi-dimensional probabilistic judge feedback to guide prompt optimization: 89.8% average HarmBench attack success across ten open-source settings under a 10-query budget.
- Format
- Article
- Reading time
- 2 min
- Published by
- Community
- Last verified
- Oct 2026
Highlights
- The Jev-Guided Strategy Bandit combines continuous jailbreak scoring with targeted refinement, strategy switching, and best-state reseeding.
- Under a budget of only 10 target-model queries it averages an 89.8% HarmBench attack success rate across ten open-source settings.
- Evaluated on two harmful-request datasets across five open-source and three closed-source LLMs.
- Defense experiments reveal limitations in existing filtering mechanisms and highlight the potential of Jev-based output filtering.
Watch out
An arXiv preprint marked under review (cs.CR), posted October 14, 2026. The title and defense analysis reference Jev while the abstract describes multi-dimensional probabilistic feedback, so how much of the loop uses the hosted model is not spelled out. Attack success is benchmark-specific and varies with query budgets and attacker models.
Questions about this entry
Short answers drawn from the linked project or page.
A query-based jailbreak framework that uses multi-dimensional probabilistic feedback to guide adversarial prompt optimization, combining continuous jailbreak scoring with targeted refinement, strategy switching, and best-state reseeding.
Under a budget of only 10 target-model queries, JSB averages an 89.8% HarmBench attack success rate across ten open-source settings, consistently outperforming existing automated jailbreak attacks, per the abstract.
Two harmful-request datasets across five open-source and three closed-source LLMs, with additional analyses under varying query budgets and attacker models. HarmBench supplies the success metric.
The framework's name and its defense analysis both reference Jev, but the abstract describes the feedback only as multi-dimensional probabilistic, without stating which implementation answered the judge calls. Read it as Jev-style feedback until the paper details the setup.
That existing filtering mechanisms have limitations against this attack style, and that Jev-based output filtering is a promising direction. The abstract gives no numbers for the defense side.
It is the adversarial counterpart to judge-based safety: when the judge's probabilities leak into an attacker's optimization loop, a small query budget can be enough. Treat judge scores as observable signal and budget-rate-limit adversarial traffic.
Not yet. The arXiv listing is marked under review (cs.CR), posted October 14, 2026, so treat the attack-success figure as a self-reported preprint result until publication.
Reactions & coverage
Posts, threads, and videos about this entry from around the web.
YouTube: Kubernetes admission control with a decision model, fail-closed.
Hacker News: SafeDep Gryph plus Jev checks for compromised coding-agent behavior.
2 pointsDetecting Compromised AI Coding Agents with Jev and GryphRead the thread on Hacker NewsX: Jev and Laya on security queries
X: Testing Jev for prompt injection
More Jev resources like this
JevOut shows short background context additions can flip correct decisions in four systems including Jev across seven datasets. Within 64 accepted evaluations per decision, additions redirect 61.4%-73.2% of initially correct decisions toward a wrong option fixed in advance.
Jev Practices & PatternsArticle#community#research#arxiv
Community
xzx34/JevOutPython
xzx34/JevOutPython0GitHub stars
A systematic study of Jev's security and privacy implications using the official API and NanoJev, a local model with controllable training data. It adapts prompt injection, adversarial suffixes, and poisoned training data, runs inference attacks against typed outputs, and maps dual uses.
Jev Practices & PatternsArticle#community#research#arxiv
Community
shihe98/Security_Privacy_JevPython
shihe98/Security_Privacy_JevPythonA position and case-study paper on using System One decision models like Jev and the open-source Laya as decision layers in LLM-driven penetration-testing harnesses. It names four decision points, runs an exploratory 13-vulnerability NeuroSploit comparison, and proposes Rave, an unevaluated model.
Jev Practices & PatternsArticle#community#research#arxiv
Community
An evaluation of prompt injection against Jev's typed probabilistic decisions using 510 reconstructed InjecAgent cases. Malicious content shifts action probabilities but rarely flips Jev to the attacker's target; score-feedback attacks raise fresh-run success from 1.8% to 3.5%.
Jev Practices & PatternsArticle#community#research#arxiv
Community
Blind security benchmarks for Jev on public corpora: 662 prompt-injection messages and 200 matched vulnerable-code pairs, with raw per-sample results and a TUI dashboard.
Jev Practices & Patterns#community#go#benchmarks
Community
Gaurav-Gosain/jev-sec-benchGo
Gaurav-Gosain/jev-sec-benchGo3GitHub stars
An automated framework that traces adversarial context through Jev-backed program decisions to downstream effects. Across 228 real-world Jev applications and 2,273 test cases, 81.5% show decision flips, 98.6% with potential security impact, and Decision Flip Rate beats the strongest baseline by 50.4 points.
Jev Benchmarks & EvaluationsArticle#community#research#arxiv
Community
xiaoxiaohg8d/JevProbe-Python
xiaoxiaohg8d/JevProbe-PythonFrom the Jev guides
Original write-ups on what this entry is for.
From the Jev AI model community
Posts from builders shipping with Jev right now.