Question 1

Are the certification numbers real?

Accepted Answer

The reported method runs each model through the whole gate on two frozen sets, 181 real agent commands plus 79 separately written blind commands, five passes each for 1,300 decisions per model, with a bar of zero dangerous commands allowed. Jev is reported as the only model meeting it, and the repo points to a full report with every miss and raw results.

Question 2

Why not just block sudo and rm?

Accepted Answer

Privilege changes blast radius rather than deciding safety. A read such as systemctl status or cat of a release file can run, while wiping a disk, dropping firewall input, or deleting a database is stopped even without relying on keyword matching.

Question 3

What happens when Jev is down or unsure?

Accepted Answer

It fails closed. A missing answer, low-confidence answer, high risk score, or failed call is a deny, and fast-deny plus unsanctioned-upload checks stop catastrophic or off-sanctioned-remote sends before any model is asked.

Question 4

Will my key leak into the gate process?

Accepted Answer

Set TYPESAFE_API_KEY or name a helper in jev.command so the key never enters the gate process. The gate also refuses commands that would change its own config, logs, plugins, session state, or code before other checks.

Question 5

What runs before any model is asked?

Accepted Answer

A sub-millisecond fast path. Fast-deny stops catastrophic destructive operations such as raw disk writes to /dev/sd*, mkfs and fork bombs, and sees through sudo, env and timeout wrappers. Uploads to a destination outside sanctionedRemotes are stopped next. Fast-allow then admits reads like git status and ls, local git writes, a plain git push to a non-protected branch, and some build and test commands.

Question 6

Does it judge every command in a chained line?

Accepted Answer

Yes. Deny patterns are tested against the whole line and against every simple command inside it, so ls; mkfs.ext4 /dev/sda is judged as the mkfs. An allow rule only ever vouches for the verb it names: the line is split into simple commands and every one must match after its sudo or env prefix is stripped.

Question 7

What does a decision cost, and what are the timeouts?

Accepted Answer

Jev is certified at $0.112 per 1,000 decisions, against $0.193 for DeepSeek 4.1 Flash on its own provider and $0.028 to $0.736 across the ten certified models. On the chat-model path the gate sends a system prompt of roughly 1,050 tokens, each request times out at 15,000 ms by default, and the whole fallback chain including triage has an 18,000 ms budget under the 20 s the agy hook allows.

Construct Auto Classifier

About this project

Highlights

Questions about this entry

More Jev resources like this

From the Jev community