What is Foreman and what problem does it solve?

An experimental supervisor where Jev watches a Codex coding worker through the Vercel AI Gateway while a programmer-selected acceptance command checks the result. It is a derivative of thruwire/foreman with the upstream MIT licence retained.

How does Jev supervise the Codex worker?

Jev assessments run through the Vercel AI Gateway adapter for typesafe-ai/jev with validated probabilities, bounded retries, deadlines and sanitized errors. Completion needs Jev's thresholds plus a zero exit code from your acceptance command.

What does FINISHED actually mean?

FINISHED requires a zero exit code from the configured acceptance command on unchanged observed source, plus Jev's completion thresholds. The README warns it does not certify the test suite, correctness or readiness to merge; a worker can weaken tests, so keep CI and human review.

What do I need for a real pilot run?

Git, Python 3.11+, macOS or Linux (Windows via WSL2), an authenticated Codex CLI, and a provisioned Vercel AI Gateway key with credits and Jev access. The README notes check-provider uses a paid synthetic Jev request.

Can I try Foreman without spending money?

Yes: tests and the demo run offline. Clone the repo, create a venv with Python 3.11+, install '.[dev]', run pytest, then foreman demo --repo . . For real runs you copy .env.example to .env and configure your key first.

What is the Azure PR review workflow?

A read-only workflow that collects an immutable diff, accepts a programmer or ChatGPT review draft, and asks Jev to assess its evidence. It creates local reports and does not launch a reviewer, approve, or merge a pull request.

What are the known limits of this release?

The README lists native Windows process control, CC5/browser automation, large Unity asset trees, hermetic builds and reliable dollar-cost accounting as outside this release. It also states no speed or quality improvement over ordinary Codex has been established.

Jev directory

CommunityJev Agents & MCP

Foreman (Shifty Eye Games pilot)

An experimental supervisor where Jev oversees a Codex coding worker through the Vercel AI Gateway: completion requires a zero exit code from the programmer's acceptance command plus Jev's thresholds, on unchanged observed source.

See highlights Open github.com

Stars: 1
Language: Python
License: MIT
Reading time: 2 min
Published by: Community
Author: shifty-eye-games
Last verified: Oct 2026

shifty-eye-games/foreman-jev

Organization repository on GitHub

View on GitHub

Experimental Jev supervisor for Codex workers via Vercel AI Gateway, with deterministic acceptance checks and read-only Azure PR review evidence.

Forks: 0
Last pushed: Updated Sep 2026

Repo stats from the GitHub API, cached Oct 2026.

Tagscommunity catalog-import logicrw codex supervisor vercel-ai-gateway

Works forJev for Decision gating Jev for Verification Jev for Code

Used inJev for Software & DevTools

Languages: Python
Platforms: CLI Vercel AI Gateway
Capabilities: Open sourceRequires API key

Highlights

Mandatory acceptance command: optimistic model scores and a successful Codex exit cannot bypass running the operator's command and recording its exit code.
Vercel AI Gateway adapter for typesafe-ai/jev with validated probabilities, bounded retries, deadlines and sanitized API errors.
Source fingerprints invalidate checks if source changes during verification or before finish; evidence covers staged, unstaged, new and committed changes.
Credential paths and recognizable secrets are filtered from observations and saved state; sanitized snapshots are kept for auditing.
Experimental derivative of thruwire/foreman with the upstream MIT licence retained; the 0.1.1+shifty.3 release passed a fresh macOS install and a real run.

Quickstart

bash

python3.12 -m venv .venv
source .venv/bin/activate
python -m pip install '.[dev]'
foreman demo --repo .

Watch out

Grounded in the truncated README and GitHub metadata reviewed on 2026-10-15; the README is cut off mid command list and states that FINISHED does not certify correctness or readiness to merge, that no speed or quality gain over ordinary Codex is established, and that the pilot targets small repositories.

Questions about this entry

Short answers drawn from the linked project or page.

From the Jev guides

Original write-ups on what this entry is for.

MCP tool routing: Jev in front of the tool call

Oct 16, 2026

Tool menus can outgrow the context that reads them. The catalog's Jev-based routers and gates narrow the list: benchmarked tool search, per-tool scoring, fail-closed approvals, and WebMCP in the browser.

Jev Agents & MCP#mcp#tool-routing#agents

Read article

Approval policies for coding agents: hooks, guards, and gateways