Skip to content

Nitro

Grok Build wrapper that asks Jev one noul per tool before the first model call of a turn, then holds the shortened tool list so the prompt cache survives.

Stars
5
Language
Rust
Published by
Community
Author
daniel-farina
Last verified
Oct 2026

daniel-farina/nitro

User repository on GitHub

View on GitHub

Grok Build with TypeSafe Jev routing tool selection once per turn: 22 to 40% cheaper on the same tasks

Forks
1
Last pushed
Updated Sep 2026

Repo stats from the GitHub API, cached Oct 2026.

About this project

Grok Build with TypeSafe Jev in front of tool selection. The command is nitro. Once per turn, before the first model call, Nitro asks Jev one question per tool: "will finishing this request need this tool at any step?" All the questions go in one request and come back in about 350 ms. The tools Jev says no to are left out of the chat model's request, and that shorter list is held for every step of the turn. The chat model still writes every command, path, and patch. Jev only decides which tools are in play.

Quoted from the project's README. Read the full README.

Highlights

  • Keeps 8 of 25 tools on a coding task, cutting schemas from about 11K tokens to about 2.9K every request.
  • Adds about 350 ms once per turn with a 0.30 keep threshold; core workspace primitives always stay.
  • Re-applies the same keep-set on later steps without new calls, after a per-step version proved costlier.
  • Leaves the full list on failed calls, timeouts, or missing answers, and never forces tool_choice.

Watch out

Two runs per cell is a small sample, not a distribution; Jev picks tools only and the chat model still writes every command, path, and patch. Copy reviewed against the repository README on 2026-10-04, not from running it.

Questions about this entry

Short answers drawn from the linked project or page.

More Jev resources like this

35GitHub stars
Rust terminal tool that asks Jev noul, choice and score questions about piped text or files and returns calibrated probabilities with stable exit codes for shell scripts, CI jobs and agents.
Jev Agents & MCP#community#jevbest#catalog-import
25GitHub stars
Agent-oriented playbook for using Jev as a cheap, fast decision layer that triages, classifies, scores, and gates work before expensive browser, research, retry, or subagent steps.
Jev Agents & MCP#community#awesomejev#catalog-import
14GitHub stars
Opt-in Hermes plugin that routes each turn to one skill: a wide Jev Choice plus request checks gate a narrow fits round, injecting a single ignorable hint line.
Jev Agents & MCP#community#jevbest#catalog-import
6GitHub stars
Terminal coding agent on Pi where Jev shortlists skills, ranks retrieved excerpts, and triages tool failures while the coding model handles reasoning and edits.
Jev Agents & MCP#community#awesomejev#catalog-import
5GitHub stars
CLI that routes a task to one specialist skill from a Tink library using TypeSafe Jev, verifies the winner with tink mount, then prints it inline or as a mounted path.
Jev Agents & MCP#community#awesomejev#catalog-import
LangChain deepagents middleware that replaces SkillsMiddleware with per-turn judging, loading only the SKILL.md files a turn needs so large catalogs stay out of the prompt.
Jev Agents & MCP#community#jevbest#catalog-import
Back to all resources

From the Jev community

Posts from builders shipping with Jev right now.

Follow @typesafeai