Skip to content

Jev directory

AI CLI

Vercel Labs' terminal CLI for the AI SDK: its `ai evaluate` command answers named Boolean, Choice, and Score questions, with Jev as the default evaluation model and one unchanged input shared across all questions.
Stars
825
Language
TypeScript
Reading time
3 min
Published by
Community
Author
vercel-labs
Last verified
Sep 2026

About this project

Create text, images, video, and audio, and make typed decisions with composable commands, stdin support, and predictable outputs. Built with the Vercel AI SDK and AI Gateway for access to hundreds of models. Requires Node.js 22+ and an AI Gateway API key or a provider-specific key (e.g. OPENAIAPIKEY).

Quoted from the project's README. Read the full README.

Highlights

  • `ai evaluate` takes repeatable --boolean, --choice, and --score flags or a named question map in JSON; Jev is the default evaluation model.
  • Stdin maps to the SDK's state and typed flags build the named questions; with --json, stdout carries only metadata.
  • Boolean returns P(true) from 0 to 1, Choice returns one supplied option plus its distribution, and Score uses Jev's probability-weighted mean.
  • Requires Node.js 22+ and an AI Gateway API key or a provider key; evaluate requests time out after 30 seconds by default.
  • The same binary generates text, images, video, and audio, supports piping between commands, and exits 2 on partial generation failure.

Quickstart

bash
npm install -g ai-cli
cat ticket.txt | ai evaluate \
  --boolean "refund=Refund requested?" \
  --choice "team=Which team?" \
  --choices "team=billing,support" \
  --score "tone=How positive?" \
  --levels "tone=angry,neutral,happy"

Watch out

The README states Apache-2.0 though the digest lists no license file; it needs Node.js 22+ and a Vercel AI Gateway key (or a provider-specific key), and question limits are enforced by the SDK and provider.

Questions about this entry

Short answers drawn from the linked project or page.

Reactions & coverage

Posts, threads, and videos about this entry from around the web.

X: Jev lands on the Vercel AI Gateway

X: Vercel ships the AI SDK provider for Jev

YouTube: Greg Isenberg and Ryan Vogel on the businesses Jev unlocks, and a path in through the Vercel AI Gateway.

From the Jev guides

Original write-ups on what this entry is for.

From the Jev AI model community

Posts from builders shipping with Jev right now.

Follow @typesafeai