Organization repository on GitHub
AI SDK for Python
- Forks
- 25
- Last pushed
- Updated Oct 2026
Repo stats from the GitHub API, cached Oct 2026.Homepage
CommunityJev Repos & SDKs
AI SDK for Python
Vercel's official AI SDK for Python, in public beta: streaming models, agent tool loops, hooks for human approval and structured output, with provider IDs routing through AI Gateway by default. The SDK's evaluation operation and Gateway examples carry Jev as a decision and evaluation provider.
- Stars
- 192
- Language
- Python
- Published by
- Community
- Last verified
- Oct 2026
About this project
A toolkit for building LLM-powered applications and agent loops. AI Gateway API-key usage works with the base package. Direct providers that use an OpenAI-compatible or Anthropic-compatible adapter load the corresponding official SDK lazily. Vercel OIDC for AI Gateway also uses an optional extra: The models module provides thin wrappers around LLM provider APIs. An ai.Model is a config object you pass to ai.stream to get an LLM reply. It accepts tool schemas but does not execute custom tools.
Quoted from the project's README. Read the full README.
Works forJev for Evaluation
Used inJev for Software & DevTools
- Languages
- Python
- Platforms
- Vercel AI Gateway
- Capabilities
- Open source
Highlights
- Ships an Agent class with streaming tool execution, approval hooks and Pydantic structured output.
- Provider IDs without a prefix route through Vercel AI Gateway; direct adapters load via extras.
- Example apps cover web agents with tool approval, coding agents, Temporal/Workflows durable agents and Slack.
- Install with uv add ai plus optional ai[openai], ai[anthropic] or ai[vercel] extras.
Watch out
GitHub reports the license as NOASSERTION, so no SPDX id could be verified. The SDK is in public beta, and Jev support lives in its evaluation operation and Gateway examples rather than a separately bundled TypeSafe dependency.
Questions about this entry
Short answers drawn from the linked project or page.
The official Vercel AI SDK for Python carries Jev through its evaluation operation and AI Gateway examples. Jev is reachable through the Gateway's provider routing, so no separate TypeSafe adapter package is required for those paths.
No, the README marks it as public beta. The core surface already covers models, agents, tools, hooks and structured output, with end-to-end example apps for web agents, coding agents, durable Temporal workflows and Slack agents.
Run uv add ai for the base package, which works with an AI Gateway API key. Add optional extras ai[openai], ai[anthropic], or ai[vercel] for direct providers or Vercel OIDC.
Provider IDs without a provider: prefix route through Vercel AI Gateway by default. Direct OpenAI-compatible or Anthropic-compatible providers require the matching extra to be installed.
Pass a Pydantic model as output_type to ai.stream, then read the parsed object from stream.output. The example defines an UprisingPlan model with phases, eta, and risk_level fields.
An agent can pause with ai.hook, passing a payload schema and metadata, and resume later with ai.resolve_hook once the external input arrives, such as an email send approval.
End-to-end demos under examples/apps: a FastAPI plus React web agent with tool approval, a coding agent, durable agents with Temporal and Workflows, and a Slack agent.
Reactions & coverage
Posts, threads, and videos about this entry from around the web.
X: Jev lands on the Vercel AI Gateway
YouTube: Greg Isenberg and Ryan Vogel on the businesses Jev unlocks, and a path in through the Vercel AI Gateway.
X: Vercel ships the AI SDK provider for Jev
X: Jev as an LLM guardrail inside Agentgateway
More Jev resources like this
21GitHub stars
Self-hosted Python SDK and System One-compatible API for runtime-defined Choice, Boolean and Score decisions on pinned open models, across Torch, vLLM, MLX, llama.cpp and WebGPU. Each result records probabilities, token usage, timing, model revision and prompt version, with committed row-level benchmarks.
Jev Repos & SDKs#community#sdk#self-hosted
Community
chengyongru/fastjevPython
chengyongru/fastjevPython11GitHub stars
A Python decorator that turns a Pydantic model into Jev questions: bool becomes a Noul, a Literal becomes a Choice, and a bounded int becomes a Score, with answers validated back into the model.
Jev Repos & SDKs#community#python#pydantic
Community
aaazzam/jevPython
aaazzam/jevPython1GitHub stars
Dependency-free TypeScript SDK that turns Jev Noul, Choice and Score answers into named decisions: enter/exit thresholds with hysteresis, nested decision trees settled in one call, a JSONL journal, threshold replay without inference and Brier calibration.
Jev Repos & SDKs#community#typescript#decisions
Community
edgardcham/hunchoTypeScript
edgardcham/hunchoTypeScript1GitHub stars
Python library that records each Jev-class decision as the full distribution under a sha256 key of state, question, provider and model, then applies a separate policy. Thresholds, review bands, routing and budgets can change across the recorded history without new model calls.
Jev Repos & SDKs#community#calibration#policy
Community
YYTbit/metajevPython
YYTbit/metajevPython5.5kGitHub stars
A filesystem-first framework for durable AI agents whose auto model router defaults to Jev through Vercel AI Gateway and whose evaluate helper asks typed Choice, Score, and Boolean questions inside tools.
Jev Repos & SDKs#community#typescript#agents
Community
vercel/eveTypeScript
vercel/eveTypeScript675GitHub stars
An Apache-licensed System One decision server that reads Choice, Score, and Noul probabilities from DiffusionGemma 26B-A4B through vLLM on NVIDIA or MLX on Apple silicon, so TypeSafe SDKs work unchanged.
Jev Repos & SDKs#community#python#open-models
Community
razorback16/openjevPython
razorback16/openjevPythonFrom the Jev guides
Original write-ups on what this entry is for.
The request shape barely changes across surfaces; the surrounding contract does. When to call the API directly and when a gateway, a Worker binding, or a router entry earns its extra hop.
Jev Tools & CLIs#gateway#vercel#cloudflare
Read article
Closed weights have not stopped the ecosystem from rebuilding the shape in the open. API-compatible servers, retrained heads on small models, and inference-time tricks that skip generation entirely.
Jev Repos & SDKs#open-models#research#local
Read article
From the Jev community
Posts from builders shipping with Jev right now.