Skip to content
JevDirectory.org
CommunityPractices & Patterns0 starsVerified 2026-09-22

Jev Playground

A Next.js playground that benchmarks Jev against GPT-5.6 Luna, Claude Haiku 4.5, Gemini 3.5 Flash Lite, and GPT-6 Astra in tic-tac-toe and Connect Four, giving every model the same legal-move Choice options through the Vercel AI Gateway.

Open github.comhegargarcia/jev-playground
Category
Practices & Patterns
Published by
Community
Author
hegargarcia
Added
2026-09-22
Tagscommunitytypescriptevaluationbenchmarksgamesvercel

Highlights

  • Tic-tac-toe and Connect Four pit Jev against four frontier models on identical legal-move options and shared tactical instructions.
  • Jev uses a native evaluation model while Astra's structured output is restricted to legal squares or columns by a Zod schema.
  • Each decision log shows chosen moves, board snapshots, option weights when returned, and provider confidence when available.
  • Aggregate scores are not published yet: automated tournaments and controlled runs are listed as future work.
  • Tests use mocked evaluations and make no paid model calls.

Quickstart

bash
bun install
echo 'AI_GATEWAY_KEY=YOUR_API_KEY' > .env.local
bun run dev

Watch out

No license file, so reuse terms are unclear. Needs Bun and a Vercel AI Gateway key; it compares interactive games only and publishes no aggregate results yet.

More like this

jev-eval-agent
104GitHub stars
A personal-assistant agent with 100 mocked tools that measures how many steps a task takes when the LLM picks the tool versus when Jev picks it before every model step.
Practices & Patterns#community#typescript#agents
Communityjev-eval-agent
typesafe-ai-benchmark
38GitHub stars
Side-by-side benchmark of TypeSafe Jev, Qwen 3.8 27B on Cerebras, and a local Needle 3 across seven synthetic workloads, recording validated outputs, mistakes, latency, tokens, and estimated cost. Raw exports and per-scene limitations are published.
Practices & Patterns#community#typescript#benchmarks
Communitytypesafe-ai-benchmark
jeff
208GitHub stars
A self-hosted implementation of TypeSafe's Jev System One API powered by the 400M-parameter GLiFormer encoder: it serves choice, score, and noul and drops into the official typesafe-sdk via TYPESAFE_BASE_URL, but trails Jev on reasoning-heavy tasks.
Practices & Patterns#community#python#open-models
Communityjeff
Back to all resources

From the community

Posts from builders shipping with Jev right now.

Follow @typesafeai

Six uses that stuck after 60 days

Security decisions that fit Jev

Kostas
Kostas
@Kostastsale
·

This made me rethink where AI actually fits into security engineering. For purely engineering work, forget about ChatGPT or Claude. TypeSafe AI just released Jev, and I think it’s going to change how we build AI into security workflows. Instead of asking an LLM to “investigate Show more

TypeSafe AI
TypeSafe AI
@typesafeai

we are officially out of stealth! join the frontier and get access to Jev on our website (link on profile)

Reply
Read 14 replies

A million judged questions

Inferring Jev's internals from 1,000 calls

iwashi / Yoshimasa Iwase
iwashi / Yoshimasa Iwase
@iwashi86
·

Jevの内部アーキテクチャを推測している技術記事(Jev’s Architecture Unmasked)からメモ。 ・本記事はJevのAPIを約1万回の呼び出して、内部構造を推測したもの ・従来の言語モデルを用いた分類やルーティングでは、トークンを1文字ずつ逐次生成するために膨大な無駄な計算コストが発生していた。 Show more

Reply
Read 2 replies

The open System One roundup

小墨同学
小墨同学
@xiaomovps
·

Jev 发布没几天，开源社区已经开始疯狂复刻了🔥 最值得推荐的五个模型： 1、Laya 421M：原生决策模型，支持 Mac 2、Decider-2B：最像 Jev，基于 Qwen3.5 3、NanoJev 0.6B：专门的 Decision Head 4、Reflex：Qwen3.5 + Direct Logits 5、System-One 4B：专门做概率校准 Show more

小墨同学
小墨同学
@xiaomovps

Jev 刚发布没几天，开源社区就出现了同款🔥 Decider-2B模型，是基于 Qwen3.5-2B 做了特殊调整 它和 Jev 模型是一样的 只做选择 评分和判断 不是文本类的 LLM 模型 但两者还是有几个明显区别： 1、模型 Jev：闭源 System One Model Decider：Qwen3.5-2B，约 1.9B 参数，Apache 2.0 开源 2、价格

Image
Reply
Read 6 replies

The launch post