Jev directory
CommunityJev Demos & Experiments
Jev Playground — taiki00wo
A Japanese-language experiment workspace that asks Jev, through typesafe-sdk-python's jev-latest, why a dummy restaurant's sales fell, and compares Jev against a local Ollama model on accuracy, speed, answer variance, confidence, and cost.
- Stars
- 0
- Reading time
- 2 min
- Published by
- Community
- Added
- Nov 2026
This is one of several Jev listings for the same project. The canonical entry is Jev Playground (MoonBit).
Highlights
- Asks Jev via typesafe-sdk-python's jev-latest about causes of a restaurant sales decline.
- Store data is labeled dummy data; no real store records are used.
- experiments.py walks four stages, from clear-answer data to passing computed change rates.
- compare.py measures accuracy, speed, answer variance, confidence, and cost against Ollama.
- Results are written as JSON under results/, which is excluded from Git.
Questions about this entry
Short answers drawn from the linked project or page.
Run uv sync, copy .env.example to .env, and put your TypeSafe AI API key in TYPESAFE_API_KEY. For the LLM comparison, start Ollama and pull the model, by default llama3:8b, with ollama pull llama3:8b.
Only for the Jev side. Passing --only llm runs just the Ollama comparison and needs no API key; running both sides, or --only jev, requires the key set in .env.
It uses dummy store data that carries correct labels. The repository states the data is not from any real store, so results are illustrative rather than drawn from live business records.
It compares Jev and an Ollama model on the same cause-judgment task, reporting accuracy, speed, how much answers vary across repeats, confidence, and cost. Results are saved as JSON in results/.
The script changes how Jev is asked in four steps: clear-answer data using Choice, Score, and Noul; mixed causes with and without a comparison baseline; per-cause Noul questions with observations mixed in; and passing a computed change rate while asking only for the judgment.
Yes. compare.py accepts --llm-model for the Ollama model, --per-cause for stores per cause (default 5, total four times that), --repeats for repeated judgments (default 3), --limit to cap records, and --seed for the dummy-data random seed (default 42).
The repository is MIT licensed. It is a personal experiment workspace rather than an official TypeSafe AI project, and it depends on the typesafe-sdk-python client for its Jev calls.
From the Jev guides
Original write-ups on what this entry is for.
From the Jev AI model community
Posts from builders shipping with Jev right now.