Skip to content

Jev directory

EuLLM

An open-source platform for creating, distributing, and running sovereign EU-compliant LLMs: one Rust binary with OpenAI- and Ollama-compatible APIs, decisions answered as probabilities in milliseconds, and an audit trail designed for the EU AI Act.
Stars
59
Language
Python
License
AGPL-3.0
Reading time
3 min
Published by
Community
Author
eullm
Last verified
Oct 2026

Highlights

  • README: local AI deciding in milliseconds — one Rust binary, OpenAI- and Ollama-compatible APIs, no telemetry, and an audit trail designed for the EU AI Act.
  • At a glance: 64 questions about a page in 0.66 s — about 10 ms each — on one RTX 5070 Ti, giving the probability of every option and generating nothing.
  • A RAG gate for Italian law reaches AUROC 0.90 against 0.79 for embeddings, blocking 2.5x fewer good answers, attributed to a Jev-Style 2B model.
  • The same question returns the same answer bit for bit, checked on both CPU and GPU; badges show engine v0.7.70 and Forge + Hub in early development.
  • AGPL-3.0-or-later, copyright I3K Technologies Srl, which also offers a separate commercial licence; contributions require the CLA.

Watch out

README reviewed 2026-10-17 and truncated mid-sentence inside the audit-trail bullet, so install commands, the Forge and Hub workflow, and pricing are not in the digest. The repo tags itself jev, jev-ai, jev-api, and jev-model and the README calls the RAG gate "Jev-Style 2B", but the excerpt shows no TypeSafe endpoint or dependency, so treat the link as a class resemblance. All timings and AUROC figures are the project's own.

Questions about this entry

Short answers drawn from the linked project or page.

From the Jev guides

Original write-ups on what this entry is for.

From the Jev AI model community

Posts from builders shipping with Jev right now.

Follow @typesafeai