Skip to content

Jev directory

Jev Nano

The nano tier of local Jev: a /v1/systemone-compatible typed-decision server — noul, choice and score questions with probabilities — running a 7M-parameter model CPU-only from an 8MB tarball. Point any Jev/TypeSafe SDK client at it via base_url.
Stars
0
Language
Python
License
MIT
Reading time
2 min
Published by
Community
Author
javimosch
Last verified
Oct 2026

Highlights

  • Runs noul / choice / score typed decisions with probabilities on a 7M-parameter CPU-only model shipped as an 8MB tarball; no GPU needed.
  • Exposes a /v1/systemone-compatible endpoint on 127.0.0.1:8097, so any Jev/TypeSafe SDK client can call it by changing base_url.
  • Written entirely in MFL via machin: model runtime, server and decision heads compile to one static native binary, with no Python in the inference path.
  • Install is a curl | bash script plus ./demo.sh, or a manual tarball from the mtlm-router v0.3.0 release for Linux x86_64.

Quickstart

bash
curl -fsSL https://raw.githubusercontent.com/javimosch/jev-nano/main/install.sh | bash
./demo.sh

Watch out

README reviewed 2026-10-17; GitHub reports Python as the repository language while the README insists there is no Python in the inference path, and the digest contains no benchmark or quality numbers beyond the MIT tag in metadata.

Questions about this entry

Short answers drawn from the linked project or page.

From the Jev guides

Original write-ups on what this entry is for.

From the Jev AI model community

Posts from builders shipping with Jev right now.

Follow @typesafeai