Skip to content

Jev directory

JEV-CPU — huggingface.co

A CPU port of SemIf with a web UI: JEV-CPU loads Qwen3-0.6B in float32 and reads a decision from its option logits in about a second, across eight domains from support to incident severity, with no GPU.
Reading time
2 min
Published by
Community
Author
Meanblock
Last verified
Oct 2026

This is one of several Jev listings for the same project. The canonical entry is JEV-CPU — leesk212.

Highlights

  • CPU port of SemIf: loads Qwen/Qwen3-0.6B in float32 (~2.4 GB) on a laptop and needs no GPU.
  • Reads the decision from option logits in about a second: one forward pass, no text generated, no decoding loop.
  • One engine across eight domains, from support and content moderation to incident severity, email intent and loan/credit risk.
  • Options are pinned to single tokens that round-trip, then only those slots are softmaxed; the winner is the argmax.
  • MIT licensed; the project states it is independent and not affiliated with SemIf's author, TypeSafe or Jev.

Quickstart

python
logits = model(**inputs, use_cache=False).logits[:, -1, :]  # (vocab,)
selected = logits[slot_ids]  # e.g. logits at tokens A, B, C
probs = softmax(selected)  # conditional distribution over the options
winner = options[argmax(probs)]

Watch out

Page copy reviewed 2026-10-15 from the Hugging Face model card, which was truncated mid-section. The ~1 second latency and the CPU port design are the card's own description; the digest carries no independent benchmark, and the project is a thin adaptation of TheoLeeCJ/SemIf.

Questions about this entry

Short answers drawn from the linked project or page.

From the Jev guides

Original write-ups on what this entry is for.

From the Jev AI model community

Posts from builders shipping with Jev right now.

Follow @typesafeai