Video
CommunityJev Practices & Patterns
Run a Jev-Style Model on Your Own GPU
A local-inference walkthrough that compares Kev, SemIf, Von, and OpenJev on consumer hardware, including Brier scores and a fake-probabilities warning.
- Format
- Video
- Reading time
- 2 min
- Published by
- Community
- Author
- Cloud Codes
- Last verified
- Sep 2026
Highlights
- Claims KV-cache sharing lifts throughput from 2 to 20+ decisions per second on one consumer GPU.
- Reviews Kev sizes, SemIf on an RTX 3090, Von's 395M CPU model, and OpenJev's multimodal path.
- Reports 81 to 85% local accuracy against Jev's 88% and warns about fake self-reported probabilities.
Watch out
Aggregates third-party claims and asks for channel membership; no independent verification.
Questions about this entry
Short answers drawn from the linked project or page.
No. The entry records that the video aggregates third-party claims with no independent verification, and the 20+ figure traces to a KV-cache sharing claim from one project's repository. The published text names an RTX 3090 for SemIf and a 395M CPU model for Von but never ties those to the throughput number, and the same video asks for channel membership.
That is the video's own warning and the sharpest thing in it: some of these models emit numbers formatted like confidence without being calibrated at all. Run a Brier score on your own labelled set before thresholding anything. The page records 81 to 85% local accuracy against Jev's 88%, but no calibration curve for any of them.
Unknown from what is published. The page documents no eval harness, no question set, and no confirmation that the local models and the hosted endpoint saw identical prompts or option lists, and a hosted API carries latency and per-token cost the local runs do not. Directional at best.
The copy names Kev model sizes, SemIf on an RTX 3090, Von's 395M CPU model and OpenJev's multimodal path. Beyond that the page documents no VRAM requirement, no quantisation level, no install steps and no serving runtime, so you would be inferring hardware needs from parameter count alone, which is where most of these plans go wrong.
Kev, SemIf, Von, and OpenJev. It reviews Kev model sizes, SemIf on an RTX 3090, Von's 395M CPU model, and OpenJev's multimodal path.
KV-cache sharing, which the entry records as claimed to lift throughput from 2 to 20+ decisions per second on one consumer GPU. The published text never ties that figure to a specific reviewed model.
No. The entry says the video aggregates third-party claims and asks for channel membership, with no independent verification, so treat the accuracy and throughput figures as collected claims rather than measured results.
Reactions & coverage
Posts, threads, and videos about this entry from around the web.
X: Standard One SH (StandardThinking)
LinkedIn: What multimodal decision models actually change, and what they do not.
LinkedInJevDirectory.org
Hacker News: Decision Index 0.2.1 scores open reproductions of Jev on a frozen suite.
jackbravo4 pointsDecision Index 0.2.1 – 70 open reproductions of TypeSafe Jev's Decision ModelRead the thread on Hacker NewsHacker News: Pointer to a DiffusionGemma plus vLLM tutorial for a Jev-shaped classifier.
1 pointHow to build a Jev-style classifier with DiffusionGemma and vLLMRead the thread on Hacker NewsFrom the Jev guides
Original write-ups on what this entry is for.
From the Jev AI model community
Posts from builders shipping with Jev right now.