Skip to content

Jev Guides & Articles

The clone wars: open reimplementations and their claims

Kev, Laya, d1, and the API-compatible servers are not the same kind of copy. How to separate a reproduction from a rival and evaluate the claims.
Published
Category
Jev Guides & Articles
Resources cited
10
Reading time
5 min
Tags#discourse#open-models#reimplementations#benchmarks

Within weeks of Jev's launch, the ecosystem had reproductions, compatible servers, and rival families. The WSJ noted that the three-week-old model was already sparking copycats. That is not a scandal; it is what happens when an interface is simple enough to copy. The interesting part is what the copies actually are, because “open reimplementation” covers several different projects with different claims.

The families are not the same thing

The open landscape splits into at least four groups:

  • Retrained heads on open backbones. Kev, Laya, and the various “decider” models add a decision head to a language model and train it to score candidate options.
  • API-compatible servers. These expose a Jev-shaped endpoint but may run a different model behind it. Open-Jev and the unofficial hosts are the examples.
  • Decision-tuned fine-tunes. A base model is fine-tuned on typed decision data, often with a calibration step. Laya is the best-known family here.
  • Rival hosted models. Liquid AI's d1 is the clearest case of a competitor with its own architecture and benchmark claims, not a Jev reproduction.

The open reimplementations article tracks the first wave. The open decision-model roundup covers the broader set. The distinction matters because a compatible API is not a reproduction, and a fine-tune is not an architecture.

Kev: the pointer-head line

Kev-0.8B and the larger Kev checkpoints are the most direct “small decision model” line. Soro-Kev-4B is a useful example of the newer generation: a LoRA adapter (rank 16, alpha 32) plus a pointer head on a frozen Qwen3-4B, served in NF4 at about 4,048 MB of VRAM. It reports 89.00% zero-shot tool routing on its Universal Tool Harness, 94.50% on external human holdouts, and 75.76% calibrated abstention on BFCL irrelevance slices. The card also reports a learned temperature of 1.62 and a split-conformal quantile of 0.8066 at 90% coverage.

Those are self-reported numbers with no third-party reproduction. The card's own caveat is that training states were capped at 4,096 tokens even though it advertises 32,768-token states. Treat the routing result as a promising checkpoint, not a settled benchmark.

Laya: the calibration-first line

Laya is the family most often compared with Jev. Its cards ship calibration artifacts, and the independent reproductions focus on whether the probabilities hold up. The Laya typed probabilistic assessor is a pre-registered evaluation of calibration and selective escalation. The Jev vs Laya benchmark is a head-to-head, and Jev News compare puts both against Luna and the rest.

The pattern in the cards is consistent: quantized variants, a calibration step, and an explicit caveat that the numbers are the author's. That is not a weakness unique to Laya. It is the normal state of an open model released faster than independent evaluation can follow.

d1: the rival, not the clone

Liquid AI's d1 is the cleanest example of a competitor rather than a reproduction. Gigazine's coverage describes it as a decision model that surpassed Jev on Hugging Face's Decision Index. Whether that holds depends on the index version and the task mix, but the framing is different: d1 is a separate model family with its own training and its own claims, not an API-compatible copy.

The Decision Index results and the encoder index results are the places to check the numbers rather than the press summary.

What the copies tell you about the original

The copy wave is evidence about the interface, not about the weights. If a dozen teams can ship a Jev-shaped endpoint in a month, the input/output contract is easy to understand. That is a good sign for adoption and a weak signal about whether any particular implementation is faithful.

The launch reception article makes the same point: the clone war confirmed the shape the launch made legible. The Microsoft MAI / model roundup and the awesome lists are better maps of the ecosystem than any single “best clone” claim.

How to evaluate a reproduction

If you are choosing an open model, do not start with the name. Start with the contract and the evidence:

QuestionWhy it matters
Does it accept state plus typed questions?A compatible API is not enough; the answer shape has to match
Which primitives does it support?Choice, Score, Noul, Box, and images are not universal
What calibration artifacts ship?A temperature or conformal quantile is a starting point, not a guarantee
What is the training data and license?The backbone and the adapter can have different terms
Who reproduced the headline number?Self-reported benchmarks are the norm
What is the context limit in practice?Cards often advertise more than they trained on

The choosing an open decision model article goes deeper on the selection process. For the clone debate, the main lesson is simpler: the existence of many copies is a signal about the interface, and the quality of any one copy is a separate question that only a held-out test can answer.

A short checklist

  • Separate API compatibility from architectural reproduction.
  • Check the primitive coverage before assuming a drop-in swap.
  • Read the caveat on every card; self-reported numbers are the default.
  • Compare on your own labels and candidate sets.
  • Check the license for the backbone and the adapter separately.
  • Treat press claims about “beating Jev” as a pointer to the index, not the result.

The clone war is noisy, but it is also useful. It turns “is this a new category?” into “which implementation fits my workload?”, which is the question that actually ships.

From the Jev directory

The resources behind this article.

Per WSJ's search excerpt, the three-week-old Jev has set Silicon Valley abuzz with talk of alternatives to large language models and is already sparking copycats. It classifies inputs to predetermined outputs: yes or no, a numerical score, or answers on a list.
Jev Media & TalksArticle#community#press#competition
Community
The smallest Kev: an 11.3M-parameter LoRA and pointer head on Qwen3.5-0.8B-Base that answers typed choice, score and noul questions with calibrated probabilities in one forward pass, running on a laptop or a 4 GB GPU.
Jev Models & Reimplementations#community#open-models#local
Community
33.3kGitHub stars
Open multilingual System 1 decision models with published checkpoints for choice, score and noul questions, plus a router that dispatches each request to the right checkpoint in one forward pass.
Jev Repos & SDKs#community#python#open-models
GIGAZINE's report on Liquid AI's d1, which it describes as the first decision model to beat Jev on Hugging Face's Decision Index, and a short survey of the clone wave that followed Jev's September launch.
Jev Media & TalksArticle#community#news#benchmarks
Community
Alex Nikolic's open reproduction of Jev as a Qwen3.5 cross-encoder: one NLI primitive over premise and hypothesis - entailment, contradiction or neutral - that reranks answers, grades them, guards content and even picks game moves, with the 4B v5 checkpoint near Jev 1.13 on public JevBench items.
Jev Models & Reimplementations#community#catalog-import#madewithjev
Community
A pointer-network decision model from Keyush Nisar that reads one agent state document plus typed questions and returns calibrated tool-routing probabilities in a single forward pass, reporting 89.00% zero-shot tool routing.
Jev Models & Reimplementations#community#open-models#local
Community
Jared Palmer's Kev-4B: a 33.8M-parameter rank-16 LoRA and pointer head on Qwen3.5-4B-Base that returns calibrated probabilities for typed choice, score and noul questions in one forward pass, sized for one 24 GB GPU or a 32 GB Apple Silicon Mac.
Jev Models & Reimplementations#community#open-models#local
Community
A Laya fine-tune for coding decisions: roughly 9k rows from SWE-Gym teach keep/drop file relevance, priority scoring and injection detection, reporting 0.833 accuracy on 1,150 held-out rows at 126 ms p50.
Jev Models & Reimplementations#community#open-models#local
Community
TechCrunch coverage of OpenAI's DevDay Decisions API beside TypeSafe's Jev, including agent-monitoring cost comparisons and CEO responses on X.
Jev Guides & ArticlesArticle#community#evaluation#agents
Community
TechCrunch news report on OpenAI opening its Decisions API to all customers on October 22, 2026, how it was built from ChatGPT Luna, and how the Jev decision-model category compares on latency, calibration, and public indices.
Jev Media & TalksArticle#press#benchmark#calibration
Community
Back to all articles

Related Jev articles

Hundreds of repos, several lists, and a benchmark layer. How to tell a maintained project from a scaffold and a benchmark from a marketing page.
Jev Guides & Articles#discourse#open-source#community
Read article
From 0.5B to 35B, what changes in accuracy, calibration, and cost? How to read the size spectrum without assuming bigger is better.
Jev Models & Reimplementations#models#open-models#benchmarks
Read article

From the Jev AI model community

Posts from builders shipping with Jev right now.

Follow @typesafeai