Skip to content

Multimodal Decision Models: What Clef and d1 Change

Jev takes text only; Clef-omni adds image, audio, and video input and Liquid d1 adds images, each keeping the same typed-answer shape. Where that matters, where it does not, and the costs the vendors underplay.

Published
Category
Jev Models & Reimplementations
Resources cited
4
Reading time
3 min
Tags#multimodal#open-models#decision-model#clef

Jev takes text, and only text. That was a firm line through 2026, and it is the first thing the rivals attacked. Cloudflare's Clef-omni adds images, audio, and video, Liquid's d1 adds images, and both keep the same typed-answer shape. Whether that matters depends entirely on whether your states contain pixels.

What changed

The decision-model contract — a state plus typed questions, answers with probabilities — was text-only by design. A multimodal decision model keeps the contract and widens the state to include media: Clef-omni accepts text, images, wav or mp3 audio, and mp4 or webm video in one request, and d1 accepts text, images, or both.

The output does not change. You still get a Choice, a Score, or a Noul. The difference is that a question can now be about a frame, a clip, or a recording instead of a description someone wrote first.

Where this genuinely helps

The text-only constraint forced a lossy pre-step: describe the image, transcribe the audio, summarize the clip, then decide. Every one of those steps is a place where the judgment input degrades. Multimodal decision models remove the pre-step for tasks where the media is the state:

  • Screening an image against a content policy.
  • Judging whether a product photo matches a listing.
  • Classifying a screen recording or a UI clip.
  • Routing on a voicemail or a call recording.

The browser and computer-use article shows the workaround that text-only Jev required: agents sent structured page observations instead of screenshots. A multimodal model lets the decision look at the pixels directly.

Where it changes nothing

For the overwhelming majority of decisions — routing a ticket, scoring a document, classifying a message — the state is already text and stays text. Adding an image modality does not change the primitive design, the threshold logic, or the state discipline. It adds an input type, not a new programming model.

The costs the vendors underplay

Three caveats recur across the multimodal entries:

  • Tokens. Images, audio, and video become input tokens, and input is what you pay for. A clip costs far more than the sentence that would have described it, so the pre-step you removed may have been the cheap one.
  • Vendor claims. The latency and quality numbers for Clef and d1 come from their makers. The price-war article collects the rival benchmarks and their sources; the FOMA comparison interleaves vendor and third-party figures. Measure on your own task.
  • Calibration. A new modality is a new calibration problem. A model that routes well on text may be uncalibrated on audio, and your thresholds do not transfer.

What to do if you are text-only today

If Jev is your model and your states are text, the multimodal question is narrower than it sounds. Check whether your pipeline already does the describe-transcribe-summarize step, and whether that step loses the information the decision needs. If it does not — if the description is as good as the image for your question — stay text-only; you are paying less. If it does, a multimodal decision model is the first thing that competes with the workaround rather than the description.

Multimodal input widens the state, not the contract. The decision shape is the same; what you can point a question at is not.

From the Jev directory

The resources behind this article.

Cloudflare's first open decision models on Workers AI: Clef, a 27B model that reads text, JSON, images, or video, and Clef-flash, a 9B model for the latency-sensitive hop, each returning a probability per option.
Jev Models & Reimplementations#community#cloudflare#decision-model
Community
A multimodal decision model on Workers AI that takes text, images, audio, or video in one request and returns schema-constrained probabilities, built on a 30B mixture-of-experts backbone with about 3B parameters active.
Jev Models & Reimplementations#community#cloudflare#multimodal
Community
Liquid AI's first decision model, a hosted API that adds image input to the Choice, Score, and Noul shape. Liquid reports it matching or beating GPT-6.1 Sol on four of six tested applications at 19x to 200x lower cost.
Jev Models & Reimplementations#community#decision-model#multimodal
Community
Instructions, option descriptions, score levels, and noul criteria all accept JSON, so you can label question parts, pass schemas and taxonomies, and keep candidate paths alive.
Jev Practices & PatternsDocs#official#primitives#architecture
Official
Back to all articles

More Jev articles

Most Jev accuracy problems are state problems. What belongs in a state, what is a pre-made judgment to leave out, and why naming the slice you ask about matters more than the wording.
Jev Practices & Patterns#state#design#primitives
Read article
A Noul returns one number and no separate confidence. How to read the value, pin its boundary with criteria, split compound questions, and set a per-action threshold that matches the cost of being wrong.
Jev Practices & Patterns#noul#primitives#confidence
Read article

From the Jev community

Posts from builders shipping with Jev right now.

Follow @typesafeai