Jev directory
CommunityJev Models & Reimplementations
CLM-35B-A3B Jev Boost Head
A contrastive state/action projection head over Qwen3.6-35B-A3B embeddings, post-trained on 67 text stores plus 382 Jev boost stores. Scores decisions as cosine similarity between state and action heads.
- Reading time
- 2 min
- Published by
- Community
- Added
- Oct 2026
Highlights
- 3-layer GELU MLP head, width 1536, 512-d output over 2048-d embeddings
- Trained on 67 text stores plus 382 Jev boost stores with 40% HQ-DQA replay
- Best checkpoint at step 33,000 of 40,000 by mean store validation loss
- Head text index scores 39.9 overall versus 21.6 for the 67-store baseline
- Built via clm_train with heads.build(2048, "best_head.pt")
Questions about this entry
Short answers drawn from the linked project or page.
It is a contrastive state/action projection head trained over Qwen/Qwen3.6-35B-A3B-FP8 embeddings. It produces a 512-d output from 2048-d L2-normalized embeddings and scores decisions as the cosine similarity between the state and action heads.
Use clm_train.models.heads.build(2048, "best_head.pt") to get a pair object exposing pair.state_head and pair.action_head. Score decisions as cos(state, action).
States and actions must be rendered and embedded exactly as in training, using clm_train.render.Renderer. One-token sequences take the single-token table.
HQ-DQA pre- and mid-training, then post-training on the recipe's 67 text stores plus 382 Jev boost stores, with plain states and 40% HQ-DQA replay. The mixture is in joint_weights.json.
On the Jev Decision Index text public suite (35 of 37 panel benchmarks), the head scores 39.9 overall versus 21.6 for the 67-store baseline, with knowledge 10.9, language 52.1, retrieval 54.7, tools 60.5, and arts 16.5.
Training data licences vary per source, and several sources are non-commercial. The model card points to the boost recipe for details.
No. The model card states it is not deployed by any Inference Provider, so it must be run locally or self-hosted.
Reactions & coverage
Posts, threads, and videos about this entry from around the web.
X: Standard One SH (StandardThinking)
LinkedIn: What multimodal decision models actually change, and what they do not.
LinkedInJevDirectory.org
Hacker News: Decision Index 0.2.1 scores open reproductions of Jev on a frozen suite.
jackbravo4 pointsDecision Index 0.2.1 – 70 open reproductions of TypeSafe Jev's Decision ModelRead the thread on Hacker NewsHacker News: Pointer to a DiffusionGemma plus vLLM tutorial for a Jev-shaped classifier.
1 pointHow to build a Jev-style classifier with DiffusionGemma and vLLMRead the thread on Hacker NewsFrom the Jev guides
Original write-ups on what this entry is for.
From the Jev AI model community
Posts from builders shipping with Jev right now.