Jev directory
CommunityJev Models & Reimplementations
Jev Knowledge Qwen3.6-35B-A3B-FP8 Embeddings (256k)
Hugging Face dataset of Qwen3.6-35B-A3B-FP8 state/action embeddings for post-training contrastive heads on the Jev Decision Index's Knowledge & Reasoning train splits: CommonsenseQA, MMLU auxiliary_train and ChessBench.
- Reading time
- 2 min
- Published by
- Community
- Added
- Oct 2026
Highlights
- 355,093 train and 39,554 validation (state, action) pairs at 2048 dimensions
- Built from CommonsenseQA, MMLU auxiliary_train and ChessBench train splits
- Up to 8 hard negatives per row, zero-padded, with valid counts in neg_counts.pt
- Two state views per decision item: the state alone and the state with its options listed
- One-token actions, negatives and states take vectors from a separate single-token table
Questions about this entry
Short answers drawn from the linked project or page.
The card gives python scripts/download.py data jev-knowledge-qwen3.6 --rows 20000 --blocks 8, and a clm-train posttrain --source hf:jev-knowledge-qwen3.6 command. The store is also readable through the Datasets library and the Hub's dataset viewer.
Qwen/Qwen3.6-35B-A3B-FP8, run through a vLLM pooling runner with last-token pooling and L2 normalization, producing 2048-dimensional vectors with max_model_len 8,192.
The dataset is licensed per-source. The vectors are a derivative of the source text and carry that text's terms, which are listed in the dataset documentation.
The split is by task, not by row: int(task_id[:8], 16) % 10 == 0 sends a task to validation. Row i of every tensor and samples[i] in metadata.json describe the same pair.
vLLM's pooling of a one-token prompt returns noise for this model, so every one-token action, negative or state takes its vector from the jackyk02/qwen3.6-35b-a3b-fp8-single-token-embeddings table. single_tokens.npz lists those rows and token ids.
MMLU-Pro, GPQA Diamond and MuSR are skipped because they have no train split or are evaluation-only. Validation and test items of the scored benchmarks are never read, and the ChessBench test bag is never downloaded.
Each split holds float16 .pt tensors for state, action, negative and options-view embeddings, int64 neg_counts.pt, bool has_options.pt, single_tokens.npz and metadata.json. Tensors load with torch.load(..., mmap=True).
Reactions & coverage
Posts, threads, and videos about this entry from around the web.
X: Standard One SH (StandardThinking)
LinkedIn: What multimodal decision models actually change, and what they do not.
LinkedInJevDirectory.org
Hacker News: Decision Index 0.2.1 scores open reproductions of Jev on a frozen suite.
jackbravo4 pointsDecision Index 0.2.1 – 70 open reproductions of TypeSafe Jev's Decision ModelRead the thread on Hacker NewsHacker News: Pointer to a DiffusionGemma plus vLLM tutorial for a Jev-shaped classifier.
1 pointHow to build a Jev-style classifier with DiffusionGemma and vLLMRead the thread on Hacker NewsFrom the Jev guides
Original write-ups on what this entry is for.
From the Jev AI model community
Posts from builders shipping with Jev right now.