Option marker
Scoring each answer option at its own marker token, then softmaxing over the question's options so the answer space is defined at request time.
- Category
- API & Models
- Also known as
- —
- Related terms
- 4
- Directory entries
- 4
- Docs
- —
- Added
- 2026-10-10
Definition
Laya scores every option at its own [MASK] token and softmaxes over that question's options, so new schemas need no retraining. Julia 1, bev-decider, and Gero-4B use related readouts — one branch or slot per option, scored in a single forward pass.
The mechanism explains the limits. Options share a fixed head budget, 192 tokens on Laya's English checkpoint and 256 on the multilingual build, which is why a 77-option question allocates three to four tokens per label and why Laya scores 0.425 on Banking77 where Jev's hosted 255-option Choice reaches 0.870.
Related terms
Definitions that connect to this one.
From the Jev directory
From the Jev community
Posts from builders shipping with Jev right now.