How does Dyad make decisions?

It augments a pretrained LLM with an environment-conditioned action encoder that embeds each candidate action description in parallel, then scores those embeddings against the LLM's internal state to yield a distribution over typed actions.

What is the point of factorizing decision-making?

It separates representations of the evolving interaction state from environment-specific action semantics, which the authors say introduces an inductive bias for reusable representations and keeps action scoring efficient as the action space grows.

Can Dyad adapt without changing the LLM?

Yes. With the LLM frozen, training the action encoder alone achieves consistent gains across four unseen environments, enabling modular adaptation without modifying any LLM parameters.

How does joint training compare with standard RL post-training?

Jointly optimizing both components outperforms conventional RL post-training across diverse interactive tasks and model scales, including a 3.80% average absolute gain on ALFWorld with a 9B model.

Does Dyad training hurt the LLM's general abilities?

The abstract says joint optimization improves general knowledge, reasoning, and coding, so the gains on interactive tasks do not appear to come at the cost of those abilities.

What environments were used to test Dyad?

The paper investigates two complementary reinforcement learning settings driven by environment interaction, and reports gains across four unseen environments plus improvements on diverse interactive tasks.

What remains unstated in the Dyad abstract?

It does not describe the conventional RL post-training baselines, the model scales other than the 9B ALFWorld result, or whether the architecture and trained components are available for reuse.

CommunityJev Practices & Patterns

Dyad: Extending Large Language Models with Native Typed Decision-Making (arXiv 2609.36116)

Dyad augments a pretrained LLM with an environment-conditioned action encoder that scores candidate action descriptions to yield a distribution over typed actions. Training only the encoder helps across four unseen environments; joint training adds a 3.80% absolute gain on ALFWorld with a 9B model.

See highlights

Open arxiv.org

Format: Article
Published by: Community
Last verified: Oct 2026

Tagscommunity research arxiv agents decision-models reinforcement-learning

Works forJev for Realtime control Jev for Tool calling

Used inJev for Software & DevTools Jev for Gaming

Highlights

Embeds each candidate action description in parallel and scores embeddings against the LLM's internal state.
With the LLM frozen, training the action encoder alone gives consistent gains across four unseen environments.
Joint optimization beats conventional RL post-training, adding 3.80% average absolute gain on ALFWorld with a 9B model.
The factorization keeps action scoring efficient as the action space grows.
Joint training also improves general knowledge, reasoning, and coding, per the abstract.

Watch out

arXiv preprint dated September 28, 2026 (cs.LG) by Yundaichuan Zhan and co-authors. The abstract reports two RL settings and one explicit number (3.80% on ALFWorld); it does not describe which conventional RL post-training baselines were compared or whether Dyad's components are released.

Questions about this entry

Short answers drawn from the linked project or page.

Related terms

Glossary definitions related to this entry.

Autoresearch

More Jev resources like this

Can Jev be Your Q or Policy in Reinforcement Learning? (arXiv 2610.11692)

A study of whether Jev can serve inside reinforcement learning training rather than as a single-domain black box. Frozen Jev fills reference-policy, exploration-judge, and replay-rater roles, and training with it beats a standard RL learner across nine MiniGrid tasks and three Atari games.