Skip to content

Jev glossary

Evaluation & TrainingReinforcement learning from human feedback

RLHF

The human-preference training method that turned pretrained models into chatbots, and the method TypeSafe deliberately did not use.
Category
Evaluation & Training
Also known as
Reinforcement learning from human feedback
Reading time
1 min
Related terms
5
Directory entries
1
Docs
docs.typesafe.ai
Added
2026-09-24

Definition

RLHF trains a model to produce responses people prefer. It powered InstructGPT and ChatGPT and was co-invented by Diogo Almeida, now a TypeSafe cofounder, but the primer argues preference optimization can reward sycophancy and confident-sounding hallucinations.

It remains a good fit for conversational models. TypeSafe's position is that production automation needs a different objective: constrained decisions and calibrated uncertainty.

Tagstraining

From the Jev directory

Directory entries that go deeper on this term.

Why TypeSafe trains decision models with RLCD instead of RLHF: calibrated probabilities where 0.2 outcomes happen about 20% of the time, and the case for machine-to-machine automation.
Jev Guides & ArticlesDocs#official#docs#evaluation
Official

From the Jev AI model community

Posts from builders shipping with Jev right now.

Follow @typesafeai