Open Models Almanac
Methodspost-trainingpreference optimization

methods · post-training

preference optimization

8 methods filed at this node or below it, from the sources of 7 models.

In this branch 8

Everything filed at this node or below it, with one collapsible heading per child node.

filed here 8

7 single mentions
Offline direct preference alignment core · 1 source · 1 quote
Budget-based verbosity control used · 1 source · 1 quote
Deliberative alignment used · 1 source · 1 quote
Direct Preference Optimization (DPO) used · 1 source · 1 quote
Fixed-reference response comparison used · 1 source · 1 quote

By model

Which of this branch's methods each model's own documents describe, and how strongly. Under each model: its strongest treatment anywhere in the branch.

↑