The documentation page &AMP;NUM;TRL.DPOTRAINER.MODEL doesn’t exist in v0.9.4, but exists on the main version. Click <a href="/docs/trl/main/en/&amp;num;trl.DPOTrainer.model">here</a> to redirect to the main version of the documentation.