Skip to content

[Feature] On-policy KL distillation loss for LLMs - #3921

Open
theap06 wants to merge 3 commits into
pytorch:mainfrom
theap06:llm-distillation-loss
Open

[Feature] On-policy KL distillation loss for LLMs#3921
theap06 wants to merge 3 commits into
pytorch:mainfrom
theap06:llm-distillation-loss

[Quality] Apply distillation test formatting

b89c142
Select commit
Loading
Failed to load commit list.
Meta CLA / Meta CLA Check succeeded Jun 30, 2026 in 0s

Contributor License Agreement is valid!