Skip to content

[Feature] On-policy KL distillation loss for LLMs - #3921

Open
theap06 wants to merge 3 commits into
pytorch:mainfrom
theap06:llm-distillation-loss
Open

[Feature] On-policy KL distillation loss for LLMs#3921
theap06 wants to merge 3 commits into
pytorch:mainfrom
theap06:llm-distillation-loss

Commits

Commits on Jun 29, 2026

Commits on Jun 30, 2026