Skip to content

[Feature] Add DistillationLoss for token-level LLM knowledge distillation - #4038

Open
theap06 wants to merge 1 commit into
pytorch:mainfrom
theap06:feature/llm-distillation-loss
Open

[Feature] Add DistillationLoss for token-level LLM knowledge distillation#4038
theap06 wants to merge 1 commit into
pytorch:mainfrom
theap06:feature/llm-distillation-loss

Commits

Commits on Jul 21, 2026