Skip to content

[bugfix] LoRA + TP>1 + sequence_parallel: sum grads of the replicated LoRA factor over the TP group (exported adapter had last-layer linear_proj.lora_B == 0) - #173

Merged
hjh0119 merged 1 commit into
modelscope:mainfrom
hojuna:fix/lora-sp-tp-grad-allreduce
Sep 7, 2026
Merged

[bugfix] LoRA: sum grads of replicated LoRA factor over TP group unde…

9a62ab5
Select commit
Loading
Failed to load commit list.
Sign in for the full log view

Annotations

1 warning
lint
succeeded Sep 7, 2026 in 25s