Issues

• Consider Bagua-Net using MPTCP instead of TCP

  BaguaSys/bagua#719 · Filter by author Dwyane-Yan opened on May 9, 2025

• Importing Bagua modules do no work

  BaguaSys/bagua#718 · Filter by author silverCore97 opened on Jul 4, 2024

• fix Lightning failing Bagua test for manual optimization

  BaguaSys/bagua#661 · Filter by author wangraying opened on Jan 3, 2023
  1

• Programs get blocked when using multiple nodes training.

  BaguaSys/bagua#653 · Filter by author zhaone opened on Nov 22, 2022
  1

• Support Pytorch 1.13

  BaguaSys/bagua#652 · Filter by author wangraying opened on Nov 8, 2022

• error with pip install

  BaguaSys/bagua#614 · Filter by author cmlakhan opened on May 26, 2022
  1

• how to do gradient accumulation in bugua

  BaguaSys/bagua#571 · Filter by author CaRRotOne opened on Mar 24, 2022
  1

• Questions about grad hook in bagua

  BaguaSys/bagua#476 · Filter by author ProHuper opened on Jan 10, 2022

• add communication support for more datatypes

  BaguaSys/bagua#427 · Filter by author wangraying opened on Dec 14, 2021

• support amp with fused optimizer

  BaguaSys/bagua#379 · Filter by author wangraying opened on Nov 16, 2021
  2

• async algorithm conflict with fused optimizer, can only support flattened inplac...

  todo 🗒️
  BaguaSys/bagua#353 · Filter by author todo opened on Nov 2, 2021

• remove this after process group destroy supported

  todo 🗒️
  BaguaSys/bagua#352 · Filter by author todo opened on Nov 2, 2021

• fused_step may miss init_post_optimizer_step_hook

  todo 🗒️
  BaguaSys/bagua#351 · Filter by author todo opened on Nov 2, 2021

• async algorithm conflict with fused optimizer, can only support flattened inplac...

  todo 🗒️
  BaguaSys/bagua#349 · Filter by author todo opened on Nov 2, 2021

• How to use bagua to replace torch.distributed.destroy_process_group()

  BaguaSys/bagua#324 · Filter by author lixiangMindSpore opened on Oct 25, 2021
  5

• PyTorch API compatible communication primitives and process group

  enhancement
  BaguaSys/bagua#320 · Filter by author NOBLES5E opened on Oct 22, 2021

• create landing page and optimization decision tree diagram

  documentation
  BaguaSys/bagua#315 · Filter by author NOBLES5E opened on Oct 19, 2021
  

• autotune add first phase CI, and blacklist algorithms that do not need bucket size

  autotune
  BaguaSys/bagua#311 · Filter by author NOBLES5E opened on Oct 19, 2021
  

• barrier with broadcast

  enhancement
  BaguaSys/bagua#301 · Filter by author NOBLES5E opened on Oct 16, 2021
  

• combine **inplace API

  todo 🗒️
  BaguaSys/bagua#289 · Filter by author todo opened on Oct 15, 2021

• remove the dependency on torch process group

  todo 🗒️
  BaguaSys/bagua#288 · Filter by author todo opened on Oct 15, 2021

• Create param groups to handle expert + data case (e.g. param.group = moe_group)

  todo 🗒️
  BaguaSys/bagua#234 · Filter by author todo opened on Sep 28, 2021
  

• Create param groups to handle expert + data case (e.g. param.group = moe_group)

  todo 🗒️
  BaguaSys/bagua#233 · Filter by author todo opened on Sep 28, 2021

• revisit allreduce for moe.gate...

  todo 🗒️
  BaguaSys/bagua#232 · Filter by author todo opened on Sep 28, 2021

• support all Al backends including CPU

  bagua-core
  BaguaSys/bagua#195 · Filter by author NOBLES5E opened on Sep 15, 2021