BaguaSys / bagua

Bagua Speeds up PyTorch

Home Page:https://tutorials-8ro.pages.dev/

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

async algorithm conflict with fused optimizer, can only support flattened inplac...

todo opened this issue · comments

commented

# TODO: async algorithm conflict with fused optimizer, can only support flattened inplace bucket.
assert do_flatten, "async does not support `do_flatten=False` at present."
if self.step_id < self.warmup_steps:
return super().tensors_to_buckets(tensors, do_flatten)
all_tensors = []


This issue was generated by todo based on a TODO comment in 5add7f8 when #207 was merged. cc @BaguaSys.