BaguaSys / bagua

Bagua Speeds up PyTorch

Home Page:https://tutorials.baguasys.com/

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

async algorithm conflict with fused optimizer, can only support flattened inplac...

todo opened this issue · comments

commented

# TODO: async algorithm conflict with fused optimizer, can only support flattened inplace bucket.
assert do_flatten, "async does not support `do_flatten=False` at present."
if self.step_id < self.warmup_steps:
return super().tensors_to_buckets(tensors, do_flatten)
all_tensors = []


This issue was generated by todo based on a TODO comment in 8707188. It's been assigned to @wangraying because they committed the code.