The FLOPs counting problem
Huskyii24 opened this issue · comments
Unsupported operator prim::PythonOp.CrossScanTriton encountered 15 time(s)
Unsupported operator prim::PythonOp.CrossMergeTriton encountered 15 time(s)
When i am testing the flops of the model, i have these information on the terminal。I found that these are implemented with triton，and there doesn't seem to be much computation in it,
Does this mean that FLOPs can be ignored for these operators？
Yes they can be ignored as they are all about transpose and flip，and the key operations are just malloc and copy.