is this inference only or training as well?
YoelShoshan opened this issue · comments
First of all, thanks for sharing this code :)
Is this code expected to be used purely in inference or can it be used for training as well?
btw - my main motivation for using batchnorm fusion isn't run speed, it's reducing memory requirements.
It is only for the inference
ok, thanks! :)