how to deploy actnn by libtorch?

[Martin Eric]

It's really an interesting work！I just wonder how can we deploy actnn using libtorch. With libtorch or onnx( from python to c++),it will make actnn more useful.Thank you~

[Jianfei Chen]

Thanks for your interest in our work. ActNN is a library for reducing training memory footprint by compressing the saved activations in each layer. At the inference time, the layer's activations won't be saved anyways, since we don't need to compute the gradients. Therefore, ActNN won't reduce the memory footprint at inference time.