There's tons of good resources to learn PyTorch and alot of important functionalities that I'd like to document so I don't forget. These functionalities may be geared towards my research or just my understanding of PyTorch.
Good resources:
PyTorch Github - Official repo with great introductory code
Udacity Github - PyTorch course with projects and examples
Excellent explanations:
Batch Norm by Frederik Kratzert
Gradient accumulation: super simple in torch: