EleutherAI / gpt-neox

An implementation of model parallel autoregressive transformers on GPUs, based on the Megatron and DeepSpeed libraries

https://www.eleuther.ai/

Add PyTorch Memory Profiler

Quentin-Anthony opened this issue 5 months ago · comments

Quentin Anthony commented 5 months ago

https://zdevito.github.io/2022/12/09/memory-traces.html