Mehdi Mirzazadeh's repositories
fairscale
PyTorch extensions for high performance and large scale training.
Language:PythonNOASSERTION000
Megatron-LM
Ongoing research training transformer language models at scale, including: BERT & GPT-2
Language:PythonNOASSERTION000
pipeline_experiments
PyTorch pipeline parallelism experiments
Language:PythonMIT000
pytorch
Tensors and Dynamic neural networks in Python with strong GPU acceleration
Language:C++NOASSERTION000
tutorials
PyTorch tutorials.
Language:Jupyter NotebookBSD-3-Clause000