Greg Pauloski's repositories
kfac-pytorch
Distributed K-FAC Preconditioner for PyTorch
BERT-PyTorch
BERT for Distributed PyTorch + AMP Training
python-template
Python package template
llm-pytorch
Tools and training scripts for large language models
DeepLearningExamples
Deep Learning Examples
gpauloski.github.io
Personal website: gregpauloski.com
loggerplus
Custom Logger for Machine Learning
gpt-neox
An implementation of model parallel autoregressive transformers on GPUs, based on the DeepSpeed library.
4pseatBot
A Discord bot -- the spiritual successor of 3pseatBot
cctools
The Cooperative Computing Tools (cctools) enable large scale distributed computations to harness hundreds to thousands of machines from clusters, clouds, and grids.
hobachi
Python object proxy with just-in-time resolution implemented in Rust
kfac
An implementation of KFAC for TensorFlow
mof-generation-at-scale
Create new MOFs by combining generative AI and simulation on HPC
parsl_object_registry
Registry system for managing the lifetime of expensive objects across different calls to workflow functions
rustlings
:crab: Small exercises to get you used to reading and writing Rust code!
tokenizers
💥 Fast State-of-the-Art Tokenizers optimized for Research and Production