hjmshi

algorithmic-efficiency

MLCommons Algorithmic Efficiency is a benchmark and competition measuring neural network training speedups due to algorithmic improvements in both training algorithms and models.

pdfo

Powell's Derivative-Free Optimization solvers.

DeepSpeed

DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.

nocode

The best way to write secure and reliable applications. Write nothing; deploy nowhere.

dlrm

An implementation of a deep learning recommendation model (DLRM)

LaTeXing

LaTeXing - Professional Typesetting - An extension for Sublime Text which makes your life easier and more comfortable while creating your documents.

gpytorch

A highly efficient implementation of Gaussian Processes in PyTorch

PyTorch-LBFGS

A PyTorch implementation of L-BFGS.

pycutest

Python interface to CUTEst

large-batch-training

Code to reproduce some of the figures in the paper "On Large-Batch Training for Deep Learning: Generalization Gap and Sharp Minima"

shampoo.pytorch

An implementation of shampoo

kfac_pytorch

NLP.py

A Python environment for large-scale optimization.

pytorch

Tensors and Dynamic neural networks in Python with strong GPU acceleration

CUTEST.py