hwang595

ps_pytorch

implement distributed machine learning with Pytorch + OpenMPI

Cuttlefish

The implementation for MLSys 2023 paper: "Cuttlefish: Low-rank Model Training without All The Tuning"

PyTorch-parameter-server

Implementation of Parameter Server using PyTorch communication lib

ATOMO

Atomo: Communication-efficient Learning via Atomic Sparsification

Draco

DRACO: Byzantine-resilient Distributed Training via Redundant Gradients

DETOX

DETOX: A Redundancy-based Framework for Faster and More Robust Gradient Aggregation

ErasureHead

distributed gradient descent using approximate coding to mitigate stragglers

Pufferfish

The implementation for MLSys 2021 paper: "Pufferfish: Communication-efficient Models At No Extra Cost"

ML-material

Useful machine learning materials

FoE-ICLR2024

The implementation of FoE for ICLR 2024

data_augmentation_playground

validation and initial experiments for data augmentation

distributed-MXNet

distributed networks on MXNet

DistributedMNIST

Distributed MNIST using Tensorflow

BasicSR

Open Source Image and Video Restoration Toolbox for Super-resolution, Denoise, Deblurring, etc. Currently, it includes EDSR, RCAN, SRResNet, SRGAN, ESRGAN, EDVR, etc. Also support StyleGAN2, DFDNet.

CSrankings

A web app for ranking computer science departments according to their research output in selective venues.

DeepLearningImplementations

Implementation of recent Deep Learning papers

examples

A set of examples around pytorch in Vision, Text, Reinforcement Learning, etc.

hwang595.github.io

Github Pages template for academic personal websites, forked from mmistakes/minimal-mistakes

modified-pytorch-cifar

Adapted from https://github.com/kuangliu/pytorch-cifar

NLP

This is where I put all my work in Natural Language Processing

open_lth

A repository in preparation for open-sourcing lottery ticket hypothesis code.

probabilistic-federated-neural-matching

Bayesian Nonparametric Federated Learning of Neural Networks

provML

provML

pytorch-cifar

95.16% on CIFAR10 with PyTorch

pytorch_ps_mpi

PyTorch parameter server with MPI

sailing-lab.github.io

svd-tf-playground

svd in tensorflow

TensorFlow_Revised_Models

revised_models

TF-Pytorch-comparison

comparison of performances between Tensorflow and Pytorch

WideResNet-pytorch

Wide Residual Networks (WideResNets) in PyTorch