taozeyi1990

conv_arithmetic

A technical report on convolution arithmetic in the context of deep learning

FedML

FEDML - The unified and scalable ML library for large-scale distributed training, model serving, and federated learning. FEDML Launch, a cross-cloud scheduler, further enables running any AI jobs on any GPU cloud or on-premise cluster. Built on this library, FEDML Nexus AI (https://fedml.ai) is your generative AI platform at scale.

darts

Differentiable architecture search for convolutional and recurrent networks

ENAS-pytorch

PyTorch implementation of "Efficient Neural Architecture Search via Parameters Sharing"

Awesome-Knowledge-Distillation

Awesome Knowledge-Distillation. 分类整理的知识蒸馏paper(2014-2021)。

neural-tangents

Fast and Easy Infinite Neural Networks in Python

pytorch-distributed

A quickstart and benchmark for pytorch distributed training.

torchquantum

A PyTorch-based framework for Quantum Classical Simulation, Quantum Machine Learning, Quantum Neural Networks, Parameterized Quantum Circuits with support for easy deployments on real quantum computers.

wide-resnet.pytorch

Best CIFAR-10, CIFAR-100 results with wide-residual networks using PyTorch

FedMA

Code for Federated Learning with Matched Averaging, ICLR 2020.

backdoor_federated_learning

Source code for paper "How to Backdoor Federated Learning" (https://arxiv.org/abs/1807.00459)

invertinggradients

Algorithms to recover input data from their gradient signal through a neural network

unnpk

解包网易游戏NeoX引擎NPK文件，如阴阳师、魔法禁书目录。

DNA

(CVPR 2020) Block-wisely Supervised Neural Architecture Search with Knowledge Distillation

fitting-random-labels

Example code for the paper "Understanding deep learning requires rethinking generalization"

apollo

Apollo: An Adaptive Parameter-wise Diagonal Quasi-Newton Method for Nonconvex Stochastic Optimization

NTK

Code for experiments in my blog post on the Neural Tangent Kernel: https://rajatvd.github.io/NTK

SNAS-Series

This repo contains the PyTorch implementation of the SNAS-Series papers

FedMD_clean

FedMD: Heterogenous Federated Learning via Model Distillation

CNTK

Convolutional Neural Tangent Kernel

federated-learning-on-raspberry-pi

This project implements the OpenMined tutorials and simulates the distributed model training process using 2 RPIs(Raspberry Pi).

federated-learning

A distributed fedrated learning system on the blockchain.

gradfeat20

Gradients as Features for Deep Representation Learning

federated-pytorch-test

Federated learning with PyTorch (federated averaging and consensus optimization): with 'reduced' bandwidth

ATOMO

Atomo: Communication-efficient Learning via Atomic Sparsification

FederatedLearning

CKN-Pytorch-image

CKN for images

nondeep

holdout-sgd

Byzantine Resilient Federated Learning

AEGD

Adaptive gradient descent with energy