Yequan Zhao's repositories
tiny-training
On-Device Training Under 256KB Memory [NeurIPS'22]
BackRazor_Neurips22
[Neurips 2022] “ Back Razor: Memory-Efficient Transfer Learning by Self-Sparsified Backpropogation”, Ziyu Jiang*, Xuxi Chen*, Xueqin Huang, Xianzhi Du, Denny Zhou, Zhangyang Wang
PETL-ViT
[ICCV 2023] Binary Adapters, [AAAI 2023] FacT, [Tech report] Convpass
awesome-model-quantization
A list of papers, docs, codes about model quantization. This repo is aimed to provide the info for model quantization research, we are continuously improving the project. Welcome to PR the works (papers, repositories) that are missed by the repo.
llama4micro
A "large" language model running on a microcontroller
EAOT
The open source implementation of "Connecting Large Language Models with Evolutionary Algorithms Yields Powerful Prompt Optimizers"
SPINN
Source code for Separable PINN
awesome-tensorial-neural-networks
A thoroughly investigated survey for tensorial neural networks.
SSF
[NeurIPS'22] This is an official implementation for "Scaling & Shifting Your Features: A New Baseline for Efficient Model Tuning".
proxylessnas
[ICLR 2019] ProxylessNAS: Direct Neural Architecture Search on Target Task and Hardware
MeZO
[NeurIPS 2023] MeZO: Fine-Tuning Language Models with Just Forward Passes. https://arxiv.org/abs/2305.17333
Torch-Pruning
[CVPR-2023] Towards Any Structural Pruning; LLaMA / YOLOv8 / CNNs / Transformers
ece_594_final
Multi-voxel pattern analyses methods based on ML & DL to decode the category of visual stimuli viewed by a human subject based on their recorded brain activity in fMRI form
PINN-without-Stacked-BP
About The official implementation of Learning Physics-Informed Neural Networks without Stacked Back-propagation (AISTATS 2023).
fwdgrad
Implementation of "Gradients without backpropagation" paper (https://arxiv.org/abs/2202.08587) using functorch
tuning_playbook
A playbook for systematically maximizing the performance of deep learning models.
local-bo-mpd
Bayesian optimization via maximizing probability of descent
poster_template
some academic posters as references. May we have in-person poster session soon!
pytorch-onn
A PyTorch Library for Photonic Integrated Circuit Simulation and Photonic AI Computing
brain-segmentation-pytorch
U-Net implementation in PyTorch for FLAIR abnormality segmentation in brain MRI
Early-Cropression-via-Gradient-Flow-Preservation
Code for Winning the Lottery Ahead of Time: Efficient Early Network Pruning (ICML 2022)
generalized-smoothing
Companion code for the ICML 2022 paper "Generalizing Gaussian Smoothing for Random Search"
ZORO
Zeroth-Order Regularized Optimization (ZORO): Approximately Sparse Gradients and Adaptive Sampling