efficient-deep-learning

There are 2 repositories under efficient-deep-learning topic.

VainF / Torch-Pruning
[CVPR 2023] DepGraph: Towards Any Structural Pruning; LLMs, Vision Foundation Models, etc.
efficient-deep-learning llm model-compression pruning transformers vision
Language:Python 3176
Efficient-ML / Awesome-Model-Quantization
A list of papers, docs, codes about model quantization. This repo is aimed to provide the info for model quantization research, we are continuously improving the project. Welcome to PR the works (papers, repositories) that are missed by the repo.
deep-learning quantization awesome model-compression binarized-neural-networks binary-network efficient-deep-learning lightweight-neural-network model-acceleration model-quantization
2262
AIoT-MLSys-Lab / Efficient-LLMs-Survey
[TMLR 2024] Efficient Large Language Models: A Survey
generative-ai large-language-models machine-learning-systems efficient-deep-learning survey
1229
MingSun-Tse / Efficient-Deep-Learning
Collection of recent methods on (deep) neural network compression and acceleration.
model-compression network-pruning knowledge-distillation deep-learning deep-neural-networks efficient-deep-learning
951
mryab / efficient-dl-systems
Efficient Deep Learning Systems course materials (HSE, YSDA)
cuda deep-learning distributed-training efficient-deep-learning machine-learning ml-infrastructure mlops pytorch
Language:Jupyter Notebook 919
chaitjo / efficient-gnns
Code and resources on scalable and efficient Graph Neural Networks (TNNLS 2023)
graph-neural-networks graph-representation-learning graph-convolutional-networks gnn efficient-deep-learning efficient-neural-networks scalable-deep-learning contrastive-learning knowledge-distillation
Language:Python 536
jerryfeng2003 / PointGST
[IEEE TPAMI] Parameter-Efficient Fine-Tuning in Spectral Domain for Point Cloud Learning
3d-point-clouds efficient-deep-learning point-cloud
Language:Python 362
xuyang-liu16 / Awesome-Generation-Acceleration
📚 Collection of awesome generation acceleration resources.
diffusion-models efficient-deep-learning efficient-inference image-generation model-acceleration text-to-image text-to-video video-generation
361
VainF / Diff-Pruning
[NeurIPS 2023] Structural Pruning for Diffusion Models
diffusion-models efficient-deep-learning model-compression network-pruning pytorch structured-pruning
Language:Python 203
Efficient-ML / Awesome-Efficient-AIGC
A list of papers, docs, codes about efficient AIGC. This repo is aimed to provide the info for efficient AIGC research, including language and vision, we are continuously improving the project. Welcome to PR the works (papers, repositories) that are missed by the repo.
aigc awesome diffusion-models distillation efficient-deep-learning generative-model large-language-models llm model-compression model-quantization pruning
199
LMD0311 / DAPT
[CVPR 2024] Dynamic Adapter Meets Prompt Tuning: Parameter-Efficient Transfer Learning for Point Cloud Analysis
cvpr2024 efficient-deep-learning 3d-point-clouds point-cloud
Language:Python 177
xuyang-liu16 / Awesome-Token-level-Model-Compression
📚 Collection of token-level model compression resources.
computer-vision efficient-deep-learning model-acceleration model-compression token-merging token-pruning token-compression
177
LayneH / GreenMIM
[NeurIPS2022] Official implementation of the paper 'Green Hierarchical Vision Transformer for Masked Image Modeling'.
efficient-deep-learning masked-image-modeling pytorch self-supervised-learning vision-transformer
Language:Python 173
Sharath-girish / efficientgaussian
Official implementation of "EAGLES: Efficient Accelerated 3D Gaussians with Lightweight EncodingS"
compression computer-graphics computer-vision efficient-deep-learning gaussian-splatting novel-view-synthesis
Language:C++ 167
tiingweii-shii / Awesome-Resource-Efficient-LLM-Papers
a curated list of high-quality papers on resource-efficient LLMs 🌱
large-language-models machine-learning resource-efficient efficient-deep-learning generative-ai machine-learning-systems survey
147
yhlleo / VTs-Drloc
[NeurIPS 2021] Official codes for "Efficient Training of Visual Transformers with Small Datasets".
efficient-deep-learning self-supervised-learning vision-transformer
Language:Python 144
AIoT-MLSys-Lab / Efficient-Diffusion-Model-Survey
[TMLR 2025] Efficient Diffusion Models: A Survey
diffusion-models efficient-deep-learning generative-ai machine-learning-systems survey
127
LauzHack / deep-learning-bootcamp
LauzHack Deep Learning Bootcamp
audio-processing computer-vision deep-learning deeprl efficient-deep-learning explainable-ai natural-language-processing on-device-learning
Language:Jupyter Notebook 114
FrancoisPorcher / awesome-ai-tutorials
The best collection of AI tutorials to make you a boss of Data Science!
ai artificial-intelligence bayesian-inference cloud cloud-computing computer-vision data-science efficient-deep-learning llm mlops natural-language-processing programming technology tutorial
Language:Python 104
mlvlab / EfficientViM
[CVPR 25] Official Implementation (Pytorch) of "EfficientViM: Efficient Vision Mamba with Hidden State Mixer-based State Space Duality"
computer-vision cvpr2025 efficient-deep-learning vision-mamba
Language:Python 98
gmh14 / data_efficient_grammar
[ICLR 2022] Data-Efficient Graph Grammar Learning for Molecular Generation
grammar-learning molecule-generation graph-learning efficient-deep-learning graph-neural-networks formal-languages symbolic-representation
Language:Jupyter Notebook 97
OPTML-Group / DeepZero
[ICLR'24] "DeepZero: Scaling up Zeroth-Order Optimization for Deep Model Training" by Aochuan Chen*, Yimeng Zhang*, Jinghan Jia, James Diffenderfer, Jiancheng Liu, Konstantinos Parasyris, Yihua Zhang, Zheng Zhang, Bhavya Kailkhura, Sijia Liu
zeroth-order-optimization ai4science blackbox-optimization efficient-deep-learning
Language:Python 65
HayeonLee / MetaD2A
Official PyTorch implementation of "Rapid Neural Architecture Search by Learning to Generate Graphs from Datasets" (ICLR 2021)
efficient-deep-learning machine-learning meta-learning neural-architecture-search pytorch
Language:Python 64
HayeonLee / HELP
Official PyTorch Implementation of HELP: Hardware-adaptive Efficient Latency Prediction for NAS via Meta-Learning (NeurIPS 2021 Spotlight)
hardware-aware neural-architecture-search efficient-deep-learning meta-learning deep-learning machine-learning
Language:Python 63
EnVision-Research / DDSM
Denoising Diffusion Step-aware Models (ICLR2024)
diffusion-models efficient-deep-learning iclr2024 image-generation model-pruning
Language:Python 62
thu-nics / FrameFusion
[ICCV'25] The official code of paper "Combining Similarity and Importance for Video Token Reduction on Large Visual Language Models"
efficient-deep-learning llm lvlm video
Language:Python 60
MingSun-Tse / Awesome-Pruning-at-Initialization
[IJCAI'22 Survey] Recent Advances on Neural Network Pruning at Initialization.
efficient-deep-learning model-compression neural-network-pruning pruning-at-initialization
59
OSUPCVLab / MobileUNETR
Official Implementation of MobileUNETR: A Lightweight End-To-End Hybrid Vision Transformer For Efficient Medical Image Segmentation (ECCV2024) (Oral)
efficient-deep-learning isic-2016 isic-2017 isic-2018 ph2-dataset segmentation transformers
Language:Python 57
BeSpontaneous / FFN-pytorch
Frame Flexible Network (CVPR2023)
action-recognition efficient-deep-learning parameter-efficient video-recognition
Language:Python 56
MingSun-Tse / Awesome-Efficient-ViT
Recent Advances on Efficient Vision Transformers
efficient-deep-learning model-compression transformers vision-transformers attention-is-all-you-need fast-attention efficient-vision-transformers
54
NoakLiu / FastCache-xDiT
FastCache: Fast Caching for Diffusion Transformer Through Learnable Linear Approximation [Efficient ML Model]
cache diffusion transformers efficientml diffusion-transformers efficient-deep-learning linear-algorithms
Language:Python 45
ROIM1998 / APT
[ICML'24 Oral] APT: Adaptive Pruning and Tuning Pretrained Language Models for Efficient Training and Inference
bert efficient-deep-learning llama2 llm llm-finetuning peft peft-fine-tuning-llm pruning roberta t5
Language:Python 45
MingSun-Tse / Why-the-State-of-Pruning-so-Confusing
[Preprint] Why is the State of Neural Network Pruning so Confusing? On the Fairness, Comparison Setup, and Trainability in Network Pruning
network-pruning efficient-deep-learning model-compression sparsity
40
negarhdr / skeleton-based-action-recognition
This repository provides implementation of a baseline method and our proposed methods for efficient Skeleton-based Human Action Recognition.
deep-learning efficient-deep-learning graph-convolutional-networks human-action-recognition pytorch
Language:Python 37
AIoT-MLSys-Lab / Famba-V
[ECCV 2024 Workshop Best Paper Award] Famba-V: Fast Vision Mamba with Cross-Layer Token Fusion
efficient-deep-learning large-language-models mamba-model
Language:Python 34
MingSun-Tse / TPP
[ICLR'23] Trainability Preserving Neural Pruning (PyTorch)
efficient-deep-learning network-pruning model-compression regularization trainability trainability-preserving-pruning
Language:Python 34

efficient-deep-learning

VainF / Torch-Pruning

Efficient-ML / Awesome-Model-Quantization

AIoT-MLSys-Lab / Efficient-LLMs-Survey

MingSun-Tse / Efficient-Deep-Learning

mryab / efficient-dl-systems

chaitjo / efficient-gnns

jerryfeng2003 / PointGST

xuyang-liu16 / Awesome-Generation-Acceleration

VainF / Diff-Pruning

Efficient-ML / Awesome-Efficient-AIGC

LMD0311 / DAPT

xuyang-liu16 / Awesome-Token-level-Model-Compression

LayneH / GreenMIM

Sharath-girish / efficientgaussian

tiingweii-shii / Awesome-Resource-Efficient-LLM-Papers

yhlleo / VTs-Drloc

AIoT-MLSys-Lab / Efficient-Diffusion-Model-Survey

LauzHack / deep-learning-bootcamp

FrancoisPorcher / awesome-ai-tutorials

mlvlab / EfficientViM

gmh14 / data_efficient_grammar

OPTML-Group / DeepZero

HayeonLee / MetaD2A

HayeonLee / HELP

EnVision-Research / DDSM

thu-nics / FrameFusion

MingSun-Tse / Awesome-Pruning-at-Initialization

OSUPCVLab / MobileUNETR

BeSpontaneous / FFN-pytorch

MingSun-Tse / Awesome-Efficient-ViT

NoakLiu / FastCache-xDiT

ROIM1998 / APT

MingSun-Tse / Why-the-State-of-Pruning-so-Confusing

negarhdr / skeleton-based-action-recognition

AIoT-MLSys-Lab / Famba-V

MingSun-Tse / TPP