model-acceleration

There are 4 repositories under model-acceleration topic.

he-y / Awesome-Pruning
A curated list of neural network pruning resources.
awesome-list model-acceleration model-compression pruning
2218
htqin / awesome-model-quantization
A list of papers, docs, codes about model quantization. This repo is aimed to provide the info for model quantization research, we are continuously improving the project. Welcome to PR the works (papers, repositories) that are missed by the repo.
deep-learning quantization awesome model-compression binarization binarized-neural-networks binary-network efficient-deep-learning lightweight-neural-network model-acceleration model-quantization
1630
guan-yuan / awesome-AutoML-and-Lightweight-Models
A list of high-quality (newest) AutoML works and lightweight models including 1.) Neural Architecture Search, 2.) Lightweight Structures, 3.) Model Compression, Quantization and Acceleration, 4.) Hyperparameter Optimization, 5.) Automated Feature Engineering.
architecture-search automated-feature-engineering automl awesome-list hyperparameter-optimization meta-learning model-acceleration model-compression nas neural-architecture-search pytorch quantization quantized-neural-network quantized-training tensorflow
827
chester256 / Model-Compression-Papers
Papers for deep neural network compression and acceleration
deep-learning model-compression papers deep-neural-networks model-acceleration
393
musco-ai / musco-pytorch
MUSCO: MUlti-Stage COmpression of neural networks
cp-decomposition deep-neural-networks low-rank model-acceleration model-compression network-acceleration network-compression pytorch tensor-decomposition truncated-svd tucker vbmf
Language:Jupyter Notebook 73
wangxb96 / Awesome-AI-on-the-Edge
Resources of our survey paper "Enabling AI on Edges: Techniques, Applications and Challenges"
data-preprocessing edge-ai edge-computing efficient-algorithm machine-learning model-acceleration model-compression model-inference tiny-ml awesome-list deep-learning model-deployment model-design
38
Lee-Gihun / MicroNet_OSI-AI
(NeurIPS-2019 MicroNet Challenge - 3rd Winner) Open source code for "SIPA: A simple framework for efficient networks"
adaptive-computation compact-neural-network early-exiting micronet micronet-challenge model-acceleration model-compression neurips-2019 pruning
Language:Python 18
signalogic / SigDL
Deep Learning Compression and Acceleration SDK -- deep model compression for Edge and IoT embedded systems, and deep model acceleration for clouds and private servers
acceleration cloud compression deep-learning embedded-targets flow-diagram model-acceleration model-compression nvidia-jetson-tx2
18
sdc17 / CrossGET
[ICML 2024] CrossGET: Cross-Guided Ensemble of Tokens for Accelerating Vision-Language Transformers.
efficient-deep-learning model-acceleration multimodal-learning vision-language-transformer image-captioning visual-question-answering visual-reasoning framework transformer image-text-retrieval text-image-retrieval token-ensemble token-matching
17
cantbebetter2 / Awesome-Diffusion-Distillation
A list of papers, docs, codes about diffusion distillation.This repo collects various distillation methods for the Diffusion model. Welcome to PR the works (papers, repositories) missed by the repo.
awesome distillation diffusion-models deep-learning lightweight-neural-network model-acceleration model-compression
14
MingSun-Tse / Caffe_IncReg
[IJCNN'19, IEEE JSTSP'19] Caffe code for our paper "Structured Pruning for Efficient ConvNets via Incremental Regularization"; [BMVC'18] "Structured Probabilistic Pruning for Convolutional Neural Network Acceleration"
pruning model-compression model-acceleration
Language:Makefile 14
TaehyeonKim-pyomu / CNN_compression_rank_selection_BayesOpt
Bayesian Optimization-Based Global Optimal Rank Selection for Compression of Convolutional Neural Networks, IEEE Access
cnn-compression rank-selection bayesian-optimization cnn pytorch tensorly neural-network-compression tucker low-rank network-acceleration model-acceleration model-compression network-compression-acceleration bayesopt gpyopt convolutional-neural-networks
Language:Python 13
bnabis93 / vision-language-examples
Vision-lanugage model example code.
embedding-models example pytorch transformer tutorial vision-language vision-language-model model-acceleration model-optimization
Language:Python 7
likholat / openvino_quantization
This sample shows how to convert TensorFlow model to OpenVINO IR model and how to quantize OpenVINO model.
tensorflow openvino quantization model-conversion model-optimizer model-acceleration post-training-quantization
Language:Python 5
dhingratul / Model-Compression
Reduce the model complexity by 612 times, and memory footprint by 19.5 times compared to base model, while achieving worst case accuracy threshold.
deep-learning tensorflow memory-footprint model-complexity cnn mnist lightweight mobile-platform ensemble-model keras inception 1x1 conv1x1 model-compression model-acceleration
Language:Jupyter Notebook 4
ksm26 / Efficiently-Serving-LLMs
Learn the ins and outs of efficiently serving Large Language Models (LLMs). Dive into optimization techniques, including KV caching and Low Rank Adapters (LoRA), and gain hands-on experience with Predibase’s LoRAX framework inference server.
batch-processing deep-learning-techniques inference-optimization machine-learning-operations model-acceleration model-inference-service model-serving optimization-techniques performance-enhancement scalability-strategies server-optimization text-generation large-scale-deployment serving-infrastructure
Language:Jupyter Notebook 2