Meng, Peng's repositories
AI-Software-Startups
A Survey of AI startups
Awesome-LLM-Inference
šA curated list of Awesome LLM Inference Paper with codes, TensorRT-LLM, vLLM, streaming-llm, AWQ, SmoothQuant, WINT8/4, Continuous Batching, FlashAttention, PagedAttention etc.
benchm-ml
A minimal benchmark for scalability, speed and accuracy of commonly used open source implementations (R packages, Python scikit-learn, H2O, xgboost, Spark MLlib etc.) of the top machine learning algorithms for binary classification (random forests, gradient boosted trees, deep neural networks etc.).
BigDL-core
Core HW bindings and optimizations for BigDL
Deep-Learning-Papers-Reading-Roadmap
Deep Learning papers reading roadmap for anyone who are eager to learn this amazing tech!
DeepSpeed
DeepSpeed is a deep learning optimization library that makes distributed training easy, efficient, and effective.
DistServe
Disaggregated serving system for Large Language Models (LLMs).
FasterTransformer
Transformer related optimization, including BERT, GPT
HiBench
HiBench is a big data benchmark suite.
inference
Reference implementations of inference benchmarks
Informer2020
The GitHub repository for the paper "Informer" accepted by AAAI 2021 (Best paper award).
MTCNN-Tensorflow
Reproduce MTCNN using Tensorflow
pytorch
Tensors and Dynamic neural networks in Python with strong GPU acceleration
serving
A flexible, high-performance serving system for machine learning models
spark-timeseries
A library for time series analysis on Apache Spark
tensorflow
Computation using data flow graphs for scalable machine learning
tensorrt
TensorFlow/TensorRT integration
TensorRT-1
TensorRT is a C++ library for high performance inference on NVIDIA GPUs and deep learning accelerators.
tf_unet
Generic U-Net Tensorflow implementation for image segmentation
TNN
TNN: developed by Tencent Youtu Lab and Guangying Lab, a uniform deep learning inference framework for mobilećdesktop and server. TNN is distinguished by several outstanding features, including its cross-platform capability, high performance, model compression and code pruning. Based on ncnn and Rapidnet, TNN further strengthens the support and performance optimization for mobile devices, and also draws on the advantages of good extensibility and high performance from existed open source efforts. TNN has been deployed in multiple Apps from Tencent, such as Mobile QQ, Weishi, Pitu, etc. Contributions are welcome to work in collaborative with us and make TNN a better framework.
travis-broken-example
An example that will cause a build failure
UER-py-1
Open Source Pre-training Model Framework in PyTorch & Pre-trained Model Zoo
use_vim_as_ide
use vim as IDE
wavenet_vocoder
WaveNet vocoder