Lucas Liebenwein's starred repositories
TensorRT-Incubator
Experimental projects related to TensorRT
TensorRT-Model-Optimizer
TensorRT Model Optimizer is a unified library of state-of-the-art model optimization techniques such as quantization and sparsity. It compresses deep learning models for downstream deployment frameworks like TensorRT-LLM or TensorRT to optimize inference speed on NVIDIA GPUs.
TensorRT-LLM
TensorRT-LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and build TensorRT engines that contain state-of-the-art optimizations to perform inference efficiently on NVIDIA GPUs. TensorRT-LLM also contains components to create Python and C++ runtimes that execute those TensorRT engines.
stanford_alpaca
Code and documentation to train Stanford's Alpaca models, and generate the data.
transformers
🤗 Transformers: State-of-the-art Machine Learning for Pytorch, TensorFlow, and JAX.
torchprune
A research library for pytorch-based neural network pruning, compression, and more.
mmdetection
OpenMMLab Detection Toolbox and Benchmark
ml-interviews-book
https://huyenchip.com/ml-interviews-book/
torchprofile
A general and accurate MACs / FLOPs profiler for PyTorch models