Sungjae Lee's starred repositories
KoMT-Bench
Official repository for KoMT-Bench built by LG AI Research
P-tuning-v2
An optimized deep prompt tuning strategy comparable to fine-tuning across scales and tasks
NeMo-Aligner
Scalable toolkit for efficient model alignment
flash-attention
Fast and memory-efficient exact attention
trt-samples-for-hackathon-cn
Simple samples for TensorRT programming
nvcc4jupyter
A plugin for Jupyter Notebook to run CUDA C/C++ code
nvbandwidth
A tool for bandwidth measurements on NVIDIA GPUs.
GenerativeAIExamples
Generative AI reference workflows optimized for accelerated infrastructure and microservice architecture.
intel-extension-for-transformers
⚡ Build your chatbot within minutes on your favorite device; offer SOTA compression techniques for LLMs; run LLMs efficiently on Intel Platforms⚡
StableCascade
Official Code for Stable Cascade
Efficient-LLMs-Survey
[TMLR 2024] Efficient Large Language Models: A Survey
ml-engineering
Machine Learning Engineering Open Book
TensorRT-LLM
TensorRT-LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and build TensorRT engines that contain state-of-the-art optimizations to perform inference efficiently on NVIDIA GPUs. TensorRT-LLM also contains components to create Python and C++ runtimes that execute those TensorRT engines.
deepmd-kit
A deep learning package for many-body potential energy representation and molecular dynamics