marssss's repositories
Selective_Context
Compress your input to ChatGPT or other LLMs, to let them process 2x more content and save 40% memory and GPU time.
artificial_intelligence
My C++ deep learning framework & other machine learning algorithms
Awesome-LLM-Compression
Awesome LLM compression research papers and tools.
CUDA-From-Correctness-To-Performance-Code
Codes & examples for "CUDA - From Correctness to Performance"
cuda-mode-lectures
Material for cuda-mode lectures
d2l-zh
《动手学深度学习》：面向中文读者、能运行、可讨论。中英文版被70多个国家的500多所大学用于教学。
DeepSpeedExamples
Example models using DeepSpeed
gpu-optimization-workshop
Slides, notes, and materials for the workshop (cuda-mode)
how-to-optim-algorithm-in-cuda
how to optimize some algorithm in cuda.
intel-extension-for-transformers
⚡ Build your chatbot within minutes on your favorite device; offer SOTA compression techniques for LLMs; run LLMs efficiently on Intel Platforms⚡
Kcx_Learning
个人知识库，记录我的计算机科学与人工智能学习之路，终生学习，终生更新
KuiperInfer
带你从零实现一个高性能的深度学习推理库，支持Unet、Yolov5、Resnet等模型的推理。Implement a high-performance deep learning inference library step by step
llm-resource
LLM全栈优质资源汇总
LLM101n
LLM101n: Let's build a Storyteller
LLMSurvey
The official GitHub page for the survey paper "A Survey of Large Language Models".
MyTinySTL
Achieve a tiny STL in C++11
onnx-tensorrt
ONNX-TensorRT: TensorRT backend for ONNX
onnxruntime-inference-examples
Examples for using ONNX Runtime for machine learning inferencing.
puck
Puck is a high-performance ANN search engine
SpeculativeDecodingPapers
📰 Must-read papers and blogs on Speculative Decoding ⚡️
tinygrad
You like pytorch? You like micrograd? You love tinygrad! ❤️
tinyml-papers-and-projects
This is a list of interesting papers and projects about TinyML.
tlx
TLX - A Collection of Sophisticated C++ Data Structures, Algorithms, and Miscellaneous Helpers
transfomers-silicon-research
Research and Materials on Hardware implementation of Transformer Model
udlbook
Understanding Deep Learning - Simon J.D. Prince
UnderstandingDeepLearning-ZH-CN
UnderstandingDeepLearing中文翻译