lyyist

KsanaLLM

pytorch-image-models

The largest collection of PyTorch image encoders / backbones. Including train, eval, inference, export scripts, and pretrained weights -- ResNet, ResNeXT, EfficientNet, NFNet, Vision Transformer (ViT), MobileNetV4, MobileNet-V3 & V2, RegNet, DPN, CSPNet, Swin Transformer, MaxViT, CoAtNet, ConvNeXt, and more

llama2.c

Inference Llama 2 in one file of pure C

llama.cpp

LLM inference in C/C++

llama-recipes

Scripts for fine-tuning Meta Llama3 with composable FSDP & PEFT methods to cover single/multi-node GPUs. Supports default & custom datasets for applications such as summarization and Q&A. Supporting a number of candid inference solutions such as HF TGI, VLLM for local or cloud deployment. Demo apps to showcase Meta Llama3 for WhatsApp & Messenger.

llama

Inference code for Llama models

PyTorch-Tutorial

Build your neural network easy and fast, 莫烦Python中文教学

gdrcopy

A fast GPU memory copy library based on NVIDIA GPUDirect RDMA technology

llama3

The official Meta Llama 3 GitHub site

AI_Tutorial

精选机器学习，NLP，图像识别， 深度学习等人工智能领域学习资料，搜索，推荐，广告系统架构及算法技术资料整理。算法大牛笔记汇总

kaggle-api

Official Kaggle API

server

The Triton Inference Server provides an optimized cloud and edge inferencing solution.

.tmux

🇫🇷 Oh my tmux! My self-contained, pretty & versatile tmux configuration made with ❤️

ninja

a small build system with a focus on speed

onnx-tensorrt

ONNX-TensorRT: TensorRT backend for ONNX

TensorRT-LLM

TensorRT-LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and build TensorRT engines that contain state-of-the-art optimizations to perform inference efficiently on NVIDIA GPUs. TensorRT-LLM also contains components to create Python and C++ runtimes that execute those TensorRT engines.

vllm

A high-throughput and memory-efficient inference and serving engine for LLMs

jemalloc

PocketFlow

An Automatic Model Compression (AutoMC) framework for developing smaller and faster AI applications.

Efficient-PyTorch

My best practice of training large dataset using PyTorch.

mpitutorial

MPI programming lessons in C and executable code examples

flash-attention

Fast and memory-efficient exact attention

xformers

Hackable and optimized Transformers building blocks, supporting a composable construction.

leedl-tutorial

《李宏毅深度学习教程》（李宏毅老师推荐👍，苹果书🍎），PDF下载地址：https://github.com/datawhalechina/leedl-tutorial/releases

TensorRT

NVIDIA® TensorRT™ is an SDK for high-performance deep learning inference on NVIDIA GPUs. This repository contains the open source components of TensorRT.

paper-reading

深度学习经典、新论文逐段精读

AI-System-School

🚀 AI System Papers and Industry Practice. ⚡️ System for Machine Learning, LLM (Large Language Model), GenAI (Generative AI). 🍻 OSDI, NSDI, SIGCOMM, SoCC, MLSys, etc. 🗃️ Llama3, Mistral, etc. 🧑‍💻 Video Tutorials.

Python

All Algorithms implemented in Python

ultralytics

NEW - YOLOv8 🚀 in PyTorch > ONNX > OpenVINO > CoreML > TFLite

nn-zero-to-hero

Neural Networks: Zero to Hero