lcy-seso

DLFrameworkTest

My tests and experiments with some popular dl frameworks.

LearningNotes

My learning notes.

AI-System

System for AI Education Resource.

buddy-mlir

An MLIR-Based Ideas Landing Project

Experiment-Miscellany

Experiments with isl.

lcy-seso.github.io

Ying's learning notes.

taichi

Productive & portable high-performance programming in Python.

accelerated-scan

Accelerated First Order Parallel Associative Scan

Awesome-LLM

Awesome-LLM: a curated list of Large Language Model

awesome-tensor-compilers

A list of awesome compiler projects and papers for tensor computation and deep learning.

Carrot

cuda_hgemm

Several optimization methods of half-precision general matrix multiplication (HGEMM) using tensor core with WMMA API and MMA PTX instruction.

cutlass

CUDA Templates for Linear Algebra Subroutines

flash-attention

Fast and memory-efficient exact attention

flash-fft-conv

FlashFFTConv: Efficient Convolutions for Long Sequences with Tensor Cores

ggml

Tensor library for machine learning

GPU-Roofline-Python

llama

Inference code for LLaMA models

llama.cpp

Port of Facebook's LLaMA model in C/C++

llm-foundry

LLM training code for MosaicML foundation models

loopy

A code generator for array-based code on CPUs and GPUs

mamba

memory-efficient-attention-pytorch

Implementation of a memory efficient multi-head attention as proposed in the paper, "Self-attention Does Not Need O(n²) Memory"

MISA

Machine Intelligence Shader Autogen. AMDGPU ML shader code generator. (previously iGEMMgen)

pytorch

Tensors and Dynamic neural networks in Python with strong GPU acceleration

RWKV-LM

RWKV is an RNN with transformer-level LLM performance. It can be directly trained like a GPT (parallelizable). So it's combining the best of RNN and transformer - great performance, fast inference, saves VRAM, fast training, "infinite" ctx_len, and free sentence embedding.

SGEMM_CUDA

Fast CUDA matrix multiplication from scratch

stanford_alpaca

Code and documentation to train Stanford's Alpaca models, and generate the data.

whisper.cpp

Port of OpenAI's Whisper model in C/C++

wmma_extension

An extension library of WMMA API (Tensor Core API)