abduld

zsh-autosuggestions

Fish-like autosuggestions for zsh

TinyLlama

The TinyLlama project is an open endeavor to pretrain a 1.1B Llama model on 3 trillion tokens.

lm-evaluation-harness

A framework for few-shot evaluation of language models.

awesome-generative-ai-guide

A one stop repository for generative AI research updates, interview resources, notebooks and much more!

llama2.mojo

Inference Llama 2 in one file of pure 🔥

ctransformers

Python bindings for the Transformer models implemented in C/C++ using GGML library.

TransformerEngine

A library for accelerating Transformer models on NVIDIA GPUs, including using 8-bit floating point (FP8) precision on Hopper and Ada GPUs, to provide better performance with lower memory utilization in both training and inference.

refact

WebUI for Fine-Tuning and Self-hosting of Open-Source Large Language Models for Coding

arkos

Another rockchip Operating System

voltaML

⚡VoltaML is a lightweight library to convert and run your ML/DL deep learning models in high performance inference runtimes like TensorRT, TorchScript, ONNX and TVM.

distribution

Home of the JELOS Linux distribution.

raft

RAFT contains fundamental widely-used algorithms and primitives for machine learning and information retrieval. The algorithms are CUDA-accelerated and form building blocks for more easily writing high performance applications.

how-to-optimize-gemm

row-major matmul optimization

metal-benchmarks

Apple GPU microarchitecture

YHs_Sample

Yinghan's Code Sample

SYCLomatic

MatmulTutorial

A Easy-to-understand TensorOp Matmul Tutorial

mperf

mperf是一个面向移动/嵌入式平台的算子性能调优工具箱

NVIDIA_SGEMM_PRACTICE

Step-by-step optimization of CUDA SGEMM

Hands-on-GEMM

Elemental

Distributed-memory, arbitrary-precision, dense and sparse-direct linear algebra, conic optimization, and lattice reduction

DissectingTensorCores

NBAssembler

Assembler and Decompiler for NVIDIA (Maxwell Pascal Volta Turing Ampere) GPUs.

gccontent-benchmark

Benchmarking different languages for a simple bioinformatics task (Counting the GC fraction of DNA in a FASTA file)

amd_matrix_instruction_calculator

A tool for generating information about the matrix multiplication instructions in AMD Radeon™ and AMD Instinct™ accelerators

LLAIR

Library to manipulate Apple Metal Shading Language IR

CUDAMicroBench

llvm-tutor

A collection of out-of-tree LLVM passes for teaching and learning

MojoPkgWorkflow

This Repository shows how to use a simple GitHub Action script for compiling a mojo directory into a package.

CLASP

CoLumn-vector pruning-Aware SPmm kernel