jishminor

triton

Development repository for the Triton language and compiler

llamafile

Distribute and run LLMs with a single file.

ggml

Tensor library for machine learning

amanda

data

Machine-readable data describing Arm architecture and implementations. Includes JSON descriptions of implemented PMU events.

ZLUDA

CUDA on AMD GPUs

bpftime

Userspace eBPF runtime for fast Uprobe & Syscall hook & Extensions with LLVM JIT

neon-guide

Makes ARM NEON documentation accessible (with examples)

DAMOV

DAMOV is a benchmark suite and a methodical framework targeting the study of data movement bottlenecks in modern applications. It is intended to study new architectures, such as near-data processing. Described by Oliveira et al. (preliminary version at https://arxiv.org/pdf/2105.03725.pdf)

VectorDBBench

A Benchmark Tool for VectorDB

llama

Inference code for Llama models

llama.cpp

LLM inference in C/C++

candle

Minimalist ML framework for Rust

STREAM

STREAM benchmark

tinymembench

Simple benchmark for memory throughput and latency

papi

bark

🔊 Text-Prompted Generative Audio Model

DeepLearningExamples

State-of-the-Art Deep Learning scripts organized by models - easy to train and deploy with reproducible accuracy and performance on enterprise-grade infrastructure.

alpaca-lora

Instruct-tune LLaMA on consumer hardware

optimate

A collection of libraries to optimise AI model performances

proxychains

proxychains - a tool that forces any TCP connection made by any given application to follow through proxy like TOR or any other SOCKS4, SOCKS5 or HTTP(S) proxy. Supported auth-types: "user/pass" for SOCKS4/5, "basic" for HTTP.

glow

Compiler for Neural Network hardware accelerators

inference

Reference implementations of MLPerf™ inference benchmarks

dgl

Python package built to ease deep learning on graph, on top of existing DL frameworks.

tuning_playbook

A playbook for systematically maximizing the performance of deep learning models.

pytorch

Tensors and Dynamic neural networks in Python with strong GPU acceleration

LoveIt

❤️A clean, elegant but advanced blog theme for Hugo 一个简洁、优雅且高效的 Hugo 主题

processwatch

llama_index

LlamaIndex is a data framework for your LLM applications

perfsage