Peng Tao's repositories
kata-containers
Kata Containers is an open source project and community working to build a standard implementation of lightweight Virtual Machines (VMs) that feel and perform like containers, but provide the workload isolation and security advantages of VMs. https://katacontainers.io/
cutlass
CUDA Templates for Linear Algebra Subroutines
DeepLearningSystem
Deep Learning System core principles introduction.
firecracker
Secure and fast microVMs for serverless computing.
fuse-backend-rs
Rust crate for implementing FUSE backends
grok-1
Grok open release
iree
A retargetable MLIR-based machine learning compiler and runtime toolkit.
llama.cpp
Port of Facebook's LLaMA model in C/C++
llm-inference-solutions
A collection of all available inference solutions for the LLMs
logai
LogAI - An open-source library for log analytics and intelligence
ollama
Get up and running with Llama 2 and other large language models locally
open-gpu-kernel-modules
NVIDIA Linux open GPU kernel module source
publish-crates
GitHub action to get easy publishing of Rust crates
triton
Development repository for the Triton language and compiler
vllm
A high-throughput and memory-efficient inference and serving engine for LLMs