Xu Zhang's repositories
llama.cpp
LLM inference in C/C++
Language:C++MIT000
llvm-project
The LLVM Project is a collection of modular and reusable compiler and toolchain technologies.
Language:LLVMNOASSERTION000
note
Personal learning note
Language:C++000
python_backend
Triton backend that enables pre-process, post-processing and other logic to be implemented in Python.
Language:C++BSD-3-Clause000
pytorch
Tensors and Dynamic neural networks in Python with strong GPU acceleration
Language:PythonNOASSERTION000
server
The Triton Inference Server provides an optimized cloud and edge inferencing solution.
Language:PythonBSD-3-Clause000
torch-mlir
The Torch-MLIR project aims to provide first class support from the PyTorch ecosystem to the MLIR ecosystem.
Language:C++NOASSERTION000
triton
Development repository for the Triton language and compiler
Language:C++MIT000
vllm
A high-throughput and memory-efficient inference and serving engine for LLMs
Language:PythonApache-2.0000