openai-triton

There are 1 repository under openai-triton topic.

ModelTC / lightllm
LightLLM is a Python-based LLM (Large Language Model) inference and serving framework, notable for its lightweight design, easy scalability, and high-speed performance.
deep-learning gpt llama llm model-serving nlp openai-triton
Language:Python 2101
chengzeyi / stable-fast
Best inference performance optimization framework for HuggingFace Diffusers on NVIDIA GPUs.
cuda diffusers pytorch stable-diffusion deeplearnng inference-engines openai-triton performance-optimizations torch stable-video-diffusion
Language:Python 1061
BobMcDear / attorch
A subset of PyTorch's neural network modules, written in Python using OpenAI's Triton.
cuda deep-learning machine-learning openai openai-triton pytorch triton
Language:Python 423
DeepAuto-AI / hip-attention
Training-free Post-training Efficient Sub-quadratic Complexity Attention. Implemented with OpenAI Triton.
attention attention-mechanism openai-triton sub-quadratic-attention triton hip-attention
Language:Python 7

ModelTC / lightllm