Giters

wenhuizhang / flashinfer

FlashInfer: Kernel Library for LLM Serving

Home Page:https://flashinfer.ai

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

FlashInfer: Kernel Library for LLM Serving

About

FlashInfer: Kernel Library for LLM Serving

https://flashinfer.ai

License:Apache License 2.0

Languages

Language:Cuda 89.5%Language:Python 4.2%Language:C++ 3.1%Language:CMake 2.7%Language:C 0.6%