Giters

cyx-6 / flashinfer

FlashInfer: Kernel Library for LLM Serving

Home Page:https://flashinfer-ai.github.io

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

FlashInfer: Kernel Library for LLM Serving

About

FlashInfer: Kernel Library for LLM Serving

https://flashinfer-ai.github.io

License:Apache License 2.0

Languages

Language:Cuda 92.8%Language:CMake 3.2%Language:C++ 2.6%Language:Python 1.4%