Giters

Sakits / flashinfer-dev

FlashInfer: Kernel Library for LLM Serving

Home Page:https://flashinfer-ai.github.io

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

FlashInfer: Kernel Library for LLM Serving

About

FlashInfer: Kernel Library for LLM Serving

https://flashinfer-ai.github.io

License:Apache License 2.0

Languages

Language:Cuda 91.7%Language:CMake 3.7%Language:C++ 3.0%Language:Python 1.7%