Giters

interestingLSY / swiftLLM

A tiny yet powerful LLM inference system tailored for researching purpose. vLLM-equivalent performance with only 2k lines of code (2% of vLLM).

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

Please add build and installation instructions

kalradivyanshu opened this issue · comments

commented

Great library, the triton code is interesting, I wanted to play around with SwiftLLM but there are no build/install instructions in README (the section is incomplete), how can I run the api_server to test things out?

Thank you for your work!