A single-binary, GPU-accelerated LLM server (HTTP and WebSocket API) written in Rust
Geek Repo:Geek Repo
Github PK Tool:Github PK Tool