philpax / llama-http

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

llama-http

Very basic example of how you can hook up llama-rs to Axum to generate text through a HTTP server.

About


Languages

Language:Rust 100.0%