Giters

AIAnytime / LLM-Inference-API-in-Rust

LLM Inference API in Rust. It also has a streamlit app that requests the running API in Rust.

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

LLM-Inference-API-in-Rust

LLM Inference API in Rust. It also has a streamlit app that requests the running API in Rust.

About

LLM Inference API in Rust. It also has a streamlit app that requests the running API in Rust.

License:MIT License

Languages

Language:Rust 83.2%Language:Python 16.8%