cmars / axum_mistral_candle

Chat Bot implemented in pure Rust using Mistral-7B with HuggingFace/Candle over Axum Websockets and a Leptos (Wasm) frontend!!

Axum Mistral Candle

Chat Bot implemented in pure Rust using Mistral-7B with HuggingFace/Candle over Axum Websockets and a Leptos (Wasm) frontend!

Makefile

If you are using Debian/Ubuntu you should be able to get up and running with a single make init.

View make help to see all commands.

Running Server

Axum

Websocket is on localhost:3000

Leptos

Frontend is on localhost:8080