sachaarbonel / ModelRunner

Run LLM models locally with an HTTP API

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

ModelRunner

Note

Some models require that you agree to their terms of service on Hugging Face before you can use them. This requires you to create a file containing your Hugging Face API key in your home directory under .cache/huggingface/token (on windows). See here for more info.

About

Run LLM models locally with an HTTP API

License:MIT License


Languages

Language:Rust 97.1%Language:Makefile 1.8%Language:Dockerfile 1.1%