jackyzha0 / rs-openai

A Rust crate for easy serving of OpenAI's API with rate limiting and token use tracking out of the box

🦀 rs-openai

A Rust crate for easy serving of OpenAI's GPT-3 API, with rate limiting and token use tracking out of the box.

Features

• Rust crate for API access
• Base API server
• Rate Limiting based off of user ID
• Per user token tracking

Usage

Create a .env at the root of this project and fill out your API Key

GPT_KEY=...

Then run cargo run in this directory to start the server on port :8000.

With Docker

$ docker build . -t rs-openai:latest
$ docker run -p 8000:8000 rs-openai:latest