apauly / tiktoken-server

Docker container to expose the OpenAI tokenizer as a REST service

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

tiktoken-server

Docker container to expose the OpenAI BPE tokenizer as a REST service. Uses the tiktoken project https://github.com/openai/tiktoken

Building

docker build -t tiktoken-server .

Running

docker run -it -p5000:5000 tiktoken-server

Calling using curl

$ curl -d '{"prompt" : "hello world", "model" : "text-davinci-003"}' -H "Content-Type: application/json"  http://localhost:5000/tokenize

About

Docker container to expose the OpenAI tokenizer as a REST service

License:MIT License


Languages

Language:Python 73.9%Language:Dockerfile 26.1%