emranio / gpt-j-api-huggingface

gpt-j-api-huggingface 🤗

An API to interact with the GPT-J language model in Huggingface!

Launching the server

To launch the API server simply run:

python3 server.py

To launch the API server with dynamic batching run:

python3 server_batch.py

Using the API

Execute the following commands to run an example in the preferred language:

CURL

bash examples/curl_example.bash

Python

python3 examples/python_example.py

Javascript

cd examples
yarn add axios
node javascript_example.js