Giters

lmg-anon / mikupad

LLM Frontend in a single html file

Home Page:https://lmg-anon.github.io/mikupad/mikupad.html

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

Encode/Decode request body

AlpinDale opened this issue · comments

commented

Hi! I've been trying to use mikupad with my custom OpenAI API server, but I don't have a /v1/token/encode endpoint. I was adding it, but unsure what the request body looks like from mikupad's side, and what sort of response it expects.

commented

The /v1/token/encode endpoint belongs to the tabby API. The request is a JSON object with a single text field, and the response is a list of tokens. You can also add the /v1/internal/token-count endpoint, which returns a JSON object with a length field indicating the token count.