scaleapi / llm-engine

Scale LLM Engine public repository

Home Page:https://llm-engine.scale.com

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

[Feature Request] Add token log probabilities to response

jenkspt opened this issue · comments

This is a feature request to add token log probabilities to the response of a Completion.create call.
cc: @yunfeng-scale

commented

This has been deployed, closing this out.