Giters

helixml / helix

Multi-node production AI stack. Run the best of open source AI easily on your own servers. Create your own AI by fine-tuning open source models. Integrate LLMs with APIs. Run gptscript securely on the server

Home Page:https://tryhelix.ai

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

[API] Pass through all openai api parameters to models

philwinder opened this issue · comments

commented

We're not passing through (at least):

  • top_p/top_k
  • temperature
  • max_tokens
  • seed
  • logit_probs
  • etc
commented

Yeah, function calling is a big one here. Need to pass function calling params back and forth too

commented

this is done now i think