llm-edge / hal-9100

Edge full-stack LLM platform. Written in Rust

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

/chat/completions

louis030195 opened this issue · comments

check chat.rs

atm problem is that mistral.ai api and perplexity.ai api don't respect fully openai

so either need them to fix or cannot use async-openai for this - just use REST

need this to implement #41 btw