llm-edge / hal-9100

Edge full-stack LLM platform. Written in Rust

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

use local llm for unit test instead of perplexity

louis030195 opened this issue Β· comments

Error: stream failed: Stream ended

πŸ™‚

solution:

https://github.com/huggingface/candle

use small llm that pass test and can run on github action

a bit related to #27

fixed
ru nning my own llm