rustformers / llm

[Unmaintained, see README] An ecosystem of Rust libraries for working with large language models

https://docs.rs/llm/latest/llm/

Halting inference works for session.infer but not for session.feed_prompt

clarkmcc opened this issue a year ago · comments

Clark McCauley commented a year ago

Halting inference works for session.infer but not for session.feed_prompt