Halting inference works for session.infer but not for session.feed_prompt
clarkmcc opened this issue · comments
Halting inference works for session.infer but not for session.feed_prompt
[Unmaintained, see README] An ecosystem of Rust libraries for working with large language models
clarkmcc opened this issue · comments