Check failed: (!free_page_ids_.empty()) is false: The KV cache is full. No page can be allocated.
pilosof opened this issue · comments
when prompting to summarize long article or long chat
- system: macbook pro m1
- model: llama3
High-performance In-browser LLM Inference Engine
pilosof opened this issue · comments
when prompting to summarize long article or long chat