n4ze3m / page-assist

Use your locally running AI models to assist you in your web browsing

Home Page:https://chromewebstore.google.com/detail/page-assist-a-web-ui-for/jfgfiigpkhlkbnfnbobbkinehhfdhndo

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

Ability to change keep_alive setting

vec137 opened this issue · comments

I noticed that my model is automatically offloaded from memory due to the 'keep_alive' parameter that is sent to the server. Could you please add the ability to edit or disable it, as the parameter passed through environment variables is automatically overrode by yours?
2024-05-20T14:02:31,022273693+03:00

I will add a new option for models on the Ollama settings page

thank you a lot :)

this one is a good idea

Hey, model parameter settings have been added in the v1.1.10 release. There are two ways to configure it: one, globally in the Ollama settings, and two, for the current chat by clicking the brain with the cog icon in the header.

More parameter settings will be added in upcoming updates. :)

image
image

Thanks :)