mihado / try-ollama

Try Ollama

Experimental Concurrency Support

sudo systemctl edit ollama
Environment="OLLAMA_HOST=0.0.0.0"
Environment="OLLAMA_NUM_PARALLEL=3"
Environemnt="OLLAMA_MAX_LOADED_MODELS=3"

sudo systemctl daemon-reload
sudo systemctl restart ollama