Connection reset by peer when using llama3
james-mwakichako opened this issue · comments
James Mwakichako commented
Getting the following error when using llama3 through ollama.
/.venv/lib/python3.11/site-packages/requests/adapters.py", line 501, in send
raise ConnectionError(err, request=request)
requests.exceptions.ConnectionError: ('Connection aborted.', ConnectionResetError(54, 'Connection reset by peer'))
Here's my ModelFile
FROM llama3
# Set parameters
PARAMETER temperature 0.8
PARAMETER stop Result
# Sets a custom system message to specify the behavior of the chat assistant
# Leaving it blank for now.
SYSTEM """"""
Lennart J. Kurzweg commented
Ollama must allow connections (ORIGINS) from where you're running crew ai
James Mwakichako commented
Thank you @noggynoggy