joaomdmoura / crewAI

Framework for orchestrating role-playing, autonomous AI agents. By fostering collaborative intelligence, CrewAI empowers agents to work together seamlessly, tackling complex tasks.

Home Page:https://crewai.com

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

Connection reset by peer when using llama3

james-mwakichako opened this issue · comments

Getting the following error when using llama3 through ollama.


/.venv/lib/python3.11/site-packages/requests/adapters.py", line 501, in send
    raise ConnectionError(err, request=request)
requests.exceptions.ConnectionError: ('Connection aborted.', ConnectionResetError(54, 'Connection reset by peer'))

Here's my ModelFile

FROM llama3

# Set parameters

PARAMETER temperature 0.8
PARAMETER stop Result

# Sets a custom system message to specify the behavior of the chat assistant

# Leaving it blank for now.

SYSTEM """"""

Ollama must allow connections (ORIGINS) from where you're running crew ai