Random 500: Expecting ',' delimiter: line 1 column 7011 (char 7010)

[GabrielLanghans]

Hello and congratulations for this amazing project :)

I'm facing some issues while running on local models (actually not tested with non local).
The search allways works but the AI insights rarely works. What happens most of the time is that it starts to type but aventually, before finish, it throws an error like this: 500: Expecting ',' delimiter: line 1 column 7011 (char 7010)
It's allways a different column though.
I have tested with llama3 and mistral over ollama and I'm using searxng.

docker-compose.yml:
`services:
backend:
build:
context: .
dockerfile: ./src/backend/Dockerfile
restart: unless-stopped
ports:
- "8004:8000"
environment:
- OLLAMA_HOST=${OLLAMA_HOST}
- TAVILY_API_KEY=${TAVILY_API_KEY}
- BING_API_KEY=${BING_API_KEY}
- SERPER_API_KEY=${SERPER_API_KEY}
- OPENAI_API_KEY=${OPENAI_API_KEY}
- GROQ_API_KEY=${GROQ_API_KEY}
- ENABLE_LOCAL_MODELS=${ENABLE_LOCAL_MODELS}
- SEARCH_PROVIDER=${SEARCH_PROVIDER}
- SEARXNG_BASE_URL=${SEARXNG_BASE_URL:-http://host.docker.internal:8099}
- REDIS_URL=${REDIS_URL}
develop:
watch:
- action: sync
path: ./src/backend
target: /workspace/src/backend
extra_hosts:
- "host.docker.internal:host-gateway"
frontend:
depends_on:
- backend
build:
context: .
dockerfile: ./src/frontend/Dockerfile
restart: always
environment:
- NEXT_PUBLIC_API_URL=${NEXT_PUBLIC_API_URL}
- NEXT_PUBLIC_LOCAL_MODE_ENABLED=${NEXT_PUBLIC_LOCAL_MODE_ENABLED}
ports:
- "3005:3000"
develop:
watch:
- action: sync
path: ./src/frontend
target: /app
ignore:
- node_modules/

searxng:
container_name: searxngfarfalle
image: docker.io/searxng/searxng:latest
restart: unless-stopped
ports:
- "8099:8080"
volumes:
- ./searxng:/etc/searxng:rw
environment:
- SEARXNG_BASE_URL=https://192.168.60.260:8099/`

.env
ENABLE_LOCAL_MODELS=True OLLAMA_HOST=http://192.168.60.234:11434 SEARCH_PROVIDER=searxng #SEARXNG_BASE_URL=http://searxng:8090 NEXT_PUBLIC_API_URL=http://192.168.60.260:8004 NEXT_PUBLIC_LOCAL_MODE_ENABLED=true

Error Log:

[ProjectMoon]

This is probably duplicate of #37