[BUG] Task HandleError error: MessageIntentTask messageTaskPayloadToMessages returned no messages

[Andrey]

Describe the bug
When I try to run Zep in docker get the following errors:

zep  | time="2023-11-10T08:56:59Z" level=error msg="Error occurred, retrying" elapsed_time=2.935469835s err="MessageNERTask messageTaskPayloadToMessages returned no messages" max_retries=5 retry_no=2 wait_time=1.718248088s
zep  | time="2023-11-10T08:57:00Z" level=debug msg="Handling task: 08f54371-62cb-4bed-a45d-686b743ac245"
zep  | time="2023-11-10T08:57:00Z" level=debug msg="MessageIntentTask called for session 879c6c77-d0a3-4662-b82c-d89d8f7129c8"
zep  | time="2023-11-10T08:57:00Z" level=debug msg="SELECT[2.165708ms]: SELECT \"m\".\"uuid\", \"m\".\"id\", \"m\".\"created_at\", \"m\".\"updated_at\", \"m\".\"deleted_at\", \"m\".\"session_id\", \"m\".\"role\", \"m\".\"content\", \"m\".\"token_count\", \"m\".\"metadata\" FROM \"message\" AS \"m\" WHERE (session_id = '879c6c77-d0a3-4662-b82c-d89d8f7129c8') AND (uuid IN ('7a9417ac-d835-4e11-b341-a935216ebe41', '866e9c0d-7594-4058-8f10-ef432f0f7067')) AND \"m\".\"deleted_at\" IS NULL"
zep  | time="2023-11-10T08:57:00Z" level=error msg="Task HandleError error: MessageIntentTask messageTaskPayloadToMessages returned no messages"
zep  | time="2023-11-10T08:57:00Z" level=error msg="Error occurred, retrying" elapsed_time=4.095127085s err="MessageIntentTask messageTaskPayloadToMessages returned no messages" max_retries=5 retry_no=3 wait_time=1.966265117s
^CGracefully stopping... (press Ctrl+C again to force)

To Reproduce
If I uncomment this lines in config.yaml

    entities:
      enabled: true
    intent:
      enabled: true

there are arrors Task HandleError error: MessageIntentTask messageTaskPayloadToMessages returned no messages.

If I comment these lines errors disappears but there are no metadata in web-ui -> sessions.

Expected behavior
Session in Zep with meta information for messages.

Logs
Please provide your Zep server and applications logs.

Environment (please complete the following information):

• Zep version: 0.17.3-88d7882 (2023-11-08T13:39:21+0000)
• Zep SDK and version: not using
• Deployment using docker compose

Additional context

config.yaml

llm:
  service: "openai"
  model: "text-embedding"
  openai_endpoint: "http://host.docker.internal:8080/v1"

nlp:
  server_url: "http://host.docker.internal:5557"

memory:
  message_window: 12

extractors:
  documents:
    embeddings:
      enabled: true
      chunk_size: 200
      dimensions: 384
      service: "openai"
  messages:
    summarizer:
      enabled: true
      entities:
        enabled: true
      embeddings:
        enabled: true
        chunk_size: 200
        dimensions: 384
        service: "openai"
    entities:
      enabled: true
    intent:
      enabled: true

store:
  type: "postgres"
  postgres:
    dsn: "postgres://postgres:postgres@localhost:5433/?sslmode=disable"

embeddings:
  enabled: true
  dimensions: 384
  model: "openai"

server:
  host: 0.0.0.0
  port: 8000
  web_enabled: true
  max_request_size: 5242880

log:
  level: "debug"

docker-compose.yaml

version: '3.5'
services:
  #############
  #  LocalAI  #
  #############
  local_ai:
    container_name: llm_local_ai
    image: llm_local_ai
    environment:
      - LOCAL_AI_PORT=${LOCAL_AI_PORT}
    build:
      context: .
      dockerfile: ./build/local_ai/Dockerfile
      args:
        DOCKER_PLATFORM: ${DOCKER_PLATFORM}
        LOCAL_AI_VERSION: ${LOCAL_AI_VERSION}
        LOCAL_AI_BUILD_TYPE: ${LOCAL_AI_BUILD_TYPE}
        LOCAL_AI_PORT: ${LOCAL_AI_PORT}
    ports:
      - "${LOCAL_AI_PORT}:${LOCAL_AI_PORT}"
    restart: unless-stopped
    stdin_open: true
    tty: true
    volumes:
      - ${PWD}/models:/local-ai/models
    healthcheck:
      test: [ "CMD", "/usr/local/bin/healthcheck.sh" ]
      timeout: 10s
      retries: 10

  #############
  #  Zep nlp  #
  #############
  zep_nlp:
    image: zep_nlp
    container_name: zep_nlp
    build:
      dockerfile: ./build/zep_nlp/Dockerfile
    environment:
      ENABLE_EMBEDDINGS: true
    ports:
      - 5557:5557
    healthcheck:
      test: timeout 10s bash -c ':> /dev/tcp/127.0.0.1/5557' || exit 1
      interval: 10s
      timeout: 5s
      retries: 5
      start_period: 45s

  ###########################
  #  Postgres (for zep)     #
  ###########################
  zep_postgres:
    container_name: zep_postgres
    image: zep_postgres
    build:
      dockerfile: ./build/zep_postgres/Dockerfile
    ports:
      - 5434:5432
    volumes:
      - ./volumes/zep_postgres_data/data:/var/lib/postgresql/data
    shm_size: "128mb"  # Increase this if vacuuming fails with a "no space left on device" error
    environment:
      POSTGRES_USER: postgres
      POSTGRES_PASSWORD: postgres
    healthcheck:
      test: [ "CMD", "pg_isready", "-q", "-d", "postgres", "-U", "postgres" ]
      interval: 5s
      timeout: 5s
      retries: 5

  #########
  #  Zep  #
  #########
  zep:
    image: zep
    container_name: zep
    build:
      dockerfile: ./build/zep/Dockerfile
    depends_on:
      zep_postgres:
        condition: service_healthy
      zep_nlp:
        condition: service_healthy
    ports:
      - "8002:8000"
    volumes:
      - ./build/zep/config.yaml:/app/config.yaml
    extra_hosts:
      - "host.docker.internal:host-gateway"
    environment:
      ZEP_STORE_TYPE: postgres
      ZEP_STORE_POSTGRES_DSN: ${ZEP_DATABASE_CONNECTION_STRING}
      ZEP_OPENAI_API_KEY: ${ZEP_OPENAI_API_KEY}
    healthcheck:
      test: timeout 10s bash -c ':> /dev/tcp/127.0.0.1/8000' || exit 1
      interval: 5s
      timeout: 10s
      retries: 3
      start_period: 40s

[Daniel Chalef]

Please would you upgrade to the latest version of Zep? v0.18.0

In addition, please correct the width of your embeddings. OpenAI embeddings are 1536 wide.

Note the 384 below.

  documents:
    embeddings:
      enabled: true
      chunk_size: 200
      dimensions: 384
      service: "openai"
  messages:
    summarizer:
      enabled: true
      entities:
        enabled: true
      embeddings:
        enabled: true
        chunk_size: 200
        dimensions: 384
        service: "openai"

[Andrey]

Thanks a lot, @danielchalef ! Now the error has disappeared.