Zep couldn't get session
tewnut opened this issue · comments
Describe the bug
Zep couldn't get sessions.
To Reproduce
Zep runs smoothly, but after 1 day without any trigger, it couldn't get the sessions, when I check the logs, there are multiple error messages. When restarting Zep (no need to restart postgres or nlp service), the problems went away.
Logs
time="2024-01-10T02:50:07Z" level=error msg="Error querying for message" consumer_group= err="could not query message: ERROR: relation \"watermill_offsets_message_summarizer\" does not exist (SQLSTATE 42P01)" subscriber_id=01HKPK48BT2898QWTT526R2V3F topic=message_summarizer wait_time=1s time="2024-01-10T02:50:07Z" level=error msg="Error querying for message" consumer_group= err="could not query message: ERROR: relation \"watermill_offsets_message_embedder\" does not exist (SQLSTATE 42P01)" subscriber_id=01HKPK48BTTBHEG8EPARVN0MW2 topic=message_embedder wait_time=1s time="2024-01-10T02:50:07Z" level=error msg="Error querying for message" consumer_group= err="could not query message: ERROR: relation \"watermill_offsets_message_summary_ner\" does not exist (SQLSTATE 42P01)" subscriber_id=01HKPK48BV07BSQF8NBWNY77R8 topic=message_summary_ner wait_time=1s time="2024-01-10T02:50:07Z" level=error msg="Error querying for message" consumer_group= err="could not query message: ERROR: relation \"watermill_offsets_message_summary_embedder\" does not exist (SQLSTATE 42P01)" subscriber_id=01HKPK48BVH9ZC5H7PGCCH7FQK topic=message_summary_embedder wait_time=1s time="2024-01-10T02:50:07Z" level=error msg="Error querying for message" consumer_group= err="could not query message: ERROR: relation \"watermill_offsets_message_token_count\" does not exist (SQLSTATE 42P01)" subscriber_id=01HKPK48BV6AAW07WED5KKQQFZ topic=message_token_count wait_time=1s time="2024-01-10T02:50:07Z" level=error msg="Error querying for message" consumer_group= err="could not query message: ERROR: relation \"watermill_offsets_message_intent\" does not exist (SQLSTATE 42P01)" subscriber_id=01HKPK48BTNFNDVWXZGW0YZXME topic=message_intent wait_time=1s time="2024-01-10T02:50:07Z" level=error msg="Error querying for message" consumer_group= err="could not query message: ERROR: relation \"watermill_offsets_document_embedder\" does not exist (SQLSTATE 42P01)" subscriber_id=01HKPK48BVJB4T7J7WJBT6HT20 topic=document_embedder wait_time=1s time="2024-01-10T02:50:07Z" level=error msg="Error querying for message" consumer_group= err="could not query message: ERROR: relation \"watermill_offsets_message_ner\" does not exist (SQLSTATE 42P01)" subscriber_id=01HKPK48BTZA634XQHDKDQMQAN topic=message_ner wait_time=1s
Environment (please complete the following information):
- Zep version: 0.21.0-9161f29
- Deployment: Kubernetes (I follow the configuration here: https://docs.getzep.com/deployment/kubernetes/)
Hi - it appears something is deleting your Zep tables. Please ensure that your Zep database is secured and not exposed to the public internet.