peterw / Chat-with-Github-Repo

This repository contains two Python scripts that demonstrate how to create a chatbot using Streamlit, OpenAI GPT-3.5-turbo, and Activeloop's Deep Lake.

Home Page:https://explodinginsights.com/

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

deeplake.util.exceptions.TensorDoesNotExistError: "Tensor 'id' does not exist."

plintner opened this issue · comments

I'm getting an error during processing. Any suggestions?

Deep Lake Dataset in hub://adrenalineuser/repo-chat already exists, loading from the storage
Traceback (most recent call last):
File "src/main.py", line 110, in
main()
File "src/main.py", line 104, in main
process_repo(args)
File "src/main.py", line 33, in process_repo
process(
File "/home/username/DevelopmentWSL/Chat-with-Github-Repo/src/utils/process.py", line 105, in process
db.add_documents(texts)
File "/home/username/.local/lib/python3.8/site-packages/langchain/vectorstores/base.py", line 72, in add_documents
return self.add_texts(texts, metadatas, **kwargs)
File "/home/username/.local/lib/python3.8/site-packages/langchain/vectorstores/deeplake.py", line 184, in add_texts
return self.vectorstore.add(
File "/home/username/.local/lib/python3.8/site-packages/deeplake/core/vectorstore/deeplake_vectorstore.py", line 230, in add
processed_tensors, id = dataset_utils.preprocess_tensors(
File "/home/username/.local/lib/python3.8/site-packages/deeplake/core/vectorstore/vector_search/dataset/dataset.py", line 254, in preprocess_tensors
if dataset and dataset[tensor_name].htype == "image":
File "/home/username/.local/lib/python3.8/site-packages/deeplake/core/dataset/dataset.py", line 506, in getitem
raise TensorDoesNotExistError(item)
deeplake.util.exceptions.TensorDoesNotExistError: "Tensor 'id' does not exist."

I am getting the same error running the ConversationalRetrievalChain.from_llm object. I'm researching a potential workaround/solution