su77ungr / CASALIOY

♾️ toolkit for air-gapped LLMs on consumer-grade hardware

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

What the use of "cleandb" in ingest ?

hippalectryon-0 opened this issue · comments

ingest.py calls Qdrant.from_documents, which itself calls client.recreate_collection, which "Delete and create empty collection with given parameters", therefore whatever we set for cleandb ("y" or "n"), the db is recreated...

From https://python.langchain.com/en/latest/modules/indexes/vectorstores/examples/qdrant.html: "Both Qdrant.from_texts and Qdrant.from_documents methods are great to start using Qdrant with LangChain, but they are going to destroy the collection and create it from scratch! If you want to reuse the existing collection, you can always create an instance of Qdrant on your own and pass the QdrantClient instance with the connection details."

Jap it is redundant at the current stage of this repo. It was used to overrun a currupted database since it reinitializes within the subtree.

Documentation was weird at that time see

Since we are still prototyping we just append it.