Giters

AkariAsai / self-rag

This includes the original implementation of SELF-RAG: Learning to Retrieve, Generate and Critique through self-reflection by Akari Asai, Zeqiu Wu, Yizhong Wang, Avirup Sil, and Hannaneh Hajishirzi.

Home Page:https://selfrag.github.io/

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

Use Self-RAG with vector databases

casper-hansen opened this issue · comments

commented

The ability to retrieve from a vector database is often how RAG is used in applications. Could you please look into adding langchain or llamaindex support on top to leverage e.g. a Pinecone, Milvus, or Chroma vector store?

commented

I am preparing an out of the box solution if you are interested

commented

I am preparing an out of the box solution if you are interested

Definitely interested!

commented

Awesome, I just put a comment here about what I am working on regarding this.

Would love to hear your thoughts in that thread

commented

Sorry for my late response, I am currently not plannig to integrate vector DB such as Chroma -- I tried once and found the indexing process was quite slow for 30M passage scale as in the entire English Wikipedia but I might have tried some techniques to enhance the efficiency. The solution by @emrgnt-cmplxty looks really nice, and recommend to check it out!