Use up the query is very slow
gongwangwang opened this issue · comments
gongwangwang commented
Use up the query is very slow, what is the way to make the query faster can try, thank you all, can use FAISS embedded database to solve the query slow
gongwangwang commented
qa = RetrievalQA.from_chain_type(llm=llm, chain_type="stuff", return_source_documents=True) in return_source_documents=False whether it will improve the query speed
Anil Chandra Naidu Matcha commented
GPU acceleration can help, we will provide an option for that soon