SamurAIGPT / EmbedAI

An app to interact privately with your documents using the power of GPT, 100% privately, no data leaks

Home Page:https://www.thesamur.ai/?utm_source=github&utm_medium=link&utm_campaign=github_privategpt

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

Use up the query is very slow

gongwangwang opened this issue · comments

Use up the query is very slow, what is the way to make the query faster can try, thank you all, can use FAISS embedded database to solve the query slow

qa = RetrievalQA.from_chain_type(llm=llm, chain_type="stuff", return_source_documents=True) in return_source_documents=False whether it will improve the query speed

GPU acceleration can help, we will provide an option for that soon