zilliztech / akcio

Akcio is a demonstration project for Retrieval Augmented Generation (RAG). It leverages the power of LLM to generate responses and uses vector databases to fetch relevant documents to enhance the quality and relevance of the output.

https://github.com/zilliztech/akcio/wiki

[Enhancement]: Add GPTCache to the project

stevennt opened this issue 10 months ago · comments

ABN Software commented 10 months ago

What would you like to be added?

It would be nice to tweak this project a bit to include GPTCache.

Thanks.

Why is this needed?

Well GPTCache reduces the API bill and also improves speed. It's also in the same Zilliz family so it is beneficial to be integrated.

Anything else?

No response