Support adding multiple docs at once
jhohrath opened this issue · comments
Currently, each document uploaded requires an API call to get embeddings. Due to API rate-limits, this really slows the document adding process for large corpus.
This process could be parallelized better by implementing a multiple document adding method, which aggregates texts across documents and sends them all to get embeddings in one API call.