Can I load saved index to GPU?
Maydaytyh opened this issue · comments
Hi, due to the large number of sentences, it's not possible to save them all at once. Therefore, I've split them into 10 smaller files. Is it possible to load the index onto the GPU when loading? Loading into memory might still result in an overflow.
Hi,
Usually if it doesn't fit in CPU memory it won't fit in the GPU memory either. I would suggest exploring some of the index compression options in faiss
Stale issue message