princeton-nlp / SimCSE

[EMNLP 2021] SimCSE: Simple Contrastive Learning of Sentence Embeddings https://arxiv.org/abs/2104.08821

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

Can I load saved index to GPU?

Maydaytyh opened this issue · comments

Hi, due to the large number of sentences, it's not possible to save them all at once. Therefore, I've split them into 10 smaller files. Is it possible to load the index onto the GPU when loading? Loading into memory might still result in an overflow.

Hi,

Usually if it doesn't fit in CPU memory it won't fit in the GPU memory either. I would suggest exploring some of the index compression options in faiss

Stale issue message