terminate called after throwing an instance of 'std::bad_alloc'

Question

terminate called after throwing an instance of 'std::bad_alloc'

pbeneteau opened this issue 4 years ago · comments

Hi,

I managed to open the wiki_bigrams.bin pre-trained model on my personal computer without any problem (16gb RAM). However, when I try to launch it on a server (8gb RAM), I get this error in 100% of the cases:

terminate called after throwing an instance of 'std::bad_alloc' 
what():    std::bad_alloc 
Aborted

Here is my code:

    def __init__(self, fasttext_model):
        self.model = sent2vec.Sent2vecModel()
        self.model.load_model(fasttext_model)

I read that this error appears when there is no more RAM available. Any idea to fix this issue?

Paul Bénéteau · Answer 1 · Thu Feb 20 2020 23:09:13 GMT+0800 (China Standard Time)

Does it mean I need a 64Gb of RAM computer to open a 64Gb model?

Prakhar Gupta · Answer 2 · Sun Mar 01 2020 00:32:30 GMT+0800 (China Standard Time)

Hi,
Yes. You need to load the model completely on the RAM.

Paul Bénéteau · Answer 3 · Sun Mar 01 2020 00:53:43 GMT+0800 (China Standard Time)

Yeah it is what I understood too. I managed to create swap memory in order to open the file even if I don’t have enough RAM. However it is a lot slower (like 1-2min) and this solution is not viable.