Why do I always encounter CUDA out of memory problem when I load the load_model_process function? Can the RTX 3090 be used for the BLIP-2 model?"
zhangmenghuan-mh opened this issue · comments
Why do I always encounter CUDA out of memory problem when I load the load_model_process function? Can the RTX 3090 be used for the BLIP-2 model?"
Yes, I'm using mine for that right now. More information may be needed to help, I know transformers version is an extremely common issue plaguing people. Specifically I'm using it for image captioning though so perhaps some nuance on your task may be in play here.