Process killed after eval phase

Question

Process killed after eval phase

Iambestfeed opened this issue a year ago · comments

I did try running the code from your repository; however, when I attempted to add the --save_safetensors feature, the process was interrupted after performing the evaluation. I didn't encounter any issues regarding permissions or memory problems. Do you think there might be an issue here?

Egiazarian Vage · Answer 1 · Wed Jul 05 2023 17:58:34 GMT+0800 (China Standard Time)

Hello!
Hard to tell. Can you please send the logs of the run? What was the error message?

Iambestfeed · Answer 2 · Wed Jul 05 2023 19:15:25 GMT+0800 (China Standard Time)

Hello! Hard to tell. Can you please send the logs of the run? What was the error message?

I don't keep a log, but what I see is that the message before everything stops is just 1 line "Killed"

Florian Zimmermeister · Answer 3 · Wed Jul 05 2023 19:42:18 GMT+0800 (China Standard Time)

Are you running on Linux ?
Try to increase the swap size, most times linux just print "Killed" if running out of CPU memory

Iambestfeed · Answer 4 · Wed Jul 05 2023 21:44:41 GMT+0800 (China Standard Time)

Are you running on Linux ? Try to increase the swap size, most times linux just print "Killed" if running out of CPU memory

Hmm, looks like the problem I'm having is that I'm trying to convert model 7b to a personal computer.
@Vahe1994 So can you provide specific configuration with CPU should have to convert 1 model 7b? I see that everything is only using the CPU so I also wonder why we don't use the GPU?