Minimize memory consumption

Question

Minimize memory consumption

Kagami opened this issue 9 years ago · comments

Kagami Hiiragi commented 9 years ago

Things currently broken:

Subtitles rendering, process hungs
Encoding the entire file, audio/last video processes hungs

Things still causing out of memory:

~400M fails at info stage
~200M fails while encoding

What can be done?

Small -max_alloc helps at info stage
-blocksize ?
Some advanced ffmpeg options/try to patch?
Compile with ALLOW_MEMORY_GROWTH, bench results?

Kagami Hiiragi · Answer 1 · Mon Aug 17 2015 22:05:12 GMT+0800 (China Standard Time)

TOTAL_MEMORY=256M for encoder and 128M for prober allows to successfully encode 600M+ files. MEMFS works with that values too but consumes much more memory.

ALLOW_MEMORY_GROWTH works as well and doesn't cause significant slowdown in nightly, though it may cause problems in v8 so let's keep it disabled for now.

It still may be worth to try advanced ffmpeg options and bigger files/different TOTAL_MEMORY values in order to decrease memory consumption even more.

Denis Zhbankov · Answer 2 · Wed Sep 27 2017 22:55:28 GMT+0800 (China Standard Time)

Any updates on this?

Brooke Vibber · Answer 3 · Wed Sep 27 2017 23:12:20 GMT+0800 (China Standard Time)

Switching build to WebAssembly should allow natural memory growth without the performance penalty from asm.js's growth mode...

Denis Zhbankov · Answer 4 · Wed Sep 27 2017 23:38:28 GMT+0800 (China Standard Time)

Thanks, @brion, worth a try.