Worker threads exit prematurely when running in non-blocking mode

[Tarashish Mishra]

This is very noticeable when running memorious crawlers in multi-threaded mode. Worker threads seem to exit before the init methods starts putting jobs on the queue. The crawler ends up running on a single thread after that.