Graceful Shutdown of Workers

Question

Graceful Shutdown of Workers

leamarty opened this issue 7 years ago · comments

Since September 30, 2016, there's a new method in KCL's library (for Java) that handles very well the shutdown. Its called "requestShutdown", and it has already been implemented there.

awslabs/amazon-kinesis-client#109

We are missing that method here in Node... when KCL decides to shutdown a worker, how can we handle and perform a Graceful Shutdown? Meaning that would be cool to let the worker to finish processing the current batch, then checkpoint, and only then start the shutdown.

Justin Pfifer · Answer 1 · Fri May 19 2017 00:32:02 GMT+0800 (China Standard Time)

Currently graceful shutdown isn't supported for the MultiLang daemon clients at this time. We would like to bring support for the feature to the MultiLang daemon, and are prioritizing the feature against other feature requests.

To assist us with prioritizing this, could anyone else affected please post a reaction or comment.

chad king · Answer 2 · Sat May 27 2017 07:41:36 GMT+0800 (China Standard Time)

This should definitely be added as soon as possible.

Aaron Harris · Answer 3 · Tue Aug 01 2017 08:01:48 GMT+0800 (China Standard Time)

It appears aws-kcl v1.7.6 Added support for graceful shutdown in MultiLang Clients. @pfifer When will we see a new npm version cut that uses version ^1.7.6 which should hopefully fix this issue? Currently master points to v1.7.6 but might as well update to v1.8.0 before cutting a new npm version.

Justin Pfifer · Answer 4 · Tue Aug 01 2017 23:04:05 GMT+0800 (China Standard Time)

The changes on the node.js side have been merged in as part of #39

We have an additional change for allowing processRecords calls to be timed out that is coming, and intend to release the two changes together.