flowerinthenight / longsub

Package for lengthy subscriptions for SQS and Pubsub.

NOTE: GCP PubSub now supports async subscription. I recommend using that instead of this.

Overview

longsub is a small wrapper package for lengthy subscriptions for both SQS and PubSub. It will setup the subscription and attempts to extend the processing window at message level until the processing is done, or failed, or requeued. Useful if you want to keep the queue timeout relatively short (for quick message redelivery) but have the option for subscribers to have longer time to process each of the messages.

Check out the examples provided for reference on how to use the package.

Authentication

For AWS, the following environment variables will be used.

# Required
AWS_REGION
AWS_ACCESS_KEY_ID
AWS_SECRET_ACCESS_KEY

# Optional. If non-empty, package will attempt to assume this role
# using the key/secret above.
ROLE_ARN

For GCP, the path of the service account JSON file is required.

GOOGLE_APPLICATION_CREDENTIALS=/etc/longsub/svcacct.json