ghermeto / amqp-migration

Migrate between 2 AMQP brokers

This script was created to drain a queue in one broker and move all the messages to another broker.

Requirements

• Node.js 16+

Setup

• Clone the repository
• Run: npm install

Usage

$ <environment vars> npm start

Environment variables

Name	Required	Type	Description
AMQP_SOURCE_URL	YES	URL	URL for the broker you want to drain
AMQP_SOURCE_CHANNEL		number	Channel ID for a specific channel you want to use for the source broker
AMQP_SOURCE_QUEUE	YES	string	Name of the source queue to be drained
AMQP_DESTINATION_URL	YES	URL	URL for the destination broker (the one you want to get the messages)
AMQP_DESTINATION_QUEUE		string	Name of the destination queue to be populated. If not provided, script will use the incoming message exchange and routing rule
REDIS_URL		URL	URL to a cache redis instance
ENABLE_FILE_LOGGER		string	Creates one file per message to accomodate extremely large messages. String 'yes' will enabled it.
RETRY_ON_FAIL		string	Prevents the script from crashing on a catastrophic event. Retries every 2 seconds. String 'yes' will enabled it.
FILE_LOGS_PATH		path	Path to save the log files, if file logging is enabled. String 'yes' will enabled it.
PRINT_RETURNED_BODY		string	Print the message body in the console. Default no. String 'yes' will enabled it.
LOG_LEVEL		string	Console log level. 'info', 'warn', 'error' levels available. Default 'info'

Tests setup

Requirements

• Docker

Install the broker containers

$ docker pull rabbitmq:management
$ docker run -d --hostname source-mq.localhost --name source-mq -p 5672:5672 -p 15672:15672 rabbitmq:management
$ docker run -d --hostname dest-mq.localhost --name dest-mq -p 5673:5672 -p 15673:15672 rabbitmq:management

Install the Redis container

 $ docker pull redis
 $ docker run --name redis-store -p 6379:6379 -d redis

Update /etc/hosts

127.0.0.1   source-mq.localhost
127.0.0.1   dest-mq.localhost

Create the logs folder

$ mkdir /tmp/logs

Configure the source broker

On the broker source-mq.localhost (http://localhost:15672/) create:

• exchanges: test-exchange, fail-exchange
• queues: test-source, fail-queue
• bind: test-exchange -> test-source

Configure the destination broker

On the broker dest-mq.localhost (http://localhost:15673/) create:

• exchanges: test-exchange, fail-exchange, no.queue
• queues: queues: test-dest, test-source
• bind: test-exchange -> test-source; test-exchange -> test-dest

Running tests

$ npm test