Redis Cluster: Node Backup & Restore

Question

Redis Cluster: Node Backup & Restore

benlaplanche opened this issue 9 years ago · comments

Backups currently happen on a per node basis, so care has to be taken to ensure they do not all run BGSAVE/SAVE at the same time for performance.

Scripting also has to be in place to manually extract the RDB files and copy them away somewhere.

You also need to backup the nodes.conf file to have a chance of doing a restore.

It would be great if this was able to be triggered in a central manner.

Restore is also tricky in that it requires knowledge of the cluster topology. It sounds like you have to recreate the cluster exactly as it was to be able to restore (read drop in) the RDB files you backed up previously.

Shashwat Srivastava commented 7 years ago

+1

Mauro Murari commented 7 years ago

+1

Franklin Amorim commented 7 years ago

+1

s-aravind-flipkart commented 7 years ago

+1

vuliad commented 7 years ago

+1

Anton Klychkov commented 5 years ago

+1

tungdam commented 5 years ago

+1

Salvatore Sanfilippo · Answer 1 · Sat Mar 21 2015 00:17:44 GMT+0800 (China Standard Time)

This is planned. The idea is to have, more or less, redis-trib able to do the following:

Get the N RDB files from the master.
Create a nodes representation in a text file that is part of the backup.
Ability to restore it into a new cluster, like part of create but --from-backup.

Basically the backup will be a directory, not a file.

Would be great to have it now, but no time, but, this does not need to wait for v2. We'll get it in the course of Redis 3.0.x.

Ben Laplanche · Answer 2 · Tue Mar 24 2015 17:56:37 GMT+0800 (China Standard Time)

Sounds good and the prioritization for a later release makes sense.

@tsaleh

Salvatore Sanfilippo · Answer 3 · Tue Mar 24 2015 18:17:50 GMT+0800 (China Standard Time)

Fortunately for this specific feature we don't need to wait for the next release, since it is in the tools space, so there will be no need to touch Redis Cluster itself to start to provide support for backups. Given that's an operational big concern hopefully this will be addressed in the course of 3.0.x by back porting the feature from 3.2.0, however currently no exact scheduling.

Gleb Chermennov · Answer 4 · Thu Jul 23 2015 17:44:54 GMT+0800 (China Standard Time)

what about AOF files? will this proposal consider them too?

karthimohan · Answer 5 · Tue Feb 02 2016 07:58:19 GMT+0800 (China Standard Time)

@antirez Just wondering if Redis Cluster Backup feature is available now or do you have any approximate time frame on when this will be ready for Production use?

vuliad · Answer 6 · Sun Jul 03 2016 01:54:23 GMT+0800 (China Standard Time)

I wonder if this feature will be released in the near future?

René Klačan · Answer 7 · Tue Dec 06 2016 19:41:19 GMT+0800 (China Standard Time)

@antirez ping

StefansArya · Answer 8 · Sun Nov 17 2019 20:38:10 GMT+0800 (China Standard Time)

I think we can easily dump & zip all the cluster data to do a backup, and put the data back then restart the cluster to restore it. We will need a script to automate it..

vuliad · Answer 9 · Sun Nov 17 2019 20:52:10 GMT+0800 (China Standard Time)

I think we can easily dump & zip all the cluster data to do a backup, and put the data back then restart the cluster to restore it. We will need a script to automate it..

Such backup without downtime will be inconsistent.

StefansArya · Answer 10 · Sun Nov 17 2019 20:59:28 GMT+0800 (China Standard Time)

Just backup from the slave, not the master

vuliad · Answer 11 · Sun Nov 17 2019 21:27:48 GMT+0800 (China Standard Time)

Just backup from the slave, not the master

It's about sharding and point-in-time snapshots across multiple nodes.