This is a python3 version of the original snapbtrex.
This is an alpha build and does not yet consider more than one usecase. Please feel free to contribute!
snapbtrex is a small utility that keeps snapshots of btrfs filesystems and optionally send it to a remote system.
The script came originally from https://btrfs.wiki.kernel.org/index.php/SnapBtr . This is an extended version which is capable of transferring snapshots to remote systems.
You can run it regularly or once in a while, to maintain an "interesting" (see
below) set of snapshots (backups). You may manually add or remove
snapshots as you like, use snapbtrex.DATE_FORMAT
(in GMT) as
snapshot-name.
Automation is achieved with systemd. Append --setup
to your manual command together with --interval INTERVAL
to create the appropriate systemd units.
It will keep at most --target-backups
snapshots and ensure that
--target-freespace
is available on the file-system by selecting
snapshots to remove.
Using --keep-backups
, you can ensure that at least some backups are
kept, even if --target-freespace
cannot be satisfied.
snapbtrex will keep backups with exponentially increasing distance as you go back in time. It does this by selecting snapshots to remove as follows.
The snapshots to remove is selected by "scoring" each space between snapshots, (newer, older). snapbtrex will remove the older of the two snapshots in the space that have the lowest score.
The scoring mechanism integrates e^x from (now-newer) to (now-older) so, new pairs will have high value, even if they are tightly packed, while older pairs will have high value if they are far apart.
Alternatively you can also keep only the latest snapshots via --keep-only-latest
or set a maximum age for your snapshots with the --max-age
parameter.
snapbtrex uses the btrfs send and receive commands to transfer
snapshots from a sending host to a receiving host via ssh. Using --ssh-port
,
you can specify the port on which such ssh connections will be
attempted.
The receiving host has to be set up appropriately for this to work. You can always call snapbtrex as standalone script if you have appropriate rights.
Specify your target host via --remote-host
and the directory with
the --remote-dir
options. Both options have to be present. The target directory
has to be located within a btrfs file system and it has to be mounted via the
root volume, or else btrfs might fail to receive snapshots.
For transfer backups with ssh within an automated script (cronjob) you have to prepare the systems with the following steps.
1. create user snapbtr
on the remote system
sudo adduser snapbtr
2. generate ssh key on sender and copy public key to receiving machine
su - snapbtr
ssh-keygen -t rsa
ssh-copy-id snapbtr@123.45.56.78
3. create a sudoers include file at the receiving machine (use sudo visudo
)
File: /etc/sudoers.d/90_snapbtrrcv
Minimum content is this for receiving snapshots on a remote system:
The receiving host has to be set up appropriately for this to work.
snapbtr ALL=(root:nobody) NOPASSWD:NOEXEC: /bin/btrfs receive*
If you want to link the latest transferred snapshot remotely with --remote-link
then you will need another line (adopt path to your specific path):
snapbtr ALL=(root:nobody) NOPASSWD:NOEXEC: /bin/ln -sfn /path/to/backups/* /path/to/current/current-link
If you want remote pruning of snapshots via --remote-keep
option, then add this:
snapbtr ALL=(root:nobody) NOPASSWD:NOEXEC: /bin/btrfs subvolume delete*
If you created snapshots with snapbtr then those snapshots were created as read/write snapshots. The sending of snapshots to remote hosts demands that those snaps are read only. You can change rw snaps to ro snaps in the directory of the snapshots via:
sudo find . -maxdepth 1 -type d -exec btrfs property set -t s {} ro true \;
Snapshot a volume and keep 20 versions:
sudo snapbtrex.py --snap /mnt/btrfs/@subvol1/ --path /mnt/btrfs/.mysnapshots/subvol1/ --target-backups 20
Snapshot and transfer to remote host every day at 4:10 am, keep 52 snapshots on the origin host (keeps all remote backups, unless you delete them manually)
10 4 * * * snapbtr /opt/snapbtrex/snapbtrex.py --snap /mnt/btrfs/@subvol1/ --path /mnt/btrfs/.mysnapshots/subvol1/ --target-backups 52 --verbose --remote-host 123.45.56.78 --remote-dir /mnt/btrfs/.backup/subvol1/ >> /var/log/snapbtrex.log
Snapshot and transfer to remote host every day at 4:20 am, keep 10 snapshots on the origin host and keep only 50 snapshots on the remote host.
20 4 * * * snapbtr /opt/snapbtrex/snapbtrex.py --snap /mnt/btrfs/@subvol2/ --path /mnt/btrfs/.mysnapshots/subvol2/ --target-backups 10 --verbose --remote-host 123.45.56.78 --remote-dir /mnt/btrfs/.backup/subvol2/ --remote-keep 50 >> /var/log/snapbtrex.log