Taraflex / eXdupe

Ultra fast file archiver that supports data deduplication and differential backups

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

2.1 gigabyte/second

eXdupe is a fast file archiver that supports deduplication and differential backups.

It's easy to use. Let's backup the entire D drive on Windows:

exdupe d:\ d.full

Each day we can then create a new backup that only stores the changes compared to the initial backup:

exdupe -D d:\ d.full d1.diff
exdupe -D d:\ d.full d2.diff

It finds identical data blocks of 4 KB at byte grannularity positions across terabytes. Example of a backup of a Windows and a Linux virtual machine of 57,776 MB in total:

exdupe 1.1.0 zpaq64 7-Zip-flzma2 restic tar+zstd
Size 28,005 MB 29,633 MB 32,331 MB 33,518 MB 35,982 MB
Time 24 s 366 s 562 s 72 s 35 s
Options -g1 -t10 -m1 -t12 fastest default -1 -T0

Try the latest development version (backwards compatibility broken often!) that doubles the speed and improves compression ratio: Windows and Linux amd64.

Or get the latest stable version.

About

Ultra fast file archiver that supports data deduplication and differential backups


Languages

Language:C 69.1%Language:Assembly 16.9%Language:C++ 6.5%Language:Rust 4.2%Language:CMake 1.5%Language:Makefile 1.5%Language:Shell 0.1%Language:Starlark 0.1%Language:Python 0.1%Language:M4 0.1%Language:Swift 0.0%Language:Batchfile 0.0%