forward3d / uphold

A tool for programmatically verifying database backups

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

With large files decompression testing the backups fail in multiple ways.

damm opened this issue · comments

I ended up fixing this locally I haven't pushed up the changes to github; but with a 25gig file it seems to just take forever to untar (over 24hours) and in /tmp/uphold appears to be a bunch of insert lines from my mysqldump.

  1. Gzip doesn't use blocks so it can use up too much memory and as I have 128gigs of ram on the box I am using this on; I can load the whole 25gig into ram a few times over.
  2. Tar does the same; like I said I have enough memory to cope but that's pretty sloppy.