kspalaiologos / bzip3

A better and stronger spiritual successor to BZip2.

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

Suggestion: incorporation with `lrzip`

kspalaiologos opened this issue · comments

I'll let the benchmarks speak for themselves. boost.tar is all Boost versions released after 2016; around 9GB of data.

time bzip3 -e -b 32 -j 10 boost.tar
779% cpu 1926M memory 2:18.50 total

time xz -T10 -9 -k boost.tar
893% cpu 9276M memory 4:10.73 total

time lrzip -b -o boost_bzip2.tar.lrz boost.tar
186% cpu 9074M memory 1:42.16 total

time lrzip --lzma -o boost_lzma.tar.lrz boost.tar
368% cpu 9227M memory 1:54.02 total

time lrzip -n -o boost_none.tar.lrz boost.tar
126% cpu 9921M memory 1:34.04 total

time bzip3 -e -b 32 -j 10 boost_none.tar.lrz
803% cpu 1921M memory 25.667 total

% wc -c *
  222599119 boost_bzip2.tar.lrz
  210693539 boost_lzma.tar.lrz
 1221138700 boost_none.tar.lrz
  206608055 boost_none.tar.lrz.bz3
 9103636480 boost.tar
 1210129084 boost.tar.bz3
 1185929228 boost.tar.xz

Seems like bzip3 wins with lzma and bzip2, but we'd have to integrate it into lrzip to see how much it improves matters (regarding timing, etc...)

Having received response from the lrzip maintainer, closing.
lrzip is in the maintenance state and the author is hesitant to add new features.