Possible to stream files through an xz algorithim?

Question

Possible to stream files through an xz algorithim?

fire opened this issue 10 years ago · comments

K. S. Ernest (iFire) Lee commented 10 years ago

It may be possible to stream a part of the transfer through an xz algorithm such as https://bitbucket.org/Rawr/goxz/.

Daniel Speed · Answer 1 · Wed Jan 28 2015 00:51:58 GMT+0800 (China Standard Time)

There is some stuff missing for support of compressed blocks at the moment - particularly the block source implementation would need to translate a request for a set of blocks into a correct range in the compressed source.

Daniel Speed · Answer 2 · Mon Feb 02 2015 20:05:33 GMT+0800 (China Standard Time)

I'm working on some changes that should help to enable this by pulling the block source base lookup of the start and end of a block into an interface (which will allow compressed ranges). It would still need implementation of the compression, some extraction in the http requester and the range lookup, but that ought to enable block-based compression.

K. S. Ernest (iFire) Lee · Answer 3 · Mon Jul 20 2015 12:26:34 GMT+0800 (China Standard Time)

https://stackoverflow.com/questions/28249782/is-it-possible-to-extract-a-tar-xz-package-in-golang/31491033#31491033

This is a pure golang implementation of xz.

Daniel Speed · Answer 4 · Tue Jul 21 2015 01:34:17 GMT+0800 (China Standard Time)

I'll hopefully have a look at compression soon

K. S. Ernest (iFire) Lee · Answer 5 · Wed Oct 28 2015 17:22:06 GMT+0800 (China Standard Time)

Any updates?

Daniel Speed · Answer 6 · Fri Oct 30 2015 23:32:56 GMT+0800 (China Standard Time)

Sorry, I haven't had much time for this, and currently I can't see when I will in the next few months.
Perhaps I'll manage to squeeze some time in somehow.