python-snappy
Python library for the snappy compression library from Google. This library is distributed under the New BSD License (http://www.opensource.org/licenses/bsd-license.php).
Dependencies
- cramjam
- crc32c
- Supports Python 3
Build & Install
Build:
python setup.py build
Install:
python setup.py install
Or install it from PyPi:
pip install python-snappy
Run tests
# run python snappy tests nosetest test_snappy.py # support for cffi backend nosetest test_snappy_cffi.py
Benchmarks
snappy vs. zlib
Compressing:
%timeit zlib.compress("hola mundo cruel!")
100000 loops, best of 3: 9.64 us per loop
%timeit snappy.compress("hola mundo cruel!")
1000000 loops, best of 3: 849 ns per loop
Snappy is 11 times faster than zlib when compressing
Uncompressing:
r = snappy.compress("hola mundo cruel!")
%timeit snappy.uncompress(r)
1000000 loops, best of 3: 755 ns per loop
r = zlib.compress("hola mundo cruel!")
%timeit zlib.decompress(r)
1000000 loops, best of 3: 1.11 us per loop
Snappy is twice as fast as zlib
Commandline usage
You can invoke Python Snappy to compress or decompress files or streams from the commandline after installation as follows
Compressing and decompressing a file:
$ python -m snappy -c uncompressed_file compressed_file.snappy $ python -m snappy -d compressed_file.snappy uncompressed_file
Compressing and decompressing a stream:
$ cat uncompressed_data | python -m snappy -c > compressed_data.snappy $ cat compressed_data.snappy | python -m snappy -d > uncompressed_data
You can get help by running
$ python -m snappy --help
- Snappy - compression library from Google (c)
- http://google.github.io/snappy
Frequently Asked Questions
How to install it on Mac OS X?
It has been reported a few times (Issue #7 and #23) that it can't be installed correctly the library in Mac. The procedure should be,
$ brew install snappy # snappy library from Google $ CPPFLAGS="-I/usr/local/include -L/usr/local/lib" pip install python-snappy
Try this command if libstdc++ is deprecated
$ CPPFLAGS="-I/usr/local/include -L/usr/local/lib -stdlib=libc++ " pip install python-snappy
Or this command in Apple Silicon:
$ CPPFLAGS="-I/opt/homebrew/include -L/opt/homebrew/lib" pip install python-snappy