This is a collection of decompression routines for ancient formats popular in the Amiga, Atari computers (and others) from 80's and 90's as well as including some current ones that were used in a some specific way in these systems.
For simple usage both a simple command line application as well as a simple API to use the decompressors are provided. The compression algorithm is automatically detected in most cases, however there are some corner cases where it is not entirely reliable due to weaknesses in the old format used. Please see the main.cpp and Decompressor.hpp to get an idea.
Even though most of these algorithms are still available for download, scavenging and using them might prove to be a challenge. Thus the purpose of this project is to:
- Provide a clean, modern implementation of the algorithms - Typically the implementations were not meant to be used outside of the original systems they were made for. Some other ported implementations are incomplete, bad quality or direct translations from old M68K assembly code.
- Provide a clean BSD-style licensing - Original implementations or their ports might have strange license or no visible license at all. There are also implementations that have been ripped off from some other source thus their legality is questionable at best.
- Provide a tested implementation - The code is no good if it does not work properly and the old code has a lot of corner cases. The implementation is tested using the cache of available files (~10k) that used these algorithms. Although it does not offer any guarantee especially when we are talking about undocumented formats, it gives hope that there are less "stupid errors" in the code.
This code should compile cleanly on any C++14 capable compiler, and it is tested on clang. Since it does not use lot of C++14 features, you might have luck compiling it with C++11 capable compiler if it has some rudimentary C++14 support.
Currently there are no plans to add password protected file support nor any kind of decryption capability. (apart from some very basic password bypassing in some formats that can be done easily)
Decompression algorithms provided:
- CrunchMania by Thomas Schwarz: supports both new (version 2) and old stream formats:
- CrM!: Crunch-Mania standard-mode
- Crm!: Crunch-Mania standard-mode, sampled
- CrM2: Crunch-Mania LZH-mode
- Crm2: Crunch-Mania LZH-mode, sampled
- Disk Masher System a.k.a. DMS
- Supports all different compression methods (NONE,SIMPLE,QUICK,MEDIUM,DEEP,HEAVY1,HEAVY2)
- Supports password bypassing
- File Imploder (and most of its clones), specifically with following headers:
- IMP!
- ATN!
- BDPI
- CHFI
- Dupa (verification missing)
- EDAM (verification missing)
- FLT! (verification missing)
- M.H. (verification missing)
- PARA (verification missing)
- RDC9 (verification missing)
- PowerPacker
- PP 1.1 (verification missing)
- PP 2.0
- Rob Northen compressors. supports all 3 known formats:
- RNC1: Both old and formats utilizing the same header. heuristics for detecting the current one
- RNC2: RNC version 2 stream
- Turbo Packer by Wolfgang Mayerle.
- Standard gzip (only ancient in context of XPK)
- Standard bzip2, both normal and randomized (only ancient in context of XPK)
- Zip decompressor backend (decompressor only, no Zip file format reading yet) with following methods
- Shrink
- Reduce
- Implode
- Deflate
- Deflate64
- Bzip2
- Lha/Lzh decompressor backend (decompressor only, no Lha file format reading yet) with following methods
- LH1
- LH2
- Supports opening XPK-encapsulated files. XPK decompressors supported are:
- ACCA: Andre's Code Compression Algorithm
- BLZW: LZW-compressor
- BZP2: Bzip2 backend for XPK
- CBR0: RLE compressor
- CRM2: CrunchMania backend for XPK
- CRMS: CrunchMania backend for XPK, sampled
- CYB2: xpkCybPrefs container
- DLTA: Delta encoding
- DUKE: NUKE with Delta encoding
- ELZX: LZX-compressor
- FAST: LZ77-compressor
- FBR2: CyberYAFA compressor
- FRHT: LZ77-compressor
- FRLE: RLE compressor
- GZIP: Deflate backend for XPK
- HUFF: Huffman modeling compressor
- HFMN: Huffman modeling compressor
- ILZR: Incremental Lempel-Ziv-Renau compressor
- IMPL: File Imploder backend for XPK
- LHLB: LZRW-compressor
- LIN1: Lino packer
- LIN2: Lino packer
- LIN3: Lino packer
- LIN4: Lino packer
- LZBS: CyberYAFA compressor
- LZW2: CyberYAFA compressor
- LZW3: CyberYAFA compressor
- LZW4: CyberYAFA compressor
- LZW5: CyberYAFA compressor
- MASH: LZRW-compressor
- NONE: Null compressor
- NUKE: LZ77-compressor
- PWPK: PowerPacker backend for XPK
- RAKE: LZ77-compressor
- RDCN: Ross Data Compression
- RLEN: RLE compressor
- SDHC: Sample delta huffman compressor
- SHR3: LZ-compressor with arithmetic encoding
- SHRI: LZ-compressor with arithmetic encoding
- SLZ3: CyberYAFA compressor
- SLZX: LZX-compressor with delta encoding
- SMPL: Huffman compressor with delta encoding
- SQSH: Compressor for sampled sounds
- TDCS: LZ77-compressor
- ZENO: LZW-compressor
Special thanks go to Cholok for providing me references to many of the XPK-compressors.
I'm slowly adding new stuff. If your favorite is not listed contact me and maybe I can add it.
Current work in progress
- Completing XPK: ARTM, DCMB, DMCU (maybe), LZCB, PPMQ, SASC, SHSC
- Support for MMCMP, StoneCracker
- Disk images support for Warp and DiskSqueeze
Not planned:
- PPC only XPK compressors
Wishlist:
- More files for my testbench
- More DMS images
- XPK DMCI and DMCD compressors. I can't find it anywhere or find anyone who knows anything about it. Would be fun to add it for completeness
- XPK TLTA compressor/encoder. ditto.
- XPK CBR1 compressor. Is this a thing? Probably not but I'd like to get my hands on the actual library to see it myself.
Feedback: tz at iki dot fi