Parallel MPI BZIP2 For Linux

Parallel MPI BZIP2 is a parallel implementation of the bzip2 block-sorting file compressor that uses MPI and achieves significant speedup on cluster machines.

The output of this version is fully compatible with bzip2 v1.0.2 or newer (ie: anything compressed with mpibzip2 can be decompressed with bzip2). MPIBZIP2 should work on any system that has a pthreads compatible C++ compiler (such as gcc). It has been tested on: Linux and Solaris.

NOTE: If you are looking for a parallel BZIP2 that works on multi-processor/muti-core/SMP machines, you should check out PBZIP2 which was designed for a multi-threaded shared-memory architecture.

Run mpibzip2 for the help listing. ================================================================== Usage: mpibzip2 [-1 .. -9] [-b#cdfktvV] < filename > < filename2 > < filenameN >

-b#: where # is the file block size in 100k (default 9 = 900k) -c : output to standard out (stdout) -d : decompress file -f : force, overwrite existing output file -k : keep input file, don't delete -t : test compressed file integrity -v : verbose mode -V : display version info for mpibzip2 then exit -1 .. -9 : set BWT block size to 100k .. 900k (default 900k)

Example: mpibzip2 -b15k myfile.tar Example: mpibzip2 -v -5 myfile.tar second*.txt Example: mpibzip2 -d myfile.tar.bz2