MT-write r100528

Enables tar to write multiple files in parallel.
MT-write enables tar to write multiple files in parallel. The goal thereof is to speed up the proces of extracting a tar file to a filesystem.

Especially Solaris' ZFS filesystem should be able to benefit from MT-write's strategy, although I had no time to verify yet. But on a 4 processor Sun machine I was able to measure a speedup of over 60 percent with a 1GB tar file on a tmpfs.

How does MT-write work?

MT-write intercepts the executable's calls to write and friends and hands them off to worker threads. In consequence the executable will be unaware of occuring errors. If any error occures writes an errormessage to the standard error output of the executable.

How big is the benefit

Well that really depends. On Solaris' tmpfs on a 4 processor machine, I observed a speedup of over 60 percent. In contrast, ufs performance on the same machine didn't make any difference.

How do I use it? is a preloadable shared object designed to be preloaded to the tar executable. E.g. $ env tar xf mytarfile.tar

last updated on:
May 31st, 2010, 22:43 GMT
developed by:
Thomas Maier-Komor
license type:
LGPL (GNU Lesser General Public License) 
ROOT \ Utilities


In a hurry? Add it to your Download Basket!

user rating 20



Rate it!

Add your review!