MT-write r100528

Enables tar to write multiple files in parallel.
MT-write enables tar to write multiple files in parallel. The goal thereof is to speed up the proces of extracting a tar file to a filesystem.

Especially Solaris' ZFS filesystem should be able to benefit from MT-write's strategy, although I had no time to verify yet. But on a 4 processor Sun machine I was able to measure a speedup of over 60 percent with a 1GB tar file on a tmpfs.

How does MT-write work?

MT-write intercepts the executable's calls to write and friends and hands them off to worker threads. In consequence the executable will be unaware of occuring errors. If any error occures mtwrite.so writes an errormessage to the standard error output of the executable.

How big is the benefit

Well that really depends. On Solaris' tmpfs on a 4 processor machine, I observed a speedup of over 60 percent. In contrast, ufs performance on the same machine didn't make any difference.

How do I use it?

mtwrite.so is a preloadable shared object designed to be preloaded to the tar executable. E.g. $ env LD_PRELOAD=mtwrite.so tar xf mytarfile.tar

last updated on:
May 31st, 2010, 22:43 GMT
price:
FREE!
developed by:
Thomas Maier-Komor
homepage:
www.maier-komor.de
license type:
LGPL (GNU Lesser General Public License) 
category:
ROOT \ Utilities

FREE!

In a hurry? Add it to your Download Basket!

user rating 20

3.1/5
 

0/5

Rate it!

Add your review!

SUBMIT