MT-write r100528

Enables tar to write multiple files in parallel.

  Add it to your Download Basket!

 Add it to your Watch List!

0/5

Rate it!

What's new in MT-write r90214:

  • An issue appearing with GNU tar on Solaris and related to futimesat was fixed.
Read full changelog
send us
an update
LICENSE TYPE:
LGPL (GNU Lesser General Public License) 
USER RATING:
3.1/5 20
DEVELOPED BY:
Thomas Maier-Komor
HOMEPAGE:
www.maier-komor.de
CATEGORY:
ROOT \ Utilities
MT-write enables tar to write multiple files in parallel. The goal thereof is to speed up the proces of extracting a tar file to a filesystem.

Especially Solaris' ZFS filesystem should be able to benefit from MT-write's strategy, although I had no time to verify yet. But on a 4 processor Sun machine I was able to measure a speedup of over 60 percent with a 1GB tar file on a tmpfs.

How does MT-write work?

MT-write intercepts the executable's calls to write and friends and hands them off to worker threads. In consequence the executable will be unaware of occuring errors. If any error occures mtwrite.so writes an errormessage to the standard error output of the executable.

How big is the benefit

Well that really depends. On Solaris' tmpfs on a 4 processor machine, I observed a speedup of over 60 percent. In contrast, ufs performance on the same machine didn't make any difference.

How do I use it?

mtwrite.so is a preloadable shared object designed to be preloaded to the tar executable. E.g. $ env LD_PRELOAD=mtwrite.so tar xf mytarfile.tar

Last updated on May 31st, 2010

#write multiple files #parallel write #tar parallel writing #MT-write #parallel #write #multiple

Add your review!

SUBMIT