compmake is a non-obtrusive module that provides:
* make–like facilities to your Python computations (clean, make, etc.), including caching of temporary results (that is, you can interrupt your program, and restart it without losing (much) data.)
* A console for inspecting failures and partial completion.
* Single-host (using the multiprocessing module) and multiple-host parallelization (using ssh-spawned slaves).
* Peace of mind!
To use compmake, you have to minimally modify your Python program, such that it can understand the processing layout and the opportunities for parallelization.
Full documentation: http://compmake.org/
Product's homepage
Requirements:
· Python
Find us on Google+
