Compression

Parallel Archiving Techniques

The .tar.gz and .zip archive formats are quite ubiquitous and with good reason. For decades they have served as the backbone of our data archiving and transfer needs. With the advent of multi-core and multi-socket CPU architectures, little unfortunately has been done to leverage the wider number of processors. While archiving then compressing a directory may seem like the intuitive sequence, we will show how compressing files before adding them to a .