pigz (parallel implementation of gzip) is a fully functional replacement for gzip that uses multiple processors and multiple cores to the hilt when compressing data.
The software compresses using threads to make use of multiple processors and cores.The input is broken up into 128 KB chunks with each compressed in parallel. The individual check value for eachc hunk is also calculated in parallel. The compressed data is written in order to the output, and a combined check value is calculated from the individual check values.
Decompression can’t be parallelized. pigz uses a single thread (the main thread) for decompression, but can create three other threads for reading, writing, and check calculation, which can speed up decompression under some circumstances.
Key Features
- Compressed data format generated is in the gzip, zlib, or single-entry zip format using the deflate compression method.
- Regulate the speed of compression. There’s the option of obtaining a few extra percent of compression using the zopfli algorithm.
- Compress blocks independently for damage recovery.
- Compress to PKWare zip (.zip) single entry format.
- Compress to zlib (.zz) format.
- Allow up to n processes (default is the number of online processors).
- Define maximum number of split blocks.
Website: zlib.net/pigz
Support: Manual, GitHub code repository
Developer: Mark Adler
License: Meets the requirements of open source
pigz is written in C. Learn C with our recommended free books and free tutorials.
Related Software
| Compression Tools | |
|---|---|
| LZ4 | Focused on compression and decompression speed |
| Zstandard | Fast compression algorithm, providing high compression ratios |
| brotli | Generic-purpose lossless compression algorithm |
| lzop | File compressor favoring speed over compression ratio |
| pigz | Parallel implementation of gzip |
| ouch | CLI tool for compressing and decompressing for various formats |
| pixz | Parallel, indexed xz compressor |
| gzip | Provides the standard GNU file compression utilities |
| BZip3 | Spiritual successor to BZip2 |
| bzip2 | Freely available, patent free, high-quality data compressor |
| PBZIP2 | Parallel implementation of bzip2 |
| lrzip | Achieve very high compression ratios and speed when used with large files |
| lbzip2 | Multi-threaded implementation of bzip2, suited for serial and parallel processing |
| plzip | Massively parallel lossless data compressor |
| p7zip-zstd | p7zip fork with additional codecs and improvements |
| 7-Zip | File archiver with a high compression ratio |
| ncompress | Fast, simple LZW file compressor |
| PXZ | Runs LZMA compression on multiple cores and processors |
| crabz | Like pigz but written in Rust |
Read our verdict in the software roundup.
| Multi-Core Compression Tools | |
|---|---|
| Zstandard | Fast compression algorithm, providing high compression ratios |
| pigz | Parallel implementation of gzip. It's a fully functional replacement for gzip |
| pixz | Parallel indexing XZ compression, fully compatible with XZ. LZMA and LZMA2 |
| PBZIP2 | Parallel implementation of the bzip2 block-sorting file compressor |
| lrzip | Compression utility that excels at compressing large files |
| lbzip2 | Parallel bzip2 compression utility, suited for serial and parallel processing |
| plzip | Massively parallel (multi-threaded) lossless data compressor based on lzlib |
| crabz | Like pigz but written in Rust |
| PXZ | Runs LZMA compression on multiple cores and processors |
Read our verdict in the software roundup.
 Explore our comprehensive directory of recommended free and open source software. Our carefully curated collection spans every major software category.This directory is part of our ongoing series of informative articles for Linux enthusiasts. It features hundreds of detailed reviews, along with open source alternatives to proprietary solutions from major corporations such as Google, Microsoft, Apple, Adobe, IBM, Cisco, Oracle, and Autodesk. You’ll also find interesting projects to try, hardware coverage, free programming books and tutorials, and much more. Discovered a useful open source Linux program that we haven’t covered yet? Let us know by completing this form. |