Compression

pigz – parallel implementation of gzip

pigz, short for Parallel Implementation of GZip, is a command-line compressor developed by Mark Adler. It uses multiple CPU cores to accelerate gzip-compatible compression while retaining a familiar command-line workflow.

The program divides its input into blocks, compresses those blocks concurrently and writes the results in the correct order. This makes pigz particularly useful when compressing large files on modern multicore systems.

Its decompression implementation is different from its compression engine. pigz normally uses one thread for the actual Deflate decompression, although separate threads can assist with reading, writing and checksum calculation. The distinction matters when comparing pigz with tools specifically designed for parallel decompression.

This is free and open source software.

Key Features

  • Parallel compression using multiple processors or CPU cores.
  • Adjustable number of compression threads.
  • Configurable compression block sizes.
  • Produces standard gzip-compatible compressed data.
  • Can create zlib streams and single-entry ZIP archives.
  • Supports higher compression settings using Zopfli optimisation.
  • Offers independent compression blocks to improve damaged-data recovery.
  • Includes an rsync-friendly mode with input-dependent block boundaries.
  • Processes files recursively through directory trees.
  • Supports compression and decompression through standard streams.
  • Tests compressed input for data integrity.
  • Lists compressed file information without extracting the data.
  • Provides options for retaining input files and controlling stored timestamps and filenames.
  • Includes the unpigz command for decompression.

Website: zlib.net/pigz
Support:
Developer: Mark Adler
License: zlib License

pigz is written in C. Learn C with our recommended free books and free tutorials.


Related Software

Compression Tools
LZ4Focused on compression and decompression speed
ZstandardFast compression algorithm, providing high compression ratios
brotliGeneric-purpose lossless compression algorithm
lzopFile compressor favoring speed over compression ratio
pigzParallel implementation of gzip
ouchCLI tool for compressing and decompressing for various formats
pixzParallel, indexed xz compressor
gzipProvides the standard GNU file compression utilities
BZip3Spiritual successor to BZip2
bzip2Freely available, patent free, high-quality data compressor
PBZIP2Parallel implementation of bzip2
lrzipAchieve very high compression ratios and speed when used with large files
lbzip2Multi-threaded implementation of bzip2, suited for serial and parallel processing
ZXCHigh-performance lossless compression library and command-line tool
plzipMassively parallel lossless data compressor
p7zip-zstdp7zip fork with additional codecs and improvements
7-ZipFile archiver with a high compression ratio
ncompressFast, simple LZW file compressor
PXZRuns LZMA compression on multiple cores and processors
crabzLike pigz but written in Rust
LzipLossless data compressor aimed at Unix-like systems
cmixOptimize compression ratio at the cost of high CPU/memory usage
bscHigh-performance block-sorting compressor for large files
rapidgzipParallelized decompression of gzip files
KanziModular lossless compressor with multithreaded processing

Read our verdict in the software roundup.

Multi-Core Compression Tools
ZstandardFast compression algorithm, providing high compression ratios
pigzParallel implementation of gzip. It's a fully functional replacement for gzip
pixzParallel indexing XZ compression, fully compatible with XZ. LZMA and LZMA2
PBZIP2Parallel implementation of the bzip2 block-sorting file compressor
lrzipCompression utility that excels at compressing large files
lbzip2Parallel bzip2 compression utility, suited for serial and parallel processing
plzipMassively parallel (multi-threaded) lossless data compressor based on lzlib
crabzLike pigz but written in Rust
PXZRuns LZMA compression on multiple cores and processors
KanziModern lossless data compressor

Read our verdict in the software roundup.


Best Free and Open Source Software LinuxLinks helps you discover the best free and open source software for Linux. Explore our extensive collection of recommended applications, including alternatives to popular proprietary software.

We also publish software reviews, Linux tutorials, hardware reviews, free programming books and articles covering the wider open source community. Browse our Linux resources to discover more.

Know a useful free and open source Linux application we haven't covered? Suggest a program for inclusion.

Has your software been featured on LinuxLinks? Display one of our Featured on LinuxLinks badges on your website or GitHub README.
Subscribe

Please read our Comment Policy before commenting.

Notify of
guest
0 Comments
Oldest
Newest Most Voted