rapidgzip can be used for parallel decompression of almost any gzip file. Other tools, such as bgzip, can only parallelize decompression of gzip files produced by themselves. rapidgzip works with all files, especially those produced by the usually installed gzip.
The Python module provides a RapidgzipFile class, which can be used to seek inside gzip files without having to decompress them first. Alternatively, you can use this simply as a parallelized gzip decoder as a replacement for Python’s builtin gzip module in order to fully utilize all your cores.
This is free and open source software.
Website: github.com/mxmlnkn/rapidgzip
Support:
Developer: Maximilian Knespel
License: MIT License or Apache License 2.0
rapidgzip is written in Python. Learn Python with our recommended free books and free tutorials.
Related Software
| Compression Tools | |
|---|---|
| LZ4 | Focused on compression and decompression speed |
| Zstandard | Fast compression algorithm, providing high compression ratios |
| brotli | Generic-purpose lossless compression algorithm |
| lzop | File compressor favoring speed over compression ratio |
| pigz | Parallel implementation of gzip |
| ouch | CLI tool for compressing and decompressing for various formats |
| pixz | Parallel, indexed xz compressor |
| gzip | Provides the standard GNU file compression utilities |
| BZip3 | Spiritual successor to BZip2 |
| bzip2 | Freely available, patent free, high-quality data compressor |
| PBZIP2 | Parallel implementation of bzip2 |
| lrzip | Achieve very high compression ratios and speed when used with large files |
| lbzip2 | Multi-threaded implementation of bzip2, suited for serial and parallel processing |
| ZXC | High-performance lossless compression library and command-line tool |
| plzip | Massively parallel lossless data compressor |
| p7zip-zstd | p7zip fork with additional codecs and improvements |
| 7-Zip | File archiver with a high compression ratio |
| ncompress | Fast, simple LZW file compressor |
| PXZ | Runs LZMA compression on multiple cores and processors |
| crabz | Like pigz but written in Rust |
| Lzip | Lossless data compressor aimed at Unix-like systems |
| cmix | Optimize compression ratio at the cost of high CPU/memory usage |
| lrzip-next | Long Range ZIP |
| rapidgzip | Parallelized decompression of gzip files |
| igzip | Command-line compression and decompression utility |
Read our verdict in the software roundup.
 Explore our comprehensive directory of recommended free and open source software. Our carefully curated collection spans every major software category.This directory is part of our ongoing series of informative articles for Linux enthusiasts. It features hundreds of detailed reviews, along with open source alternatives to proprietary solutions from major corporations such as Google, Microsoft, Apple, Adobe, IBM, Cisco, Oracle, and Autodesk. You’ll also find interesting projects to try, hardware coverage, free programming books and tutorials, and much more. Discovered a useful open source Linux program that we haven’t covered yet? Let us know by completing this form. |