lbzip2 is a multithreaded file compressor designed to work with the bzip2 format. It distributes compression and decompression tasks across available CPU cores, improving throughput on machines capable of processing multiple blocks simultaneously.
The utility is especially useful with larger files and workflows involving tar archives. It can overlap compression or decompression with input and output operations, making better use of system resources than a strictly sequential implementation.
lbzip2 retains compatibility with standard bzip2 data while providing a more parallel-oriented processing model. It also includes a single-worker mode for circumstances where additional threads offer little benefit.
This is free and open source software.
Key Features
- Parallel compression and decompression using multiple worker threads.
- Produces and reads data compatible with standard bzip2.
- Uses block-based processing to distribute work across CPU cores.
- Supports streaming compression and decompression through pipes.
- Allows compression to overlap with input and output operations.
- Provides a single-worker decompression mode.
- Supports configurable processing thread counts.
- Includes an input-bound splitter for distributing compressed data.
- Offers good multicore scaling for suitable workloads.
- Can be used in place of bzip2 for many command-line operations.
- Supports integration with tar for compressed archive workflows.
- Provides options for retaining input files and controlling processing behaviour.
- Uses a Burrows-Wheeler-based compression technique compatible with the bzip2 format.
Website: github.com/kjn/lbzip2
Support:
Developer: Laszlo Ersek, Mikolaj Izdebski and contributors
License: GNU General Public License v3.0
lbzip2 is written in C. Learn C with our recommended free books and free tutorials.
Related Software
| Compression Tools | |
|---|---|
| LZ4 | Focused on compression and decompression speed |
| Zstandard | Fast compression algorithm, providing high compression ratios |
| brotli | Generic-purpose lossless compression algorithm |
| lzop | File compressor favoring speed over compression ratio |
| pigz | Parallel implementation of gzip |
| ouch | CLI tool for compressing and decompressing for various formats |
| pixz | Parallel, indexed xz compressor |
| gzip | Provides the standard GNU file compression utilities |
| BZip3 | Spiritual successor to BZip2 |
| bzip2 | Freely available, patent free, high-quality data compressor |
| PBZIP2 | Parallel implementation of bzip2 |
| lrzip | Achieve very high compression ratios and speed when used with large files |
| lbzip2 | Multi-threaded implementation of bzip2, suited for serial and parallel processing |
| ZXC | High-performance lossless compression library and command-line tool |
| plzip | Massively parallel lossless data compressor |
| p7zip-zstd | p7zip fork with additional codecs and improvements |
| 7-Zip | File archiver with a high compression ratio |
| ncompress | Fast, simple LZW file compressor |
| PXZ | Runs LZMA compression on multiple cores and processors |
| crabz | Like pigz but written in Rust |
| Lzip | Lossless data compressor aimed at Unix-like systems |
| cmix | Optimize compression ratio at the cost of high CPU/memory usage |
| bsc | High-performance block-sorting compressor for large files |
| rapidgzip | Parallelized decompression of gzip files |
| Kanzi | Modular lossless compressor with multithreaded processing |
Read our verdict in the software roundup.
| Multi-Core Compression Tools | |
|---|---|
| Zstandard | Fast compression algorithm, providing high compression ratios |
| pigz | Parallel implementation of gzip. It's a fully functional replacement for gzip |
| pixz | Parallel indexing XZ compression, fully compatible with XZ. LZMA and LZMA2 |
| PBZIP2 | Parallel implementation of the bzip2 block-sorting file compressor |
| lrzip | Compression utility that excels at compressing large files |
| lbzip2 | Parallel bzip2 compression utility, suited for serial and parallel processing |
| plzip | Massively parallel (multi-threaded) lossless data compressor based on lzlib |
| crabz | Like pigz but written in Rust |
| PXZ | Runs LZMA compression on multiple cores and processors |
| Kanzi | Modern lossless data compressor |
Read our verdict in the software roundup.
 LinuxLinks helps you discover the best free and open source software for Linux. Explore our extensive collection of recommended applications, including alternatives to popular proprietary software.We also publish software reviews, Linux tutorials, hardware reviews, free programming books and articles covering the wider open source community. Browse our Linux resources to discover more. Know a useful free and open source Linux application we haven't covered? Suggest a program for inclusion. Has your software been featured on LinuxLinks? Display one of our Featured on LinuxLinks badges on your website or GitHub README. |
Please read our Comment Policy before commenting.
Au 10/1/2024 lbzip2 ne réponds plus (site non trouvé).
Quelqu’un à une adresse ?
The domain lapsed for the project’s website address. We’ve reverted to point to the project’s GitHub repository.