libbsc is a high performance lossless data compression project built around block-sorting algorithms. The project provides both the bsc command-line compressor and the libbsc library, which makes the same compression technology available to other software.
The compressor is designed with large files and modern multicore processors in mind. Files are divided into blocks which can be processed in parallel, allowing compression and decompression workloads to make use of multiple CPU cores. The chosen block size affects both memory consumption and compression ratio, giving users some control over the trade-off between resource usage and compression efficiency.
libbsc uses a collection of transforms and entropy coding techniques intended to achieve strong compression while retaining competitive performance. The project is particularly interesting for users dealing with large datasets where compression ratio matters but extremely slow archival compressors are not desirable.
This is free and open source software.
Key Features
- Lossless block-sorting data compression.
- High compression ratios while maintaining good performance.
- Multithreaded compression of independent blocks.
- Parallel processing on multicore processors.
- bsc command-line compression utility.
- libbsc library for compressing memory blocks.
- Configurable block sizes.
- Optional shared library build.
- Optional NVIDIA CUDA acceleration.
- CMake-based build system.
Website: github.com/IlyaGrebnov/libbsc
Support:
Developer: Ilya Grebnov
License: Apache License 2.0
libbsc is written in C. Learn C with our recommended free books and free tutorials.
Related Software
| Compression Tools | |
|---|---|
| LZ4 | Focused on compression and decompression speed |
| Zstandard | Fast compression algorithm, providing high compression ratios |
| brotli | Generic-purpose lossless compression algorithm |
| lzop | File compressor favoring speed over compression ratio |
| pigz | Parallel implementation of gzip |
| ouch | CLI tool for compressing and decompressing for various formats |
| pixz | Parallel, indexed xz compressor |
| gzip | Provides the standard GNU file compression utilities |
| BZip3 | Spiritual successor to BZip2 |
| bzip2 | Freely available, patent free, high-quality data compressor |
| PBZIP2 | Parallel implementation of bzip2 |
| lrzip | Achieve very high compression ratios and speed when used with large files |
| lbzip2 | Multi-threaded implementation of bzip2, suited for serial and parallel processing |
| ZXC | High-performance lossless compression library and command-line tool |
| plzip | Massively parallel lossless data compressor |
| p7zip-zstd | p7zip fork with additional codecs and improvements |
| 7-Zip | File archiver with a high compression ratio |
| ncompress | Fast, simple LZW file compressor |
| PXZ | Runs LZMA compression on multiple cores and processors |
| crabz | Like pigz but written in Rust |
| Lzip | Lossless data compressor aimed at Unix-like systems |
| cmix | Optimize compression ratio at the cost of high CPU/memory usage |
| lrzip-next | Long Range ZIP |
| rapidgzip | Parallelized decompression of gzip files |
| igzip | Command-line compression and decompression utility |
Read our verdict in the software roundup.
 Explore our carefully curated directory of recommended free and open source software, covering every major software category.The directory forms part of our extensive collection of articles for Linux enthusiasts. It includes hundreds of detailed reviews, together with free and open source alternatives to proprietary software from companies such as Google, Microsoft, Apple, Adobe, IBM, Cisco, Oracle, and Autodesk. LinuxLinks also covers interesting projects worth exploring, Linux-compatible hardware, free programming books and tutorials, and much more. Know a useful free and open source Linux application that we haven’t covered? Tell us about it using our submission form. |
Please read our Comment Policy before commenting.