Compression

libbsc – high performance block-sorting data compressor

libbsc is a high performance lossless data compression project built around block-sorting algorithms. The project provides both the bsc command-line compressor and the libbsc library, which makes the same compression technology available to other software.

The compressor is designed with large files and modern multicore processors in mind. Files are divided into blocks which can be processed in parallel, allowing compression and decompression workloads to make use of multiple CPU cores. The chosen block size affects both memory consumption and compression ratio, giving users some control over the trade-off between resource usage and compression efficiency.

libbsc uses a collection of transforms and entropy coding techniques intended to achieve strong compression while retaining competitive performance. The project is particularly interesting for users dealing with large datasets where compression ratio matters but extremely slow archival compressors are not desirable.

This is free and open source software.

Key Features

  • Lossless block-sorting data compression.
  • High compression ratios while maintaining good performance.
  • Multithreaded compression of independent blocks.
  • Parallel processing on multicore processors.
  • bsc command-line compression utility.
  • libbsc library for compressing memory blocks.
  • Configurable block sizes.
  • Optional shared library build.
  • Configurable parallel block processing allows users to balance compression performance and memory requirements.

Website: github.com/IlyaGrebnov/libbsc
Support:
Developer: Ilya Grebnov
License: Apache License 2.0

libbsc is written in C. Learn C with our recommended free books and free tutorials.


Related Software

Compression Tools
LZ4Focused on compression and decompression speed
ZstandardFast compression algorithm, providing high compression ratios
brotliGeneric-purpose lossless compression algorithm
lzopFile compressor favoring speed over compression ratio
pigzParallel implementation of gzip
ouchCLI tool for compressing and decompressing for various formats
pixzParallel, indexed xz compressor
gzipProvides the standard GNU file compression utilities
BZip3Spiritual successor to BZip2
bzip2Freely available, patent free, high-quality data compressor
PBZIP2Parallel implementation of bzip2
lrzipAchieve very high compression ratios and speed when used with large files
lbzip2Multi-threaded implementation of bzip2, suited for serial and parallel processing
ZXCHigh-performance lossless compression library and command-line tool
plzipMassively parallel lossless data compressor
p7zip-zstdp7zip fork with additional codecs and improvements
7-ZipFile archiver with a high compression ratio
ncompressFast, simple LZW file compressor
PXZRuns LZMA compression on multiple cores and processors
crabzLike pigz but written in Rust
LzipLossless data compressor aimed at Unix-like systems
cmixOptimize compression ratio at the cost of high CPU/memory usage
bscHigh-performance block-sorting compressor for large files
rapidgzipParallelized decompression of gzip files
KanziModular lossless compressor with multithreaded processing

Read our verdict in the software roundup.


Best Free and Open Source Software LinuxLinks helps you discover the best free and open source software for Linux. Explore our extensive collection of recommended applications, including alternatives to popular proprietary software.

We also publish software reviews, Linux tutorials, hardware reviews, free programming books and articles covering the wider open source community. Browse our Linux resources to discover more.

Know a useful free and open source Linux application we haven't covered? Suggest a program for inclusion.

Has your software been featured on LinuxLinks? Display one of our Featured on LinuxLinks badges on your website or GitHub README.
Subscribe

Please read our Comment Policy before commenting.

Notify of
guest
0 Comments
Oldest
Newest Most Voted