Compression

crabz – parallel compression utility written in Rust

crabz is a command-line compression and decompression utility written in Rust. It draws inspiration from pigz and uses the gzp library to provide parallel processing for several related compression formats.

The application focuses on exploiting multicore processors while retaining a relatively straightforward command-line interface. It is particularly useful when processing gzip-compatible data or block-oriented compressed formats.

crabz supports configurable thread counts and optional CPU affinity. The latter allows processing threads to be assigned to specific physical cores, which may improve performance in suitable environments. Upstream describes the program as a proof of concept, so it should not be presented as a fully mature replacement for every gzip-related workflow.

This is free and open source software.

Key Features

  • Parallel compression using the gzp library.
  • Supports gzip, zlib and raw Deflate formats.
  • Supports BGZF and Mgzip block-oriented compression formats.
  • Includes support for the Snap compression format.
  • Allows compression levels to be adjusted.
  • Supports configurable numbers of compression threads.
  • Provides multithreaded decompression for formats that permit it.
  • Allows compression threads to be pinned to specific physical CPU cores.
  • Offers in-place compression and decompression, removing the source file on completion.
  • Supports configurable output file paths.
  • Can read input from standard input.
  • Writes compressed or decompressed data to standard output.
  • Provides command-line help covering formats and processing options.
  • Cross-platform support – runs on Linux, macOS, and Windows.

Website: github.com/sstadick/crabz
Support:
Developer: Seth Stadick
License: MIT License

crabz is written in Rust. Learn Rust with our recommended free books and free tutorials


Related Software

Compression Tools
LZ4Focused on compression and decompression speed
ZstandardFast compression algorithm, providing high compression ratios
brotliGeneric-purpose lossless compression algorithm
lzopFile compressor favoring speed over compression ratio
pigzParallel implementation of gzip
ouchCLI tool for compressing and decompressing for various formats
pixzParallel, indexed xz compressor
gzipProvides the standard GNU file compression utilities
BZip3Spiritual successor to BZip2
bzip2Freely available, patent free, high-quality data compressor
PBZIP2Parallel implementation of bzip2
lrzipAchieve very high compression ratios and speed when used with large files
lbzip2Multi-threaded implementation of bzip2, suited for serial and parallel processing
ZXCHigh-performance lossless compression library and command-line tool
plzipMassively parallel lossless data compressor
p7zip-zstdp7zip fork with additional codecs and improvements
7-ZipFile archiver with a high compression ratio
ncompressFast, simple LZW file compressor
PXZRuns LZMA compression on multiple cores and processors
crabzLike pigz but written in Rust
LzipLossless data compressor aimed at Unix-like systems
cmixOptimize compression ratio at the cost of high CPU/memory usage
bscHigh-performance block-sorting compressor for large files
rapidgzipParallelized decompression of gzip files
KanziModular lossless compressor with multithreaded processing

Read our verdict in the software roundup.

Multi-Core Compression Tools
ZstandardFast compression algorithm, providing high compression ratios
pigzParallel implementation of gzip. It's a fully functional replacement for gzip
pixzParallel indexing XZ compression, fully compatible with XZ. LZMA and LZMA2
PBZIP2Parallel implementation of the bzip2 block-sorting file compressor
lrzipCompression utility that excels at compressing large files
lbzip2Parallel bzip2 compression utility, suited for serial and parallel processing
plzipMassively parallel (multi-threaded) lossless data compressor based on lzlib
crabzLike pigz but written in Rust
PXZRuns LZMA compression on multiple cores and processors
KanziModern lossless data compressor

Read our verdict in the software roundup.


Best Free and Open Source Software LinuxLinks helps you discover the best free and open source software for Linux. Explore our extensive collection of recommended applications, including alternatives to popular proprietary software.

We also publish software reviews, Linux tutorials, hardware reviews, free programming books and articles covering the wider open source community. Browse our Linux resources to discover more.

Know a useful free and open source Linux application we haven't covered? Suggest a program for inclusion.

Has your software been featured on LinuxLinks? Display one of our Featured on LinuxLinks badges on your website or GitHub README.
Subscribe

Please read our Comment Policy before commenting.

Notify of
guest
0 Comments
Oldest
Newest Most Voted