uniq Archives - LinuxLinks

hist-rs – high-throughput CLI to count unique lines

hist-rs is a Rust command-line utility built for high-throughput line-oriented text processing.

cuniq is a command-line utility written in Rust for counting unique lines in text input.

uniqs is a Rust command-line utility that serves as an alternative to uniq with streaming support.

xuniq is a high-performance and stable line deduplicator. Unlike the standard uniq utility, xuniq does not require your input to be sorted.

anewer appends new lines efficiently, with trimming, field skipping, NUL separators, dry-run mode and configurable output buffering.

anew appends only previously unseen lines to a file, prints added records to stdout and supports dry-run and quiet modes.

zet performs line-based unions, intersections, differences and duplicate counts across files without requiring sorted input.

uq removes duplicate lines from input streams without sorting, retaining the first occurrence of each line for simple terminal pipelines.

semiuniq filters repeated lines within a configurable recent-history window, reducing nearby duplicates without sorting the input.

runiq offers four duplicate-filtering strategies with different tradeoffs in performance, memory consumption and matching accuracy.

nauniq filters non-adjacent duplicate lines, with options for case matching, bounded memory, pattern resets and append-only output.

huniq removes repeated records without sorting, supports occurrence counts and custom delimiters, and preserves first-seen order.