filtering Archives - LinuxLinks

uq removes duplicate lines from input streams without sorting, retaining the first occurrence of each line for simple terminal pipelines.

semiuniq filters repeated lines within a configurable recent-history window, reducing nearby duplicates without sorting the input.

runiq offers four duplicate-filtering strategies with different tradeoffs in performance, memory consumption and matching accuracy.

nauniq filters non-adjacent duplicate lines, with options for case matching, bounded memory, pattern resets and append-only output.

huniq removes repeated records without sorting, supports occurrence counts and custom delimiters, and preserves first-seen order.

Tag: filtering