uniqs is a Rust command-line utility that serves as an alternative to uniq with streaming support.
It’s intended for text-processing workflows where you want to remove repeated lines as data is read, without relying on a prior sort step, making it a good fit for pipelines and larger input streams.
This is free and open source software.
Key Features
- Reads from standard input by default, with optional input and output file arguments.
- Writes each distinct line once, ignoring lines that have already appeared earlier in the input.
- Includes a
--countoption to prefix lines with their number of occurrences. - Supports use in shell pipelines as well as direct file-to-file processing.
- Provides a
completionsubcommand to generate shell completion scripts.
Website: github.com/simnalamburt/uniqs
Support:
Developer: Jihyeon Kim
License: Apache License 2.0 or MIT License
uniqs is written in Rust. Learn Rust with our recommended free books and free tutorials.
Related Software
| Alternatives to uniq | |
|---|---|
| runiq | An efficient way to filter duplicate lines from input, à la uniq |
| huniq | Removes duplicates from stdin using a hash table |
| nauniq | Non-adjacent uniq |
| semiuniq | Removes nearby repeated lines in a file |
| uq | Removes duplicate lines from the output, regardless of the order |
| zet | Perform set operations on files considered as sets of lines |
| anew | Adds new lines to files, skipping duplicates |
| anewer | Appends lines from stdin to a file if they don't already exist in the file |
 Explore our carefully curated directory of recommended free and open source software, covering every major software category.The directory forms part of our extensive collection of articles for Linux enthusiasts. It includes hundreds of detailed reviews, together with free and open source alternatives to proprietary software from companies such as Google, Microsoft, Apple, Adobe, IBM, Cisco, Oracle, and Autodesk. LinuxLinks also covers interesting projects worth exploring, Linux-compatible hardware, free programming books and tutorials, and much more. Know a useful free and open source Linux application that we haven’t covered? Tell us about it using our submission form. |
Please read our Comment Policy before commenting.