Duplito is a command-line file lister and duplicate-file finder. It builds a persistent database of file hashes and then uses that index to identify whether files in specified directories have duplicates elsewhere. Its output distinguishes duplicate and unique files while showing the locations and sizes of matching copies.
Users can choose between a quick partial hash, which combines the file size with MD5 hashes of selected portions, and a full-content hash. The quick method reduces the work required for large files but provides a heuristic result, while full hashing offers a more thorough comparison. Duplito is a read-only reporting tool and does not delete, move or otherwise modify the files it examines.
This is free and open source software.
Key Features
- Identifies duplicate files by examining their content and size.
- Lists duplicate and unique files within selected directories.
- Shows the locations of other copies of each duplicate file.
- Builds a persistent file-hash database for subsequent searches.
- Stores its hash database in the user’s .duplito directory.
- Quick hashing mode examines portions of each file and its total size.
- Full hashing mode examines the complete contents of each file.
- Uses concurrent hashing with a configurable number of threads.
- Scan individual files, directories or multiple paths in one command.
- Recursive scanning of subdirectories.
- Accepts file selections produced through shell wildcard expansion.
- Display only files identified as duplicates.
- Filter the displayed file list by minimum file size.
- Per-directory summaries show duplicate statistics.
- Overall summary reports statistics for all supplied paths.
- Filter directories by the percentage of duplicate content.
- Filter directories by the number of bytes occupied by duplicates.
- Optionally continues after encountering inaccessible or unreadable files.
- Marks zero-length files separately instead of treating them as duplicates.
- Defaults to the current directory when listing files without a supplied path.
- Makes no changes to the files being examined.
Website: github.com/ftarlao/duplito
Support:
Developer: Fabiano Tarlao
License: GNU General Public License v3.0
Duplito is written in Go. Learn Go with our recommended free books and free tutorials.
Related Software
| Find and Delete Duplicate Files with these CLI Tools | |
|---|---|
| Czkawka | Find duplicate files, big files, empty files, similar images, and much more |
| fdupes | Great CLI tool that's written in C |
| fclones | Efficient duplicate file finder and remover |
| rmlint | Fast tool to remove duplicates and other lint |
| jdupes | Powerful CLI duplicate file finder and 'enhanced' fork of fdupes |
| smash | Find duplicate files super fast |
| rdfind | CLI redundant data find tool written in C++ |
| duff | Command-line utility for finding duplicate files |
| rmdupes | Option to use a reference directory |
| Periscope | Organize storage and safely remove redundant files |
| Go Find Duplicates | Scans directories for duplicate files and directories |
| dskDitto | Parallel duplicate-file detector with interactive menus |
| samanlainen | Delete duplicate files with SHA512 hashing |
| FSlint | Python based CLI and GUI tool |
| sdupes | Fast duplicate file detection utility. |
| dupefi | Duplicate file finder designed with Linux philosophy |
| Dupster | Duplicate file finder |
| duple | Find and remove duplicate files |
| ddh | Directory Differential hTool |
| backdown | Safely and ergonomically remove duplicate files |
Read our verdict in the software roundup.
 Explore our comprehensive directory of recommended free and open source software. Our carefully curated collection spans every major software category.This directory is part of our ongoing series of informative articles for Linux enthusiasts. It features hundreds of detailed reviews, along with open source alternatives to proprietary solutions from major corporations such as Google, Microsoft, Apple, Adobe, IBM, Cisco, Oracle, and Autodesk. You’ll also find interesting projects to try, hardware coverage, free programming books and tutorials, and much more. Discovered a useful open source Linux program that we haven’t covered yet? Let us know by completing this form. |
Please read our Comment Policy before commenting.