Go Find Duplicates is a command-line utility that scans directories for duplicate files and directories.
It’s designed to be fast and simple to use, making it suitable for checking local storage, external drives, and large collections of photos, videos, music, and documents. The program is safe to use because it only reads files and produces a duplicates report rather than deleting or modifying anything.
By default, this tool identifies duplicates if all of the following conditions match:
- file extension is same.
- file size is same.
- CRC32 hash of “crucial bytes” is same.
This is free and open source software.
Key Features
- Command-line tool for finding duplicate files and directories.
- Designed to scan photos, videos, music, documents, and other file collections quickly.
- Produces reports in text, CSV, JSON, or standard output formats.
- Supports exclusion lists for ignoring selected files and directories.
- Offers parallel scanning and a minimum file size filter.
- Includes an optional thorough mode that uses SHA-256 hashing of full file contents.
Website: github.com/m-manu/go-find-duplicates
Support:
Developer: Manu Manjunath
License: Apache License 2.0
Go Find Duplicates is written in Go. Learn Go with our recommended free books and free tutorials.
Related Software
| Find and Delete Duplicate Files with these CLI Tools | |
|---|---|
| Czkawka | Find duplicate files, big files, empty files, similar images, and much more |
| fdupes | Great CLI tool that's written in C |
| fclones | Efficient duplicate file finder and remover |
| rmlint | Fast tool to remove duplicates and other lint |
| jdupes | Powerful CLI duplicate file finder and 'enhanced' fork of fdupes |
| smash | Find duplicate files super fast |
| rdfind | CLI redundant data find tool written in C++ |
| duff | Command-line utility for finding duplicate files |
| rmdupes | Option to use a reference directory |
| Periscope | Organize storage and safely remove redundant files |
| Go Find Duplicates | Scans directories for duplicate files and directories |
| dskDitto | Parallel duplicate-file detector with interactive menus |
| samanlainen | Delete duplicate files with SHA512 hashing |
| FSlint | Python based CLI and GUI tool |
| sdupes | Fast duplicate file detection utility. |
| dupefi | Duplicate file finder designed with Linux philosophy |
| Dupster | Duplicate file finder |
| duple | Find and remove duplicate files |
| ddh | Directory Differential hTool |
| backdown | Safely and ergonomically remove duplicate files |
Read our verdict in the software roundup.
 LinuxLinks helps you discover the best free and open source software for Linux. Explore our extensive collection of recommended applications, including alternatives to popular proprietary software.We also publish software reviews, Linux tutorials, hardware reviews, free programming books and articles covering the wider open source community. Browse our Linux resources to discover more. Know a useful free and open source Linux application we haven't covered? Suggest a program for inclusion. Has your software been featured on LinuxLinks? Display one of our Featured on LinuxLinks badges on your website or GitHub README. |
Please read our Comment Policy before commenting.