Go Find Duplicates is a command-line utility that scans directories for duplicate files and directories.
It’s designed to be fast and simple to use, making it suitable for checking local storage, external drives, and large collections of photos, videos, music, and documents. The program is safe to use because it only reads files and produces a duplicates report rather than deleting or modifying anything.
By default, this tool identifies duplicates if all of the following conditions match:
- file extension is same.
- file size is same.
- CRC32 hash of “crucial bytes” is same.
This is free and open source software.
Key Features
- Command-line tool for finding duplicate files and directories.
- Designed to scan photos, videos, music, documents, and other file collections quickly.
- Produces reports in text, CSV, JSON, or standard output formats.
- Supports exclusion lists for ignoring selected files and directories.
- Offers parallel scanning and a minimum file size filter.
- Includes an optional thorough mode that uses SHA-256 hashing of full file contents.
Website: github.com/m-manu/go-find-duplicates
Support:
Developer: Manu Manjunath
License: Apache License 2.0
Go Find Duplicates is written in Go. Learn Go with our recommended free books and free tutorials.
Related Software
| Find and Delete Duplicate Files with these CLI Tools | |
|---|---|
| Czkawka | Find duplicate files, big files, empty files, similar images, and much more |
| fdupes | Great CLI tool that's written in C |
| fclones | Efficient duplicate file finder and remover |
| rmlint | Fast tool to remove duplicates and other lint |
| jdupes | Powerful CLI duplicate file finder and 'enhanced' fork of fdupes |
| smash | Find duplicate files super fast |
| rdfind | CLI redundant data find tool written in C++ |
| duff | Command-line utility for finding duplicate files |
| FSlint | Python based CLI and GUI tool |
| samanlainen | Delete duplicate files with SHA512 hashing |
| rmdupes | Option to use a reference directory |
| sdupes | Fast duplicate file detection utility. |
| dupefi | Duplicate file finder designed with Linux philosophy |
| ddh | Directory Differential hTool |
| backdown | Safely and ergonomically remove duplicate files |
| duple | Find and remove duplicate files |
Read our verdict in the software roundup.
 Explore our comprehensive directory of recommended free and open source software. Our carefully curated collection spans every major software category.This directory is part of our ongoing series of informative articles for Linux enthusiasts. It features hundreds of detailed reviews, along with open source alternatives to proprietary solutions from major corporations such as Google, Microsoft, Apple, Adobe, IBM, Cisco, Oracle, and Autodesk. You’ll also find interesting projects to try, hardware coverage, free programming books and tutorials, and much more. Discovered a useful open source Linux program that we haven’t covered yet? Let us know by completing this form. |