Folder

dupefi – command-line duplicate file finder

dupefi is a command-line utility for finding duplicate files and producing customisable output. It is designed to work alongside standard Linux command-line tools rather than performing filesystem cleanup itself.

The application identifies matching files and allows users to control how duplicate groups are displayed. Its output templates can generate filenames, structured records or shell commands for subsequent processing.

dupefi also provides a reference-directory comparison mode, allowing files in one collection to be checked against another. Its combination of content comparison, regular-expression filtering and configurable output makes it suitable for scripted file-management workflows.

This is free and open source software.

Key Features

  • Finds duplicate files within one or more directories.
  • Supports comparing selected directories against a separate reference directory.
  • Provides configurable output templates for duplicate file paths.
  • Allows original files and duplicate copies to be formatted separately.
  • Supports generating structured output such as JSON records.
  • Can generate shell commands for processing duplicate files.
  • Supports regular-expression filtering of filenames.
  • Provides a separate regular-expression filter for files that should not be reported as duplicates.
  • Allows a minimum file size to be specified.
  • Supports checksum-based comparisons using SHA-256.
  • Can be combined with standard shell commands to calculate duplicate storage usage.
  • Provides output suitable for creating hard links or deletion scripts.
  • Does not directly delete, move or modify files.
  • Allows users to review generated commands before executing filesystem changes.

Website: github.com/hirak99/dupefi
Support:
Developer: hirak99
License: Apache License 2.0

Options available with dupefi

dupefi is written in Go. Learn Go with our recommended free books and free tutorials.


Related Software

Find and Delete Duplicate Files with these CLI Tools
CzkawkaFind duplicate files, big files, empty files, similar images, and much more
fdupesGreat CLI tool that's written in C
fclonesEfficient duplicate file finder and remover
rmlintFast tool to remove duplicates and other lint
jdupesPowerful CLI duplicate file finder and 'enhanced' fork of fdupes
smashFind duplicate files super fast
rdfindCLI redundant data find tool written in C++
duffCommand-line utility for finding duplicate files
rmdupesOption to use a reference directory
PeriscopeOrganize storage and safely remove redundant files
Go Find DuplicatesScans directories for duplicate files and directories
dskDittoParallel duplicate-file detector with interactive menus
samanlainenDelete duplicate files with SHA512 hashing
FSlintPython based CLI and GUI tool
sdupesFast duplicate file detection utility.
dupefiDuplicate file finder designed with Linux philosophy
DupsterDuplicate file finder
dupleFind and remove duplicate files
ddhDirectory Differential hTool
backdownSafely and ergonomically remove duplicate files

Read our verdict in the software roundup.


Best Free and Open Source Software LinuxLinks helps you discover the best free and open source software for Linux. Explore our extensive collection of recommended applications, including alternatives to popular proprietary software.

We also publish software reviews, Linux tutorials, hardware reviews, free programming books and articles covering the wider open source community. Browse our Linux resources to discover more.

Know a useful free and open source Linux application we haven't covered? Suggest a program for inclusion.

Has your software been featured on LinuxLinks? Display one of our Featured on LinuxLinks badges on your website or GitHub README.
Subscribe

Please read our Comment Policy before commenting.

Notify of
guest
0 Comments
Oldest
Newest Most Voted