How to Remove Duplicate Files on Linux

What Causes This?

Duplicate files on Linux usually build up over time from repeated downloads, copied folders, backups, sync conflicts, and app-generated cache or export files. This is especially common if you move files between drives, use cloud storage, or keep multiple versions of photos, videos, and documents without realizing it. In some cases, duplicates are exact matches; in others, they have different names but identical content.

Common Symptoms

• Your Linux drive keeps running low on space for no obvious reason
• You notice multiple copies of the same photos, videos, documents, or downloads
• File searches return several nearly identical results
• Backups take longer and use more storage than expected
• Important folders like Downloads, Desktop, or Pictures feel cluttered and hard to manage

How to Fix It Manually

If you want to remove duplicate files yourself, Linux gives you a few reliable ways to find them. Be careful before deleting anything, especially in system folders or backup locations.

1. Start by checking which folders are using the most space

   1. Open your file manager.
   2. Look through common problem folders like Downloads, Documents, Desktop, Pictures, and Videos.
   3. Sort files by Size or Date Modified to spot repeated downloads or copied files quickly.

2. Use the find command to locate files with the same name

   1. Open Terminal.
   2. Run a command like this to search a folder:

      find ~/Downloads -type f | sed 's|.*/||' | sort | uniq -d

   3. This shows duplicate file names, which is useful for a quick check, but it does not confirm the files have identical contents.

3. Use a duplicate file finder for exact matches

   1. Install fdupes if it is not already installed:
      • Ubuntu/Debian:

        sudo apt install fdupes

      • Fedora:

        sudo dnf install fdupes

      • Arch:

        sudo pacman -S fdupes

   2. Scan a folder recursively:

      fdupes -r ~/Downloads

   3. Review the results carefully. Files listed together are duplicates based on content, not just name.

4. Delete duplicates carefully

   1. To delete manually, use the file paths shown by fdupes and remove only the copies you do not need.
   2. You can delete from the file manager, or use Terminal:

      rm "/path/to/duplicate-file"

   3. Avoid deleting files from /etc, /usr, /var, or other system directories unless you are absolutely sure they are safe to remove.

5. Use interactive cleanup if you want prompts

   1. Run:

      fdupes -rd ~/Downloads

   2. This asks you which duplicate copies to keep and which to remove.
   3. Read each prompt closely so you do not delete the wrong file.

6. Empty the Trash and recheck free space

   1. Open the Trash in your file manager.
   2. Permanently delete the files you removed.
   3. Check available disk space again with:

      df -h

Fix It Automatically with Kudu

If you do not want to scan folders and compare files manually, Kudu can detect duplicate files automatically and help you remove them safely. It makes it easier to recover storage, reduce clutter, and avoid deleting the wrong files by mistake.

Download Kudu Free →