There are 15 repositories under duplicate-detection topic.
WinDirStat is a disk usage statistics viewer and cleanup tool for Microsoft Windows
Interact, analyze and structure massive text, image, embedding, audio and video datasets
Remove duplicates from MASSIVE wordlist, without sorting it (for dictionary-based password cracking)
A plugin that does one thing only: Detect and manage duplicate items in Zotero.
Filter, Sort & Delete Duplicate Files Recursively
Near Duplicate Video Detection (Perceptual Video Hashing) - Get a 64-bit comparable hash-value for any video.
An extension toolkit for Immich enabling advanced management capabilities through AI-powered similarity detection
⚡ Check your npm modules for unused and duplicate dependencies fast
Interactive code for image similarity using SIFT algorithm
Vidupe is a program that can find duplicate and similar video files. V1.211 released on 2019-09-18, Windows exe here:
Easily delete your YouTube Music library (and manage playlists)
CLI utility to find near duplicate images and remove all but the best copy.
Fast Near-Duplicate Image Search and Delete using pHash, t-SNE and KDTree.
Find similar audio files easily
Duplicates Detector is a cross-platform GUI utility for finding duplicate files, allowing you to delete or link them to save space. Duplicate files are displayed and processed on two synchronized panels for efficient and convenient operation.
Command-line program for Content-Based Image Retrieval of images and videos. Includes tools for general search and de-duplication.
CLI tool that fast checks if your bundle contains multiple versions of the same package, only by looking in package.json.
Remove Duplicate Messages
Nextcloud Media Duplicate Collector application
Detecting near-duplicate videos by aggregating features from intermediate CNN layers
An open-source library that leverages Python’s data science ecosystem to build powerful end-to-end Entity Resolution workflows.
Apps to find duplicate files including same/similar images & videos (with computer vision/AI)
A uniquely crafted image viewer and editor with options to organize files, and maintain large lists of image files for slideshows, dupes detection or other purposes.
Find duplicate files quickly.
Advanced similarity and duplicate source code proof of concept for our research efforts.
OpenStaticAnalyzer is a source code analyzer tool, which can perform deep static analysis of the source code of complex systems.
Welcome to Snowman App – a Data Matching Benchmark Platform.