Abstract:Unsupervised near-duplicate detection has many practical applications ranging from social media analysis and web-scale retrieval, to digital image forensics. It entails running a threshold-limited query on a set of descriptors extracted from the images, with the goal of identifying all possible near-duplicates, while limiting the false positives due to visually similar images. Since the rate of false alarms grows with the dataset size, a very high specificity is thus required, up to $1 - 10^{-9}$ for realistic use cases; this important requirement, however, is often overlooked in literature. In recent years, descriptors based on deep convolutional neural networks have matched or surpassed traditional feature extraction methods in content-based image retrieval tasks. To the best of our knowledge, ours is the first attempt to establish the performance range of deep learning-based descriptors for unsupervised near-duplicate detection on a range of datasets, encompassing a broad spectrum of near-duplicate definitions. We leverage both established and new benchmarks, such as the Mir-Flick Near-Duplicate (MFND) dataset, in which a known ground truth is provided for all possible pairs over a general, large scale image collection. To compare the specificity of different descriptors, we reduce the problem of unsupervised detection to that of binary classification of near-duplicate vs. not-near-duplicate images. The latter can be conveniently characterized using Receiver Operating Curve (ROC). Our findings in general favor the choice of fine-tuning deep convolutional networks, as opposed to using off-the-shelf features, but differences at high specificity settings depend on the dataset and are often small. The best performance was observed on the MFND benchmark, achieving 96\% sensitivity at a false positive rate of $1.43 \times 10^{-6}$.

Near duplicate detection of images with area and proposed pixel‐based feature extraction

Efficient near-duplicate image detection by learning from examples

A Review on Near Duplicate Detection of Images using Computer Vision Techniques

Fine-search for image copy detection based on local affine-invariant descriptor and spatial dependent matching

Statistical Probability Based Algorithm for Extracting Feature Points in 2-Dimensional Image

Squirrel Search Optimization-based near-duplicate image detection

Query Oriented Subspace Shifting for Near-Duplicate Image Detection

Near-duplicate image recognition

Near-Duplicate Image Detection System Using Coarse-to-Fine Matching Scheme Based on Global and Local CNN Features

Siamese coding network and pair similarity prediction for near-duplicate image detection

Near-duplicate Keyframe Retrieval by Nonrigid Image Matching.

Fast and accurate near-duplicate image elimination for visual sensor networks

Detecting Near-Duplicate Face Images

Efficient Feature Detection and Effective Post-Verification for Large Scale Near-Duplicate Image Search

Benchmarking unsupervised near-duplicate image detection

Evolution of a Web-Scale Near Duplicate Image Detection System

Near-duplicate Keyframe Retrieval by Semi-Supervised Learning and Nonrigid Image Matching

A Novel Region Duplication Detection Algorithm Based on Hybrid Approach

Scale-rotation invariant pattern entropy for keypoint-based near-duplicate detection

Region duplication detection based on Harris corner points and step sector statistics

Dataset and Case Studies for Visual Near-Duplicates Detection in the Context of Social Media