Abstract:Source camera identification can verify whether two videos were shot by the same device, which is of great significance in multimedia forensics. Most existing identification methods use convolutional neural networks to learn sensor noise patterns to identify the source camera in closed forensic scenarios. While these methodologies have achieved remarkable results, they are nonetheless constrained by two primary challenges: (1) the interference of semantic information and (2) the incongruity in feature distributions across different datasets. The former will interfere with the extraction of effective features of the model. The latter will cause the model to fit the characteristic distribution of the training data and be sensitive to unseen data features. To address these challenges, we propose a novel source camera identification framework that determines whether a video was shot by the same device by obtaining similarities between source camera features. Firstly, we extract video key frames and use the integral image to optimize the smoothing blocks selection algorithm of inter-pixel variance to remove the interference of video semantic information. Secondly, we design a residual neural network fused with a constraint layer to adaptively learn video source features. Thirdly, we introduce a triplet loss metric learning strategy to optimize the network model to improve the discriminability of the model. Finally, we design a multi-dimensional feature vector similarity fusion strategy to achieve highly generalized source camera recognition. Extensive experiments show that our method achieved an AUC value of up to 0.9714 in closed-set forensic scenarios and an AUC value of 0.882 in open-set scenarios, representing an improvement of 5% compared to the best baseline method. Furthermore, our method demonstrates effectiveness in the task of deepfake detection.

Open-Set source camera identification based on envelope of data clustering optimization (EDCO)

A New Feature-Based Method for Source Camera Identification

Source Camera Identification Forensics Based on Wavelet Features

Source Camera Identification Using Support Vector Machines

Identification of Source Cameras Based on CFA Interpolation Algorithm Detection Using Covariance Matrix

Camera Source Identification with Limited Labeled Training Set.

An In-Depth Study on Open-Set Camera Model Identification

E 2 C 2 : efficient and effective camera calibration in indoor environments

Source Camera Identification Issues: Forensic Features Selection And Robustness

Generalizing Source Camera Identification Based on Integral Image Optimization and Constrained Neural Network

Source Camera Identification Issues

Efficient Source Camera Identification with Diversity-Enhanced Patch Selection and Deep Residual Prediction

Towards Evidential and Class Separable Open Set Object Detection

Improved Robust Kernel Subspace for Object-Based Registration and Change Detection

Robust Camera Model Identification over Online Social Network Shared Images via Multi-Scenario Learning

Selecting forensic features for robust source camera identification

Towards Open-set Camera 3D Object Detection

Open-set Face Recognition using Ensembles trained on Clustered Data

Unexplored Faces of Robustness and Out-of-Distribution: Covariate Shifts in Environment and Sensor Domains

Object Detection using Event Camera: A MoE Heat Conduction based Detector and A New Benchmark Dataset

Source Camera Identification with a Robust Device Fingerprint: Evolution from Image-Based to Video-Based Approaches