Abstract:Source camera identification can verify whether two videos were shot by the same device, which is of great significance in multimedia forensics. Most existing identification methods use convolutional neural networks to learn sensor noise patterns to identify the source camera in closed forensic scenarios. While these methodologies have achieved remarkable results, they are nonetheless constrained by two primary challenges: (1) the interference of semantic information and (2) the incongruity in feature distributions across different datasets. The former will interfere with the extraction of effective features of the model. The latter will cause the model to fit the characteristic distribution of the training data and be sensitive to unseen data features. To address these challenges, we propose a novel source camera identification framework that determines whether a video was shot by the same device by obtaining similarities between source camera features. Firstly, we extract video key frames and use the integral image to optimize the smoothing blocks selection algorithm of inter-pixel variance to remove the interference of video semantic information. Secondly, we design a residual neural network fused with a constraint layer to adaptively learn video source features. Thirdly, we introduce a triplet loss metric learning strategy to optimize the network model to improve the discriminability of the model. Finally, we design a multi-dimensional feature vector similarity fusion strategy to achieve highly generalized source camera recognition. Extensive experiments show that our method achieved an AUC value of up to 0.9714 in closed-set forensic scenarios and an AUC value of 0.882 in open-set scenarios, representing an improvement of 5% compared to the best baseline method. Furthermore, our method demonstrates effectiveness in the task of deepfake detection.

Selecting forensic features for robust source camera identification

Source Camera Identification Issues: Forensic Features Selection And Robustness

Source Camera Identification Issues

Source Camera Identification Forensics Based on Wavelet Features

A New Feature-Based Method for Source Camera Identification

Source Camera Identification Using Support Vector Machines

Identification of Source Cameras Based on CFA Interpolation Algorithm Detection Using Covariance Matrix

Classifier Combination Based Source Identification for Cell Phone Images

Issues on Selecting Image Features for Robust Source Camera Identification.

Detecting Image Tampering Using Feature Fusion

Source Cell-phone Identification Based on Multi-feature Fusion.

Multiple Heterogeneous JPEG Image Hierarchical Forensic

Silhouette coefficient based approach on cell-phone classification for unknown source images

Generalizing Source Camera Identification Based on Integral Image Optimization and Constrained Neural Network

Source Camera Identification with a Robust Device Fingerprint: Evolution from Image-Based to Video-Based Approaches

Efficient Source Camera Identification with Diversity-Enhanced Patch Selection and Deep Residual Prediction

Identifying Camera and Processing from Cropped JPEG Photos Via Tensor Analysis

A Robust Image Forensic Framework Utilizing Multi-Colorspace Enriched Vision Transformer for Distinguishing Natural and Computer-Generated Images

Source Camera Identification and Detection in Digital Videos through Blind Forensics

Image forensic signature for content authenticity analysis

Beyond PRNU: Learning Robust Device-Specific Fingerprint for Source Camera Identification