An In-Depth Study on Open-Set Camera Model Identification

Pedro Ribeiro Mendes Júnior,Luca Bondi,Paolo Bestagini,Stefano Tubaro,Anderson Rocha

DOI: https://doi.org/10.1109/ACCESS.2019.2921436

2019-11-14

Abstract:Camera model identification refers to the problem of linking a picture to the camera model used to shoot it. As this might be an enabling factor in different forensic applications to single out possible suspects (e.g., detecting the author of child abuse or terrorist propaganda material), many accurate camera model attribution methods have been developed in the literature. One of their main drawbacks, however, is the typical closed-set assumption of the problem. This means that an investigated photograph is always assigned to one camera model within a set of known ones present during investigation, i.e., training time, and the fact that the picture can come from a completely unrelated camera model during actual testing is usually ignored. Under realistic conditions, it is not possible to assume that every picture under analysis belongs to one of the available camera models. To deal with this issue, in this paper, we present the first in-depth study on the possibility of solving the camera model identification problem in open-set scenarios. Given a photograph, we aim at detecting whether it comes from one of the known camera models of interest or from an unknown one. We compare different feature extraction algorithms and classifiers specially targeting open-set recognition. We also evaluate possible open-set training protocols that can be applied along with any open-set classifier, observing that a simple of those alternatives obtains best results. Thorough testing on independent datasets shows that it is possible to leverage a recently proposed convolutional neural network as feature extractor paired with a properly trained open-set classifier aiming at solving the open-set camera model attribution problem even to small-scale image patches, improving over state-of-the-art available solutions.

Computer Vision and Pattern Recognition,Machine Learning

What problem does this paper attempt to address?

The problem that this paper attempts to solve is camera model identification in an open - set scenario. Traditionally, camera model identification is usually carried out under a closed - set assumption, that is, all photos to be analyzed are assumed to be from a set of known camera models. However, in practical applications, photos may come from completely unknown camera models, and in this case, the closed - set method will fail. Therefore, the goal of the paper is to develop a method that can accurately classify known camera models while detecting unknown camera models.

Specifically, the paper studies how to solve the camera model identification problem through a supervised learning pipeline under open - set conditions. This pipeline mainly consists of three modules: a feature extractor, a training protocol, and an open - set classifier. The paper evaluates different feature extraction algorithms (such as rich features, CFA features, and CNN - based features), multiple training strategies (such as closed strategies, open strategies, and NetOpen strategies), and several open - set classifiers (such as SVM, OCSVM, WSVM, DBC, SSVM, PISVM, OSNN, etc.). Through these studies, the paper aims to find the most effective solution to meet the challenges of camera model identification under open - set conditions.