Abstract:Deep Neural Network (DNN) models are widely used for image classification. While they offer high performance in terms of accuracy, researchers are concerned about if these models inappropriately make inferences using features irrelevant to the target object in a given image. To address this concern, we propose a metamorphic testing approach that assesses if a given inference is made based on irrelevant features. Specifically, we propose two metamorphic relations (MRs) to detect such unreliable inferences. These relations expect (a) the classification results with different labels or the same labels but less certainty from models after corrupting the relevant features of images, and (b) the classification results with the same labels after corrupting irrelevant features. The inferences that violate the metamorphic relations are regarded as unreliable inferences. Our evaluation demonstrated that our approach can effectively identify unreliable inferences for single-label classification models with an average precision of 64.1% and 96.4% for the two MRs, respectively. As for multi-label classification models, the corresponding precision for MR-1 and MR-2 is 78.2% and 86.5%, respectively. Further, we conducted an empirical study to understand the problem of unreliable inferences in practice. Specifically, we applied our approach to 18 pre-trained single-label image classification models and 3 multi-label classification models, and then examined their inferences on the ImageNet and COCO datasets. We found that unreliable inferences are pervasive. Specifically, for each model, more than thousands of correct classifications are actually made using irrelevant features. Next, we investigated the effect of such pervasive unreliable inferences, and found that they can cause significant degradation of a model's overall accuracy. After including these unreliable inferences from the test set, the model's accuracy can be significantly changed. Therefore, we recommend that developers should pay more attention to these unreliable inferences during the model evaluations. We also explored the correlation between model accuracy and the size of unreliable inferences. We found the inferences of the input with smaller objects are easier to be unreliable. Lastly, we found that the current model training methodologies can guide the models to learn object-relevant features to certain extent, but may not necessarily prevent the model from making unreliable inferences. We encourage the community to propose more effective training methodologies to address this issue.

ATOM: Automated Black-Box Testing of Multi-Label Image Classification Systems.

Automated Testing of Image Captioning Systems

A Combinatorial Interaction Testing Method for Multi-Label Image Classifier

Learning Image Labels On-the-fly for Training Robust Classification Models

Automatic Image Annotation Combining Svms and Knn Algorithm

A multi-label image classification method combining multi-stage image semantic information and label relevance

CoocNet: a Novel Approach to Multi-Label Text Classification with Improved Label Co-Occurrence Modeling

A Multi-label Image Recognition Algorithm Based on Spatial and Semantic Correlation Interaction.

Spatial Context-Aware Object-Attentional Network for Multi-Label Image Classification

To What Extent Do DNN-based Image Classification Models Make Unreliable Inferences?

Multimodal Learning for Multi-Label Image Classification.

MCDNet: An Infrared Small Target Detection Network Using Multi-Criteria Decision and Adaptive Labeling Strategy

Multi-label image annotation based on multi-model

Multi-label Image Annotation Based on Convolutional Neural Network

A combined method for multi-class image semantic segmentation

S-MAT: Semantic-Driven Masked Attention Transformer for Multi-Label Aerial Image Classification.

Automatic Image Annotation by Sequentially Learning From Multi-Level Semantic Neighborhoods

Metamorphic Testing for Object Detection Systems

Midcn: A Multiple Instance Deep Convolutional Network For Image Classification

When the Small-Loss Trick is Not Enough: Multi-Label Image Classification with Noisy Labels Applied to CCTV Sewer Inspections

Rethinking Crowdsourcing Annotation: Partial Annotation with Salient Labels for Multi-Label Image Classification