Abstract:Convolutional neural networks (CNNs) are one of the most successful computer vision systems to solve object recognition. Furthermore, CNNs have major applications in understanding the nature of visual representations in the human brain. Yet it remains poorly understood how CNNs actually make their decisions, what the nature of their internal representations is, and how their recognition strategies differ from humans. Specifically, there is a major debate about the question of whether CNNs primarily rely on surface regularities of objects, or whether they are capable of exploiting the spatial arrangement of features, similar to humans. Here, we develop a novel feature-scrambling approach to explicitly test whether CNNs use the spatial arrangement of features (i.e. object parts) to classify objects. We combine this approach with a systematic manipulation of effective receptive field sizes of CNNs as well as minimal recognizable configurations (MIRCs) analysis. In contrast to much previous literature, we provide evidence that CNNs are in fact capable of using relatively long-range spatial relationships for object classification. Moreover, the extent to which CNNs use spatial relationships depends heavily on the dataset, e.g. texture vs. sketch. In fact, CNNs even use different strategies for different classes within heterogeneous datasets (ImageNet), suggesting CNNs have a continuous spectrum of classification strategies. Finally, we show that CNNs learn the spatial arrangement of features only up to an intermediate level of granularity, which suggests that intermediate rather than global shape features provide the optimal trade-off between sensitivity and specificity in object classification. These results provide novel insights into the nature of CNN representations and the extent to which they rely on the spatial arrangement of features for object classification.

Exploring the Interchangeability of CNN Embedding Spaces

End-to-End Spatial Transform Face Detection and Recognition

Deep Model Transferability from Attribution Maps

Inability of spatial transformations of CNN feature maps to support invariant recognition

Comparison of Embedded Spaces for Deep Learning Classification

Convolutional Neural Network Image Classification Based on Different Color Spaces

Bridging the Semantic Latent Space Between Brain and Machine: Similarity is All You Need

What Does CNN Shift Invariance Look Like? A Visualization Study

A FEATURE EMBEDDING STRATEGY FOR HIGH-LEVEL CNN REPRESENTATIONS FROM MULTIPLE CONVNETS

From Bricks to Bridges: Product of Invariances to Enhance Latent Space Communication

Learning Geometric Invariance Features and Discrimination Representation for Image Classification via Spatial Transform Network and XGBoost Modeling

On the universality of neural encodings in CNNs

Measuring similarity between embedding spaces using induced neighborhood graphs

Visualizing and Comparing Convolutional Neural Networks

A novel feature-scrambling approach reveals the capacity of convolutional neural networks to learn spatial relations

On the Large-Scale Transferability of Convolutional Neural Networks.

Deeper Interpretability of Deep Networks

Understanding image representations by measuring their equivariance and equivalence

Complex Network for Complex Problems: A comparative study of CNN and Complex-valued CNN

Learning Cross Space Mapping Via DNN Using Large Scale Click-Through Logs

Transform-Invariant Convolutional Neural Networks for Image Classification and Search