Abstract:The training data distribution is often biased towards objects in certain orientations and illumination conditions. While humans have a remarkable capability of recognizing objects in out-of-distribution (OoD) orientations and illuminations, Deep Neural Networks (DNNs) severely suffer in this case, even when large amounts of training examples are available. Neurons that are invariant to orientations and illuminations have been proposed as a neural mechanism that could facilitate OoD generalization, but it is unclear how to encourage the emergence of such invariant neurons. In this paper, we investigate three different approaches that lead to the emergence of invariant neurons and substantially improve DNNs in recognizing objects in OoD orientations and illuminations. Namely, these approaches are (i) training much longer after convergence of the in-distribution (InD) validation accuracy, i.e., late-stopping, (ii) tuning the momentum parameter of the batch normalization layers, and (iii) enforcing invariance of the neural activity in an intermediate layer to orientation and illumination conditions. Each of these approaches substantially improves the DNN's OoD accuracy (more than 20% in some cases). We report results in four datasets: two datasets are modified from the MNIST and iLab datasets, and the other two are novel (one of 3D rendered cars and another of objects taken from various controlled orientations and illumination conditions). These datasets allow to study the effects of different amounts of bias and are challenging as DNNs perform poorly in OoD conditions. Finally, we demonstrate that even though the three approaches focus on different aspects of DNNs, they all tend to lead to the same underlying neural mechanism to enable OoD accuracy gains - individual neurons in the intermediate layers become invariant to OoD orientations and illuminations. We anticipate this study to be a basis for further improvement of deep neural networks' OoD generalization performance, which is highly demanded to achieve safe and fair AI applications.

Improving OOD Generalization of Pre-trained Encoders via Aligned Embedding-Space Ensembles

APE: Aligning Pretrained Encoders to Quickly Learn Aligned Multimodal Representations

Disentangling Factors of Variation in Deep Representations Using Adversarial Training.

Improving Pre-Trained Self-Supervised Embeddings Through Effective Entropy Maximization

Learning Meta-Embeddings by Using Ensembles of Embedding Sets

Holistic Sentence Embeddings for Better Out-of-Distribution Detection

Scalable Ensemble Diversification for OOD Generalization and Detection

The Role of Pretrained Representations for the OOD Generalization of Reinforcement Learning Agents

OOD-ENS: Cross-Validated Out-of-Distribution Ensemble Detector

Out-of-Distribution Detection via Deep Multi-Comprehension Ensemble

NeuralOOD: Improving Out-of-Distribution Generalization Performance with Brain-machine Fusion Learning Framework

Spatial Ensemble: a Novel Model Smoothing Mechanism for Student-Teacher Framework

EnAET: A Self-Trained Framework for Semi-Supervised and Supervised Learning With Ensemble Transformations

Towards out-of-distribution generalization in large-scale astronomical surveys: robust networks learn similar representations

Mean Embeddings with Test-Time Data Augmentation for Ensembling of Representations

GeRA: Label-Efficient Geometrically Regularized Alignment

A Clustering Ensemble Algorithm for Handling Deep Embeddings Using Cluster Confidence

Predicting the Performance of Foundation Models via Agreement-on-the-Line

Combining Supervised and Unsupervised Models Via Unconstrained Probabilistic Embedding

Starbucks: Improved Training for 2D Matryoshka Embeddings

Three approaches to facilitate invariant neurons and generalization to out-of-distribution orientations and illuminations