Abstract:Geometric shape features have been widely used as strong predictors for image classification. Nevertheless, most existing classifiers such as deep neural networks (DNNs) directly leverage the statistical correlations between these shape features and target variables. However, these correlations can often be spurious and unstable across different environments (e.g., in different age groups, certain types of brain changes have unstable relations with neurodegenerative disease); hence leading to biased or inaccurate predictions. In this paper, we introduce a novel framework that for the first time develops invariant shape representation learning (ISRL) to further strengthen the robustness of image classifiers. In contrast to existing approaches that mainly derive features in the image space, our model ISRL is designed to jointly capture invariant features in latent shape spaces parameterized by deformable transformations. To achieve this goal, we develop a new learning paradigm based on invariant risk minimization (IRM) to learn invariant representations of image and shape features across multiple training distributions/environments. By embedding the features that are invariant with regard to target variables in different environments, our model consistently offers more accurate predictions. We validate our method by performing classification tasks on both simulated 2D images, real 3D brain and cine cardiovascular magnetic resonance images (MRIs). Our code is publicly available at <a class="link-external link-https" href="https://github.com/tonmoy-hossain/ISRL" rel="external noopener nofollow">this https URL</a>.

Deep and Structured Robust Information Theoretic Learning for Image Analysis

Robust Recognition via Information Theoretic Learning

Robust feature extraction via information theoretic learning

Robust Discriminative t-Linear Subspace Learning for Image Feature Extraction

Deep Information Theoretic Registration

Robust low-rank representation via residual projection for image classification

Robust Structured Nonnegative Matrix Factorization for Image Representation.

Robust sparse low-rank embedding for image dimension reduction

Robust and Discriminative Image Authentication Based on Standard Model Feature.

Discriminative models for robust image classification

Sparse fixed-rank representation for robust visual analysis.

Analysis and Improvement of Low Rank Representation for Subspace Segmentation

Learning Low-Rank Sparse Representations With Robust Relationship Inference for Image Memorability Prediction

Robust Multiview Feature Learning for RGB-D Image Understanding

On the Robustness of deep learning-based MRI Reconstruction to image transformations

Structurally Incoherent Low-Rank 2DLPP for Image Classification

A New Low-Rank Structurally Incoherent Algorithm for Robust Image Feature Extraction

Adaptive Structure-constrained Robust Latent Low-Rank Coding for Image Recovery

Dual low-rank structure embedding for robust visual information processing

Robust classwise and projective low-rank representation for image classification

Invariant Shape Representation Learning For Image Classification