Abstract:Image classification is one of the fundamental problems in computer vision. Owing to the availability of large image datasets like ImageNet and YFCC100M, a plethora of research has been conducted to do high precision image classification and many remarkable achievements have been made. The success of most existing methods hinges on a basic hypothesis that the testing image set has the same distribution as the training image set. However, in many real applications, we cannot guarantee the validity of the i.i.d. hypothesis since the testing image set is unseen. It is thus desirable to learn an image classifier, which can perform well even in non-i.i.d. situations. In this paper, we propose a novel Causally Regularized Logistic Regression (CRLR) algorithm to address the non-i.i.d. problem without knowing testing data information by searching for causal features. The causal features refer to characteristics truly determining whether a special object belongs to a category or not. Algorithmically, we propose a causal regularizer for causal feature identification by jointly optimizing it with a logistic loss term. Assisted with the causal regularizer, we can estimate the causal contribution (causal effect) of each focal image feature (viewed as a treatment variable) by sample reweighting which ensures the distributions of all remaining image features between images with different focal feature levels are close. The resultant classifier will be based on the estimated causal contributions of the features, rather than traditional correlation-based contributions. To validate the e effectiveness of our CRLR algorithm, we manually construct a new image dataset from YFCC100M, simulating various non-i.i.d. situations in the real world, and conduct extensive experiments for image classification. Experimental results clearly demonstrate that our CRLR algorithm outperforms the state-of-the-art methods.

An Image Classification Method Based on Hyperedge Correlation

Learning and Exploiting Interclass Visual Correlations for Medical Image Classification

Image Classification Method by Combining Multi-features and Sparse Coding

Hyperspectral Image Classification with Hypergraph Modelling

Adaptive hypergraph learning and its application in image classification.

Image Classification Method Rationally Utilizing Spatial Information of the Image

Hypergraph-Induced Convolutional Networks for Visual Classification

Feature Correlation Hypergraph: Exploiting High-order Potentials for Multimodal Recognition

Efficient Multi-Label Classification with Hypergraph Regularization

Joint Hypergraph Learning for Tag-Based Image Retrieval

Elastic Net Hypergraph Learning for Image Clustering and Semi-supervised Classification

Image ranking via attribute boosted hypergraph

Color Image Edge Detection Based on HSI Color Space

Spectral-Spatial Constraint Hyperspectral Image Classification

Local Correntropy Matrix Representation for Hyperspectral Image Classification

On Image Classification: Correlation v.s. Causality.

Image edge enhancement for effective image classification

A Picture Matching Algorithm of Robust Hypercomplex Correlation

Web and personal image annotation by mining label correlation with relaxed visual graph embedding.

Correlative multi-label multi-instance image annotation

A simple and effective postprocessing method for image classification