Abstract: The goal of image ordinal estimation is to estimate the ordinal label of a given image with a convolutional neural network. Existing methods are mainly based on ordinal regression and particularly focus on modeling the ordinal mapping from the feature representation of the input to the ordinal label space. However, the manifold of the resultant feature representations does not maintain the intrinsic ordinal relations of interest, which hinders the effectiveness of the image ordinal estimation. Therefore, this paper proposes learning intrinsic Consistent Ordinal REpresentations (CORE) from ordinal relations residing in groundtruth labels while encouraging the feature representations to embody the ordinal low-dimensional manifold. First, we develop an ordinal totally ordered set (toset) distribution (OTD), which can (i) model the label embeddings to inherit ordinal information and measure distances between ordered labels of samples in a neighborhood, and (ii) model the feature embeddings to infer numerical magnitude with unknown ordinal information among the features of different samples. Second, through OTD, we convert the feature representations and labels into the same embedding space for better alignment, and then compute the Kullback Leibler (KL) divergence between the ordinal labels and feature representations to endow the latent space with consistent ordinal relations. Third, we optimize the KL divergence through ordinal prototype-constrained convex programming with dual decomposition; our theoretical analysis shows that we can obtain the optimal solutions via gradient backpropagation. Extensive experimental results demonstrate that the proposed CORE can accurately construct an ordinal latent space and significantly enhance existing deep ordinal regression methods to achieve better results.

Deep and interpretable regression models for ordinal outcomes

Continuously Generalized Ordinal Regression for Linear and Deep Models

Transductive Ordinal Regression

A neural network approach to ordinal regression

Deep transformation models: Tackling complex regression problems with neural network based transformation models

Deep transformation models for functional outcome prediction after acute ischemic stroke

Deciphering Feature Effects on Decision-Making in Ordinal Regression Problems: an Explainable Ordinal Factorization Model.

Distributed Ordinal Regression Over Networks

Stabilized Sparse Ordinal Regression for Medical Risk Stratification

Revisiting image ordinal estimation: how to deal with ordinal relationship in deep learning?

CORE: Learning Consistent Ordinal REpresentations for Image Ordinal Estimation

Deep Ordinal Reinforcement Learning

Learning a binary search with a recurrent neural network. A novel approach to ordinal regression analysis

Improving Deep Regression with Ordinal Entropy

Kernel Discriminant Learning for Ordinal Regression

Robust Deep Ordinal Regression Under Label Noise

OrdinalCLIP: Learning Rank Prompts for Language-Guided Ordinal Regression

Explainable Ordinal Factorization Model: Deciphering the Effects of Attributes by Piece-wise Linear Approximation.

An interpretable neural network-based non-proportional odds model for ordinal regression

Tackling Ordinal Regression Problem for Heterogeneous Data: Sparse and Deep Multi-Task Learning Approaches

Penalized polytomous ordinal logistic regression using cumulative logits. Application to network inference of zero-inflated variables