Abstract: The goal of image ordinal estimation is to estimate the ordinal label of a given image with a convolutional neural network. Existing methods are mainly based on ordinal regression and particularly focus on modeling the ordinal mapping from the feature representation of the input to the ordinal label space. However, the manifold of the resultant feature representations does not maintain the intrinsic ordinal relations of interest, which hinders the effectiveness of the image ordinal estimation. Therefore, this paper proposes learning intrinsic Consistent Ordinal REpresentations (CORE) from ordinal relations residing in groundtruth labels while encouraging the feature representations to embody the ordinal low-dimensional manifold. First, we develop an ordinal totally ordered set (toset) distribution (OTD), which can (i) model the label embeddings to inherit ordinal information and measure distances between ordered labels of samples in a neighborhood, and (ii) model the feature embeddings to infer numerical magnitude with unknown ordinal information among the features of different samples. Second, through OTD, we convert the feature representations and labels into the same embedding space for better alignment, and then compute the Kullback Leibler (KL) divergence between the ordinal labels and feature representations to endow the latent space with consistent ordinal relations. Third, we optimize the KL divergence through ordinal prototype-constrained convex programming with dual decomposition; our theoretical analysis shows that we can obtain the optimal solutions via gradient backpropagation. Extensive experimental results demonstrate that the proposed CORE can accurately construct an ordinal latent space and significantly enhance existing deep ordinal regression methods to achieve better results.

Ordinal regularized manifold feature extraction for image ranking

Learning an Image Manifold for Retrieval

Image Feature Optimization Based on Nonlinear Dimensionality Reduction

Ordinal preserving projection: a novel dimensionality reduction method for image ranking

Learning with Both Unlabeled Data and Query Logs for Image Search.

Ordinal Preserving Projection

Multi-Manifold Ranking: Using Multiple Features for Better Image Retrieval.

CORE: Learning Consistent Ordinal REpresentations with Convex Optimization for Image Ordinal Estimation

Inequivalent manifold ranking for content-based image retrieval

Manifold-ranking Embedded Order Preserving Hashing for Image Semantic Retrieval

Efficient Manifold Ranking for Image Retrieval

A Novel Ranking Algorithm Based on Manifold Learning for CBIR System

LGSLRR: Towards fusing discriminative ordinal local and global structured low-rank representation for image recognition

Regularized Regression on Image Manifold for Retrieval

CORE: Learning Consistent Ordinal REpresentations for Image Ordinal Estimation

Non-Rigid Registration of Medical Images Based on Ordinal Feature and Manifold Learning

Multi-Modal Web Image Retrieval Using Manifold-Ranking

Fast Manifold Ranking with Local Bipartite Graph.

Manifold-Regularized Feature Selector for High-Resolution Aerial Photographs Categorization

Ordinal Distance Metric Learning with MDS for Image Ranking

Manifold-ranking based retrieval using k-regular nearest neighbor graph