Revisiting image ordinal estimation: how to deal with ordinal relationship in deep learning?

Chao Zhang,Ce Zhu,Xun Xu
DOI: https://doi.org/10.1117/1.JEI.28.1.013025
IF: 0.829
2019-01-01
Journal of Electronic Imaging
Abstract:Image ordinal estimation usually defined as a regression or classification problem is challenging in computer vision. Many recent works simply implement deep convolutional neural networks (CNNs) to get ideal results, while they have not analyzed why it works well as conventional computer vision methods. We revisit the problem of image ordinal estimation and propose two methods on ordinal estimation. First, a double-task convolutional neural network model (DTCNN) is proposed by combining classification and regression objectives. Then we have analyzed why DTCNN works well from three perspectives: (1) the ordinal relationship between two tasks, (2) the coarse/fine category level for two tasks, and (3) neurons' activation on two tasks. To avoid choosing heuristic combination parameter, we further propose risk-based CNN (R-CNN) model to embed the ordinal constraint into classification task. Based on Bayesian risk rule, the category information and ordinal information are fused by a dynamic weighting loss function. Experimental results on two ordinal datasets show that both DTCNN and R-CNN obtain competitive performance. (C) 2019 SPIE and IS&T
What problem does this paper attempt to address?