Deep Residual Prototype Learning Network for Hyperspectral Image Classification

Yu Liu,Mingrui Su,Lu Liu,Chunchao Li,Yuanxi Peng,Jing Hou,Tian Jiang
DOI: https://doi.org/10.1117/12.2548524
2020-01-01
Abstract:Deep residual networks (ResNets) can learn deep feature representation from hyperspectral images ( HSIs), and therefore have been widely used for HSI classification. Despite their high accuracies, there still exist a lot of challenging cases, such as open world recognition, limited-sample learning and visualization of learned classification features, which cannot be well addressed. Most of the challenges in HSI classification can be attributed to the dependence on softmax based loss function and classifiers, which cause the lack of robustness for deep learning models and the hardness to visualize the learned classification features. To improve the robustness and achieve the visualization of learned classification features, we propose a novel learning framework called Residual Prototype Learning Network, a combination of residual network and prototypes learning mechanism. Under the framework, a prototype learning based loss function is proposed to enhance intra-class compactness and the inter-class separation of these feature representations; in addition, a prototype learning based classifier is simultaneously proposed to achieve the 2D or 3D visualization of the classification features. The effectiveness of our proposed learning framework is evaluated on several publicly available HSI benchmarks, and the experimental results show that our approach achieve better results than traditional softmax based ResNets.
What problem does this paper attempt to address?