A Multi-scale Network Based on Attention Mechanism for Hyperspectral Image Classification

Xin Luo,Baiyi Shu,Haoyang Yu,Hongjie Wang,Jiong Mu
DOI: https://doi.org/10.1145/3373509.3373560
2019-01-01
Abstract:In recent years, with the theoretical progress of deep learning and the improvement of computational power, more and more deep learning based work has been proposed and achieved good results. However, due to its particularity, hyperspectral image (HSI) is difficult to directly apply the theory and experience of traditional deep learning. For HSI, we mainly face the following problems: effective use of spatial and spectral information, lack of annotated datasets and large spectral dimensions. These problems make it difficult to classify. Generally, in order to solve these problems, some pre-processing methods, such as PCA, and mutual information, will be taken, but this will lose some useful information. On the other hand, people usually consider spatial information on a joint-learning way (take a pixel-centric patch as input), but this approach may lead to some useless information being taken into account. Therefore, we apply the attention model to the HSI classification and reduce the dimension in a way that can be learned, we believe that this can also help the network to be more easily concentrated on similar pixels without being affected by abnormal pixels. In summary, we propose a new attention-based network called ABMN (attention based multiscale network), which is mainly composed of a dimension reduction block and a multi-scale spatial information extraction block. And excellent results are obtained on two popular hyperspectral image sets (Pavia University scene, Indian Pines), OA is 99.66% and 100% respectively.
What problem does this paper attempt to address?