Capsule Attention Module-Based CapsNet for Hyperspectral Image Classification

Xinsheng Zhang,Zhaohui Wang
DOI: https://doi.org/10.1117/12.2679994
2022-01-01
Abstract:Hyperspectral image (HSI) classification aims to assign each pixel with a proper land-cover label. Over the past few years, HSI classification using convolutional neural networks (CNNs) has progressed significantly. In spite of their effectiveness, CNN is not efficient in capturing the hierarchical structure of the entities in the images and does not fully consider the spatial information that is important to classification. Capsule network (CapsNet) preserves the hierarchy between different parts of the entity in an image by replacing scalar representations with vectors which has become an active area in the classification field in the past years. In this article, a capsule attention module-based CapsNet (CAM-CapsNet) is proposed which is not only employed to improve the performance of HSI classification but also to reduce the computation cost of the model. Specifically, 3-D convolutional layers are used to extract higher level spatial and spectral features. The local connection dynamic routing is proposed to reduce the number of parameters in the network. For the sake of boosting the representational capacity of CapsNet for spectral-spatial HSI classification, the network is improved by discriminating the significance of different spectral bands. A capsule attention module is designed to adaptively recalibrate spectral bands by selectively emphasizing informative bands and suppressing the less useful ones. The CAM-CapsNet was trained on three HSI datasets and achieved higher accuracy by comparing with some of the state-of-the-art models.
What problem does this paper attempt to address?