Abstract:In recent years, methods based on deep convolutional neural networks (CNNs) have dominated the classification task of hyperspectral images. Although CNN-based HSI classification methods have the advantages of spatial feature extraction, HSI images are characterized by approximately continuous spectral information, usually containing hundreds of spectral bands. CNN cannot mine and represent the sequence properties of spectral features well, and the transformer model of attention mechanism proves its advantages in processing sequence data. This study proposes a new spectral spatial kernel combined with the improved Vision Transformer (ViT) to jointly extract spatial spectral features to complete classification task. First, the hyperspectral data are dimensionally reduced by PCA; then, the shallow features are extracted with an spectral spatial kernel, and the extracted features are input into the improved ViT model. The improved ViT introduces a re-attention mechanism and a local mechanism based on the original ViT. The re-attention mechanism can increase the diversity of attention maps at different levels. The local mechanism is introduced into ViT to make full use of the local and global information of the data to improve the classification accuracy. Finally, a multi-layer perceptron is used to obtain the classification result. Among them, the Focal Loss function is used to increase the loss weight of small-class samples and difficult-to-classify samples in HSI data samples and reduce the loss weight of easy-to-classify samples, so that the network can learn more useful hyperspectral image information. In addition, using the Apollo optimizer to train the HSI classification model to better update and compute network parameters that affect model training and model output, thereby minimizing the loss function. We evaluated the classification performance of the proposed method on four different datasets, and achieved good classification results on urban land object classification, crop classification and mineral classification, respectively. Compared with the state-of-the-art backbone network, the method achieves a significant improvement and achieves very good classification accuracy.

Classification Algorithm Based on Spatial Continuity for Hyperspectral Image

An Integrated Classification Method for Thematic Mapper Imagery of Plain and Highland Terrains

A Hyperspectral Image Classification Method Based on the Nonlocal Attention Mechanism of a Multiscale Convolutional Neural Network.

Spectral-Spatial Classification of Hyperspectral Image Using Improved Functional Principal Component Analysis

A Spectral-Texture Kernel-Based Classification Method for Hyperspectral Images.

A Spectral-Spatial Classification of Hyperspectral Images Based on the Algebraic Multigrid Method and Hierarchical Segmentation Algorithm

An Innovative Method to Classify Remote Sensing Images Using Artificial Bee Colony Algorithm

A 3-stage Spectral-spatial Method for Hyperspectral Image Classification

Spectral-Spatial Classification of Hyperspectral Images Using Joint Bilateral Filter and Graph Cut Based Model.

Hyperspectral Classification Based on Spectral-Spatial Convolutional Neural Networks

An improved spectral-spatial classification framework for hyperspectral remote sensing images

Hyperspectral On-Board Classification Algorithm Based on Multiscale Feature Extraction

Study on the Classification Methods of the Hyperspectral Image Based on the Continuum Removed

Spatial information aided fine classification of hyperspectral images with similar spectrums

A Method of Spatial Mapping and Reclassification for High-Spatial-Resolution Remote Sensing Image Classification

A Hyperspectral Image Classification Method Based on Adaptive Spectral Spatial Kernel Combined with Improved Vision Transformer

Multilevel object based image classification over urban area based hierarchical image segmentation and invariant moments

Classification of Hyperspectral Imagery Based on Spectral Gradient, SVM and Spatial Random Forest

Classification of coastal areas by airborne hyperspectral image

Recent Advances on Spectral–Spatial Hyperspectral Image Classification: An Overview and New Guidelines

Hyperspectral Imagery Classification Based on Quick Shift