Abstract:Hyperspectral image (HSI) classification has been extensively applied for analyzing remotely sensed images. HSI data consist of multiple bands that provide abundant spatial information. Convolutional neural networks (CNNs) have emerged as powerful deep learning methods for processing visual data. In recent work, CNNs have shown impressive results in HSI classification. In this paper, we propose a hierarchical neural network architecture called feature extraction with hybrid spectral CNN (FE-HybridSN) to extract superior spectral–spatial features. FE-HybridSN effectively captures more spectral–spatial information while reducing computational complexity. Considering the prevalent issue of class imbalance in experimental datasets (IP, UP, SV) and real-world hyperspectral datasets, we apply the focal loss to mitigate these problems. The focal loss reconstructs the loss function and facilitates effective achievement of the aforementioned goals. We propose a framework (FEHN-FL) that combines FE-HybridSN and the focal loss for HSI classification and then conduct extensive HSI classification experiments using three remote sensing datasets: Indian Pines (IP), University of Pavia (UP), and Salinas Scene (SV). Using cross-entropy loss as a baseline, we assess the hyperspectral classification performance of various backbone networks and examine the influence of different spatial sizes on classification accuracy. After incorporating focal loss as our loss function, we not only compare the classification performance of the FE-HybridSN backbone network under different loss functions but also evaluate their convergence rates during training. The proposed classification framework demonstrates satisfactory performance compared to state-of-the-art end-to-end deep-learning-based methods, such as 2D-CNN, 3D-CNN, etc.

An End-to-End Hyperspectral Image Classification Method Using Deep Convolutional Neural Network with Spatial Constraint

Deep CNN-based Hyperspectral Image Classification Using Discriminative Multiple Spatial-Spectral Feature Fusion

Hyperspectral Image Classification With Spatial Consistence Using Fully Convolutional Spatial Propagation Network

HSI-CNN: A Novel Convolution Neural Network for Hyperspectral Image

Hyperspectral Image Classification Using Hierarchical Spatial-Spectral Transformer

Digging More in Neural World: An Efficient Approach for Hyperspectral Image Classification Using Convolutional Neural Network.

Self-Supervised Convolutional Neural Network Via Spectral Attention Module for Hyperspectral Image Classification

Residual Spectral–Spatial Attention Network for Hyperspectral Image Classification

Cross Spectral-Spatial Convolutional Network for Hyperspectral Image Classification

HAMNet: hyperspectral image classification based on hybrid neural network with attention mechanism and multi-scale feature fusion

Joint spatial-spectral hyperspectral image classification based on convolutional neural network

Deep Prototypical Networks With Hybrid Residual Attention for Hyperspectral Image Classification

Hyperspectral Image Classification Method Based on 2d–3d CNN and Multibranch Feature Fusion

Spectral-spatial classification of hyperspectral imagery using a dual-channel convolutional neural network

An Effective Hyperspectral Image Classification Network Based on Multi-Head Self-Attention and Spectral-Coordinate Attention

A Hybrid 3D–2D Feature Hierarchy CNN with Focal Loss for Hyperspectral Image Classification

Bands Sensitive Convolutional Network for Hyperspectral Image Classification

High Efficient Deep Feature Extraction and Classification of Spectral-Spatial Hyperspectral Image Using Cross Domain Convolutional Neural Networks

Hyperspectral Image Classification Method Based on 2D–3D CNN and Multibranch Feature Fusion

Hyperspectral image reconstruction by deep convolutional neural network for classification.

Hyperspectral Image Classification Based on Multilevel Joint Feature Extraction Network