Abstract:Hyperspectral image (HSI) classification has been extensively applied for analyzing remotely sensed images. HSI data consist of multiple bands that provide abundant spatial information. Convolutional neural networks (CNNs) have emerged as powerful deep learning methods for processing visual data. In recent work, CNNs have shown impressive results in HSI classification. In this paper, we propose a hierarchical neural network architecture called feature extraction with hybrid spectral CNN (FE-HybridSN) to extract superior spectral–spatial features. FE-HybridSN effectively captures more spectral–spatial information while reducing computational complexity. Considering the prevalent issue of class imbalance in experimental datasets (IP, UP, SV) and real-world hyperspectral datasets, we apply the focal loss to mitigate these problems. The focal loss reconstructs the loss function and facilitates effective achievement of the aforementioned goals. We propose a framework (FEHN-FL) that combines FE-HybridSN and the focal loss for HSI classification and then conduct extensive HSI classification experiments using three remote sensing datasets: Indian Pines (IP), University of Pavia (UP), and Salinas Scene (SV). Using cross-entropy loss as a baseline, we assess the hyperspectral classification performance of various backbone networks and examine the influence of different spatial sizes on classification accuracy. After incorporating focal loss as our loss function, we not only compare the classification performance of the FE-HybridSN backbone network under different loss functions but also evaluate their convergence rates during training. The proposed classification framework demonstrates satisfactory performance compared to state-of-the-art end-to-end deep-learning-based methods, such as 2D-CNN, 3D-CNN, etc.

Hierarchical Feature Fusion and Selection for Hyperspectral Image Classification

Hyperspectral Image Classification Based on Dual-Scale Dense Network with Efficient Channel Attentional Feature Fusion

A Multiscale Dual-Branch Feature Fusion and Attention Network for Hyperspectral Images Classification

Hierarchical Attention and Parallel Filter Fusion Network for Multisource Data Classification

Subpixel Multilevel Scale Feature Learning and Adaptive Attention Constraint Fusion for Hyperspectral Image Classification

Hyperspectral Image Spectral–Spatial Classification Method Based on Deep Adaptive Feature Fusion

Hierarchical Attention and Parallel Filter Fusion Network for Multi-Source Data Classification

Adaptive Spectral-Spatial Feature Fusion Network for Hyperspectral Image Classification Using Limited Training Samples

A Hybrid 3D–2D Feature Hierarchy CNN with Focal Loss for Hyperspectral Image Classification

Hyperspectral Image Classification Using Feature Fusion Hypergraph Convolution Neural Network

Feature-Decision Level Collaborative Fusion Network for Hyperspectral and LiDAR Classification

A Hierarchical Coarse–Fine Adaptive Fusion Network for the Joint Classification of Hyperspectral and LiDAR Data

Lightweight Multilevel Feature Fusion Network for Hyperspectral Image Classification

HAMNet: hyperspectral image classification based on hybrid neural network with attention mechanism and multi-scale feature fusion

Hyperspectral Image Classification Based on Two-Branch Spectral–Spatial-Feature Attention Network

Hyperspectral Image Classification Based on Multilevel Joint Feature Extraction Network

Hierarchical Multi-Scale Convolutional Neural Networks For Hyperspectral Image Classification

The real-time and stack fusion enhanced dual-channel network with attention modules for fast hyperspectral image classification

Feature Fusion via Deep Residual Graph Convolutional Network for Hyperspectral Image Classification

Integrating Hybrid Pyramid Feature Fusion and Coordinate Attention for Effective Small Sample Hyperspectral Image Classification