Improving Hyperspectral Image Classification with Compact Multi-Branch Deep Learning

Islam,Islam,Uddin,Ulhaq

DOI: https://doi.org/10.3390/rs16122069

IF: 5

2024-06-08

Remote Sensing

Abstract:The progress in hyperspectral image (HSI) classification owes much to the integration of various deep learning techniques. However, the inherent 3D cube structure of HSIs presents a unique challenge, necessitating an innovative approach for the efficient utilization of spectral data in classification tasks. This research focuses on HSI classification through the adoption of a recently validated deep-learning methodology. Challenges in HSI classification encompass issues related to dimensionality, data redundancy, and computational expenses, with CNN-based methods prevailing due to architectural limitations. In response to these challenges, we introduce a groundbreaking model known as "Crossover Dimensionality Reduction and Multi-branch Deep Learning" (CMD) for hyperspectral image classification. The CMD model employs a multi-branch deep learning architecture incorporating Factor Analysis and MNF for crossover feature extraction, with the selection of optimal features from each technique. Experimental findings underscore the CMD model's superiority over existing methods, emphasizing its potential to enhance HSI classification outcomes. Notably, the CMD model exhibits exceptional performance on benchmark datasets such as Salinas Scene (SC), Pavia University (PU), Kennedy Space Center (KSC), and Indian Pines (IP), achieving impressive overall accuracy rates of 99.35% and 99.18% using only 5% of the training data.

environmental sciences,imaging science & photographic technology,remote sensing,geosciences, multidisciplinary

What problem does this paper attempt to address?

The paper mainly proposes a new solution to address the challenges faced in the classification of Hyperspectral Images (HSIs). Specifically, the research focuses on how to improve the accuracy and efficiency of HSI classification, especially when dealing with high data dimensionality, redundant information, and high computational costs.

The proposed solution is a method called "Cross-Dimensional Reduction and Multi-Branch Deep Learning" (CMD). This method combines the advantages of Factor Analysis (FA) and Minimum Noise Fraction (MNF) techniques to effectively reduce data dimensionality while retaining key information. By selecting the optimal features from each technique, the CMD model can create a comprehensive and information-rich feature space, thereby enhancing the performance of classification tasks.

Additionally, the paper introduces a multi-branch deep learning architecture that includes multiple branches specifically designed to extract different features (such as spectral features and spatial features) from HSIs. This approach not only improves training efficiency but also better captures the complex patterns in HSI data, thereby improving classification results.

Experimental results show that the CMD model achieved remarkable performance on benchmark datasets such as Salinas Scene (SA), Pavia University (PU), Kennedy Space Center (KSC), and Indian Pines (IP). Notably, with only a small amount of training data, the overall accuracy reached 99.35% and 99.18%, respectively, indicating that the model has strong generalization capabilities.