Abstract:In contrast to conventional remote sensing images, hyperspectral remote sensing images are characterized by a greater number of spectral bands and exceptionally high resolution. The richness of both spectral and spatial information facilitates the precise classification of various objects within the images, establishing hyperspectral imaging as indispensable for remote sensing applications. However, the labor-intensive and time-consuming process of labeling hyperspectral images results in limited labeled samples, while challenges like spectral similarity between different objects and spectral variation within the same object further complicate the development of classification algorithms. Therefore, efficiently exploiting the spatial and spectral information in hyperspectral images is crucial for accomplishing the classification task. To address these challenges, this paper presents a Multi-Scale Feature Fusion Convolutional Neural Network (MSFF). The network introduces a dual branch spectral and spatial feature extraction module utilizing 3D depthwise separable convolution for joint spectral and spatial feature extraction, further refined by an attention based on central pixels (ACP) mechanism. Additionally, the spectral-spatial joint attention module (SSJA) is designed to interactively explore latent dependency between spectral and spatial information through the use of multilayer perceptron and global pooling operations. Finally, a feature fusion module (FF) and an adaptive multi-scale feature extraction module (AMSFE) are incorporated to enable adaptive feature fusion and comprehensive mining of feature information. Experimental results demonstrate that the proposed method performs exceptionally well on the IP, PU, and YRE datasets, delivering superior classification results compared to other methods and underscoring the potential and advantages of MSFF in hyperspectral remote sensing classification

A Multi-branch Feature Fusion Model Based on Convolutional Neural Network for Hyperspectral Remote Sensing Image Classification

A Hyperspectral Image Classification Method Based on the Nonlocal Attention Mechanism of a Multiscale Convolutional Neural Network.

Aerial Scene Classification Via Multilevel Fusion Based on Deep Convolutional Neural Networks.

Hyperspectral Remote Sensing Images Deep Feature Extraction Based on Mixed Feature and Convolutional Neural Networks

Multiscale Spatial-Spectral Feature Extraction Network for Hyperspectral Image Classification

A Multiscale Dual-Branch Feature Fusion and Attention Network for Hyperspectral Images Classification

Multi-layer feature fusion for hyperspectral image classification

Hyperspectral Image Classification Based on Multilevel Joint Feature Extraction Network

MSFF: A Multi-Scale Feature Fusion Convolutional Neural Network for Hyperspectral Image Classification

A Novel 2D-3D CNN with Spectral-Spatial Multi-Scale Feature Fusion for Hyperspectral Image Classification

Hyperspectral Image Classification Based on Fusion of Convolutional Neural Network and Graph Network

Hyperspectral Image Classification Using Multi-Branch-multi-scale Residual Fusion Network

Three-branch attention deep model for hyperspectral image classification using cross fusion

A Multi-Branch Feature Fusion Strategy Based on an Attention Mechanism for Remote Sensing Image Scene Classification

Hyperspectral Classification Based on Spectral-Spatial Convolutional Neural Networks

An Enhanced Spectral Fusion 3D CNN Model for Hyperspectral Image Classification

A Joint Convolutional Cross ViT Network for Hyperspectral and Light Detection and Ranging Fusion Classification

Hyperspectral Image Classification with a Dense Multi-Scale Residual Network

Multiscale Information Fusion for Hyperspectral Image Classification Based on Hybrid 2D-3D CNN

Hyperspectral image classification using 3D-2D CNN with multi-scale information extraction and fusion module

A Hybrid 3D–2D Feature Hierarchy CNN with Focal Loss for Hyperspectral Image Classification