Abstract:In contrast to conventional remote sensing images, hyperspectral remote sensing images are characterized by a greater number of spectral bands and exceptionally high resolution. The richness of both spectral and spatial information facilitates the precise classification of various objects within the images, establishing hyperspectral imaging as indispensable for remote sensing applications. However, the labor-intensive and time-consuming process of labeling hyperspectral images results in limited labeled samples, while challenges like spectral similarity between different objects and spectral variation within the same object further complicate the development of classification algorithms. Therefore, efficiently exploiting the spatial and spectral information in hyperspectral images is crucial for accomplishing the classification task. To address these challenges, this paper presents a Multi-Scale Feature Fusion Convolutional Neural Network (MSFF). The network introduces a dual branch spectral and spatial feature extraction module utilizing 3D depthwise separable convolution for joint spectral and spatial feature extraction, further refined by an attention based on central pixels (ACP) mechanism. Additionally, the spectral-spatial joint attention module (SSJA) is designed to interactively explore latent dependency between spectral and spatial information through the use of multilayer perceptron and global pooling operations. Finally, a feature fusion module (FF) and an adaptive multi-scale feature extraction module (AMSFE) are incorporated to enable adaptive feature fusion and comprehensive mining of feature information. Experimental results demonstrate that the proposed method performs exceptionally well on the IP, PU, and YRE datasets, delivering superior classification results compared to other methods and underscoring the potential and advantages of MSFF in hyperspectral remote sensing classification

ISSP-Net: An Interactive Spatial-Spectral Perception Network for Multimodal Classification

Spnet: A Spectral Patching Network For End-To-End Hyperspectral Image Classification

Attention in Attention for Hyperspectral with High Spatial Resolution (H) Image Classification

Relationship Learning From Multisource Images via Spatial-Spectral Perception Network

A Semantically Nonredundant Continuous-Scale Feature Network for Panchromatic and Multispectral Classification

Hyperspectral Image Classification Based on Fusing S3-PCA, 2D-SSA and Random Patch Network

Hyperspectral Image Classification Based on Fusing S<SUP>3</SUP>-PCA, 2D-SSA and Random Patch Network

Spectral–Spatial Feature Extraction Network With SSM–CNN for Hyperspectral–Multispectral Image Collaborative Classification

Hyperspectral image classification based on multiscale piecewise spectral-spatial attention network

Spatial--spectral FFPNet: Attention-Based Pyramid Network for Segmentation and Classification of Remote Sensing Images

SSCNet: A Spectrum-Space Collaborative Network for Semantic Segmentation of Remote Sensing Images

SSMU-Net: A Style Separation and Mode Unification Network for Multimodal Remote Sensing Image Classification

Center-similarity spectral-spatial attention network for hyperspectral image classification

Intra- and Intersource Interactive Representation Learning Network for Remote Sensing Images Classification

MSFF: A Multi-Scale Feature Fusion Convolutional Neural Network for Hyperspectral Image Classification

MS2CANet: Multiscale Spatial–Spectral Cross-Modal Attention Network for Hyperspectral Image and LiDAR Classification

Subpixel Mapping of Hyperspectral Image Based on Multiscale and Multifeature

A multimodal hyper-fusion transformer for remote sensing image classification

Hyperspectral and SAR Image Classification via Multiscale Interactive Fusion Network

Dual-Branch Spectral–Spatial Attention Network for Hyperspectral Image Classification

Spectral–Spatial Fusion Sub-Pixel Mapping Based on Deep Neural Network