Abstract:In contrast to conventional remote sensing images, hyperspectral remote sensing images are characterized by a greater number of spectral bands and exceptionally high resolution. The richness of both spectral and spatial information facilitates the precise classification of various objects within the images, establishing hyperspectral imaging as indispensable for remote sensing applications. However, the labor-intensive and time-consuming process of labeling hyperspectral images results in limited labeled samples, while challenges like spectral similarity between different objects and spectral variation within the same object further complicate the development of classification algorithms. Therefore, efficiently exploiting the spatial and spectral information in hyperspectral images is crucial for accomplishing the classification task. To address these challenges, this paper presents a Multi-Scale Feature Fusion Convolutional Neural Network (MSFF). The network introduces a dual branch spectral and spatial feature extraction module utilizing 3D depthwise separable convolution for joint spectral and spatial feature extraction, further refined by an attention based on central pixels (ACP) mechanism. Additionally, the spectral-spatial joint attention module (SSJA) is designed to interactively explore latent dependency between spectral and spatial information through the use of multilayer perceptron and global pooling operations. Finally, a feature fusion module (FF) and an adaptive multi-scale feature extraction module (AMSFE) are incorporated to enable adaptive feature fusion and comprehensive mining of feature information. Experimental results demonstrate that the proposed method performs exceptionally well on the IP, PU, and YRE datasets, delivering superior classification results compared to other methods and underscoring the potential and advantages of MSFF in hyperspectral remote sensing classification

MFFNet: Multi-modal Feature Fusion Network for Instance Segmentation of Froth Flotation Images

MFF-Net: Towards Efficient Monocular Depth Completion With Multi-Modal Feature Fusion

MFFNet: Multimodal Feature Fusion Network for Point Cloud Semantic Segmentation

Multiscale Feature Fusion and Semi-Supervised Temporal-Spatial Learning for Performance Monitoring in the Flotation Industrial Process.

FNeXter: A Multi-Scale Feature Fusion Network Based on ConvNeXt and Transformer for Retinal OCT Fluid Segmentation

FDGSNet: A Multi-modal Gated Segmentation Network for Remote Sensing Image Based on Frequency Decomposition

MFVNet: a deep adaptive fusion network with multiple field-of-views for remote sensing image semantic segmentation

MFAFNet: A Lightweight and Efficient Network with Multi-Level Feature Adaptive Fusion for Real-Time Semantic Segmentation

LMFNet: An Efficient Multimodal Fusion Approach for Semantic Segmentation in High-Resolution Remote Sensing

FFNet: Feature Fusion Network for Few-shot Semantic Segmentation

CIMFNet: Cross-layer Interaction and Multiscale Fusion Network for Semantic Segmentation of High-Resolution Remote Sensing Images

SFFNet: A Wavelet-Based Spatial and Frequency Domain Fusion Network for Remote Sensing Segmentation

MFFNet: Multi-modal Feature Fusion Network for V-D-T Salient Object Detection

A Crossmodal Multiscale Fusion Network for Semantic Segmentation of Remote Sensing Data

MSFF: A Multi-Scale Feature Fusion Convolutional Neural Network for Hyperspectral Image Classification

DFFNet: An IoT-perceptive dual feature fusion network for general real-time semantic segmentation

Multi-View Feature Fusion and Rich Information Refinement Network for Semantic Segmentation of Remote Sensing Images

Multi-Modal Temporal Hypergraph Neural Network for Flotation Condition Recognition

AMFF-net: Adaptive Multi-Modal Feature Fusion Network for Image Classification

Deep Multimodal Fusion Network for Semantic Segmentation Using Remote Sensing Image and LiDAR Data

Frustum FusionNet: Amodal 3D Object Detection with Multi-Modal Feature Fusion