Abstract:In contrast to conventional remote sensing images, hyperspectral remote sensing images are characterized by a greater number of spectral bands and exceptionally high resolution. The richness of both spectral and spatial information facilitates the precise classification of various objects within the images, establishing hyperspectral imaging as indispensable for remote sensing applications. However, the labor-intensive and time-consuming process of labeling hyperspectral images results in limited labeled samples, while challenges like spectral similarity between different objects and spectral variation within the same object further complicate the development of classification algorithms. Therefore, efficiently exploiting the spatial and spectral information in hyperspectral images is crucial for accomplishing the classification task. To address these challenges, this paper presents a Multi-Scale Feature Fusion Convolutional Neural Network (MSFF). The network introduces a dual branch spectral and spatial feature extraction module utilizing 3D depthwise separable convolution for joint spectral and spatial feature extraction, further refined by an attention based on central pixels (ACP) mechanism. Additionally, the spectral-spatial joint attention module (SSJA) is designed to interactively explore latent dependency between spectral and spatial information through the use of multilayer perceptron and global pooling operations. Finally, a feature fusion module (FF) and an adaptive multi-scale feature extraction module (AMSFE) are incorporated to enable adaptive feature fusion and comprehensive mining of feature information. Experimental results demonstrate that the proposed method performs exceptionally well on the IP, PU, and YRE datasets, delivering superior classification results compared to other methods and underscoring the potential and advantages of MSFF in hyperspectral remote sensing classification

Markov random field based spectral-spatial fusion network for hyperspectral image classification

Spatial-spectral Classification of Hyperspectral Images: a Deep Learning Framework with Markov Random Fields Based Modelling

Characterizing Markov Random Fields and Coefficient of Variations as Measures of Spatial Distributions for Hyperspectral Image Classification

Spectral–Spatial Hyperspectral Image Classification Using Cascaded Markov Random Fields

Lightweight Multiresolution Feature Fusion Network for Spectral Super-Resolution

Hyperspectral Image Classification with Markov Random Fields and a Convolutional Neural Network

Markov Random Fields Integrating Adaptive Interclass-Pair Penalty and Spectral Similarity for Hyperspectral Image Classification

Hyperspectral Image Classification Using Multi-Branch-multi-scale Residual Fusion Network

Integration of 3-dimensional discrete wavelet transform and Markov random field for hyperspectral image classification.

Spectral-Spatial Hyperspectral Image Classification Via Robust Low-Rank Feature Extraction and Markov Random Field.

MSFF: A Multi-Scale Feature Fusion Convolutional Neural Network for Hyperspectral Image Classification

Hyperspectral Image Classification Based on Fusing S<SUP>3</SUP>-PCA, 2D-SSA and Random Patch Network

Hyperspectral Image Classification Based on Fusing S3-PCA, 2D-SSA and Random Patch Network

A dual-branch multi-feature deep fusion network framework for hyperspectral image classification

Adaptive Markov Random Field Approach for Classification of Hyperspectral Imagery

Spectral-spatial Classification Based on Subspace Support Vector Machine and Markov Random Field

Superpixel-based Markov Random Field for Classification of Hyperspectral Images

A Deep Network Based on Multiscale Spectral-Spatial Fusion for Hyperspectral Classification.

Hyperspectral Image Classification Based on Multi-Scale Feature Fusion Residual Network

Hyperspectral Image Classification Based on Multiscale Spatial and Spectral Feature Network.

A Novel MRF-Based Multifeature Fusion for Classification of Remote Sensing Images