Abstract:The field of multi-source remote sensing observation is becoming increasingly dynamic through the integration of various remote sensing data sources. However, existing deep learning methods face challenges in differentiating between internal and external relationships and capturing fine spatial features. These models often struggle to effectively capture comprehensive information across remote sensing data bands, and they have inherent differences in the size, structure, and physical properties of different remote sensing datasets. To address these challenges, this paper proposes a novel geometric-algebra-based spectral–spatial hierarchical fusion network (GASSF-Net), which uses geometric algebra for the first time to process multi-source remote sensing images, enabling a more holistic approach to handling these images by simultaneously leveraging the real and imaginary components of geometric algebra to express structural information. This method captures the internal and external relationships between remote sensing image features and spatial information, effectively fusing the features of different remote sensing data to improve classification accuracy. GASSF-Net uses geometric algebra (GA) to represent pixels from different bands as multivectors, thus capturing the intrinsic relationships between spectral bands while preserving spatial information. The network begins by deeply mining the spectral–spatial features of a hyperspectral image (HSI) using pairwise covariance operators. These features are then extracted through two branches: a geometric-algebra-based branch and a real-valued network branch. Additionally, the geometric-algebra-based network extracts spatial information from light detection and ranging (LiDAR) to complement the elevation data lacking in the HSI. Finally, a genetic-algorithm-based cross-fusion module is introduced to fuse the HSI and LiDAR data for improved classification. Experiments conducted on three well-known datasets, Trento, MUUFL, and Houston, demonstrate that GASSF-Net significantly outperforms traditional methods in terms of classification accuracy and model efficiency.

NCGLF 2 : Network combining global and local features for fusion of multisource remote sensing data

Multilayer Feature Fusion Network With Spatial Attention and Gated Mechanism for Remote Sensing Scene Classification

MGFN: A Multi-Granularity Fusion Convolutional Neural Network for Remote Sensing Scene Classification

GFFNet: Global Feature Fusion Network for Semantic Segmentation of Large-Scale Remote Sensing Images

GLF-Net: A Semantic Segmentation Model Fusing Global and Local Features for High-Resolution Remote Sensing Images

Attention Multihop Graph and Multiscale Convolutional Fusion Network for Hyperspectral Image Classification

A Spatial-Spectral Relation-Guided Fusion Network for Multisource Optical RS Image Classification

GLFNet: Combining Global and Local Information in Vehicle Re-Recognition

An End-to-End Local-Global-Fusion Feature Extraction Network for Remote Sensing Image Scene Classification

Global and Local Dual Fusion Network for Large-Ratio Cloud Occlusion Missing Information Reconstruction of a High-Resolution Remote Sensing Image

GLFuse: A Global and Local Four-Branch Feature Extraction Network for Infrared and Visible Image Fusion

GALFusion: Multi-Exposure Image Fusion via a Global–Local Aggregation Learning Network

Local–Global Feature Fusion Network for Efficient Hyperspectral Image Super-Resolution

Gradient Guided Multiscale Feature Collaboration Networks for Few-Shot Class-Incremental Remote Sensing Scene Classification

GASSF-Net: Geometric Algebra Based Spectral-Spatial Hierarchical Fusion Network for Hyperspectral and LiDAR Image Classification

Local–Global Multiscale Fusion Network for Semantic Segmentation of Buildings in SAR Imagery

SCGRFuse: An infrared and visible image fusion network based on spatial/channel attention mechanism and gradient aggregation residual dense blocks

Graph Representation Learning for Infrared and Visible Image Fusion

DGFNet: Dual Gate Fusion Network for Land Cover Classification in Very High-Resolution Images

GLFNet: Global-local fusion network for the segmentation in ultrasound images