Abstract:The field of multi-source remote sensing observation is becoming increasingly dynamic through the integration of various remote sensing data sources. However, existing deep learning methods face challenges in differentiating between internal and external relationships and capturing fine spatial features. These models often struggle to effectively capture comprehensive information across remote sensing data bands, and they have inherent differences in the size, structure, and physical properties of different remote sensing datasets. To address these challenges, this paper proposes a novel geometric-algebra-based spectral–spatial hierarchical fusion network (GASSF-Net), which uses geometric algebra for the first time to process multi-source remote sensing images, enabling a more holistic approach to handling these images by simultaneously leveraging the real and imaginary components of geometric algebra to express structural information. This method captures the internal and external relationships between remote sensing image features and spatial information, effectively fusing the features of different remote sensing data to improve classification accuracy. GASSF-Net uses geometric algebra (GA) to represent pixels from different bands as multivectors, thus capturing the intrinsic relationships between spectral bands while preserving spatial information. The network begins by deeply mining the spectral–spatial features of a hyperspectral image (HSI) using pairwise covariance operators. These features are then extracted through two branches: a geometric-algebra-based branch and a real-valued network branch. Additionally, the geometric-algebra-based network extracts spatial information from light detection and ranging (LiDAR) to complement the elevation data lacking in the HSI. Finally, a genetic-algorithm-based cross-fusion module is introduced to fuse the HSI and LiDAR data for improved classification. Experiments conducted on three well-known datasets, Trento, MUUFL, and Houston, demonstrate that GASSF-Net significantly outperforms traditional methods in terms of classification accuracy and model efficiency.

DJSPNet: Deep Joint Statistical–Spatial Pooling Network for High-Resolution SAR Image Classification

Spnet: A Spectral Patching Network For End-To-End Hyperspectral Image Classification

A Feature Fusion-Net Using Deep Spatial Context Encoder and Nonstationary Joint Statistical Model for High-Resolution SAR Image Classification

High-Resolution SAR Image Classification Using Subspace Wavelet Encoding Network

Superpixel-Based Long-Range Dependent Network for High-Resolution Remote-Sensing Image Classification

SPNet: Spectral Patching End-to-End Classification Network for UAV-Borne Hyperspectral Imagery With High Spatial and Spectral Resolutions

High-Resolution SAR Image Classification Using Multi-Scale Deep Feature Fusion and Covariance Pooling Manifold Network

SDF2Net: Shallow to Deep Feature Fusion Network for PolSAR Image Classification

A Wavelet-Driven Subspace Basis Learning Network for High-Resolution Synthetic Aperture Radar Image Classification

Discriminant Deep Belief Network for High-Resolution SAR Image Classification.

SPHR-SAR-Net: Superpixel High-resolution SAR Imaging Network Based on Nonlocal Total Variation

FDFNet: A Fusion Network for Generating High-Resolution Fully PolSAR Images

Joint Classification of Hyperspectral and LiDAR Data Using Height Information Guided Hierarchical Fusion-and-Separation Network

Attention-Based Second-Order Pooling Network for Hyperspectral Image Classification

Deep Learning for Integrated Speckle Reduction and Super-Resolution in Multi-Temporal SAR

Multi-scale direction-aware SAR object detection network via global information fusion

MPT-SFANet: Multi-Order Pooling Transformer-Based Semantic Feature Aggregation Network for SAR Image Classification

Hyperspectral Image Classification Based on Fusing S3-PCA, 2D-SSA and Random Patch Network

Deep Spatial-Spectral Joint-Sparse Prior Encoding Network for Hyperspectral Target Detection

A Joint Convolutional Neural Network for Simultaneous Despeckling and Classification of SAR Targets

GASSF-Net: Geometric Algebra Based Spectral-Spatial Hierarchical Fusion Network for Hyperspectral and LiDAR Image Classification