Abstract:Deep learning techniques have brought substantial performance gains to remote sensing image classification. Among them, convolutional neural networks (CNN) can extract rich spatial and spectral features from hyperspectral images in a short-range region, whereas graph convolutional networks (GCN) can model middle- and long-range spatial relations (or structural features) between samples on their graph structure. These different features make it possible to classify remote sensing images finely. In addition, hyperspectral images and light detection and ranging (LiDAR) images can provide spatial-spectral information and elevation information of targets on the Earth's surface, respectively. These multi-source remote sensing data can further improve classification accuracy in complex scenes. This paper proposes a classification method for HS and LiDAR data based on a dual-coupled CNN-GCN structure. The model can be divided into a coupled CNN and a coupled GCN. The former employs a weight-sharing mechanism to structurally fuse and simplify the dual CNN models and extracting the spatial features from HS and LiDAR data. The latter first concatenates the HS and LiDAR data to construct a uniform graph structure. Then, the dual GCN models perform structural fusion by sharing the graph structures and weight matrices of some layers to extract their structural information, respectively. Finally, the final hybrid features are fed into a standard classifier for the pixel-level classification task under a unified feature fusion module. Extensive experiments on two real-world hyperspectral and LiDAR data demonstrate the effectiveness and superiority of the proposed method compared to other state-of-the-art baseline methods, such as two-branch CNN and context CNN. In particular, the overall accuracy (99.11%) on Trento achieves the best classification performance reported so far.

Dual-Branch Dynamic Modulation Network for Hyperspectral and LiDAR Data Classification.

Multiscale 3-D-2-D Mixed CNN and Lightweight Attention-Free Transformer for Hyperspectral and LiDAR Classification

Dual-Branch Feature Fusion Network Based Cross-Modal Enhanced CNN and Transformer for Hyperspectral and LiDAR Classification

Multimodal Deep Learning for Semisupervised Classification of Hyperspectral and LiDAR Data

Multiscale and Multidirection Feature Extraction Network for Hyperspectral and LiDAR Classification

Remote Sensing Collaborative Classification Using Multimodal Adaptive Modulation Network

Multibranch Feature Fusion Network with Self- and Cross-Guided Attention for Hyperspectral and LiDAR Classification

Multi-Scale and Multi-Direction Feature Extraction Network for Hyperspectral and LiDAR Classification

A dual-branch multi-feature deep fusion network framework for hyperspectral image classification

Dual Graph Convolution Joint Dense Networks for Hyperspectral and LiDAR Data Classification

Discrepant Bi-Directional Interaction Fusion Network for Hyperspectral and LiDAR Data Classification

Joint Classification of Hyperspectral Images and LiDAR Data Based on Dual-Branch Transformer

Multiple Information Collaborative Fusion Network for Joint Classification of Hyperspectral and LiDAR Data

A Spatial-Spectral Bilinear Representation Fusion Network for Multimodal Classification

Combined Classification of Hyperspectral and LiDAR Data Based on Dual-Channel Cross-Transformer.

Dual-Branch Subpixel-Guided Network for Hyperspectral Image Classification

Hyperspectral and LiDAR Data Classification Using Spatial Context and De-Redundant Fusion Network.

Feature-Decision Level Collaborative Fusion Network for Hyperspectral and LiDAR Classification

A Dual-Branch Attention Fusion Deep Network for Multiresolution Remote-Sensing Image Classification

Dual-Coupled CNN-GCN-Based Classification for Hyperspectral and LiDAR Data

Multi-Level Interactive Fusion Network Based on Adversarial Learning for Fusion Classification of Hyperspectral and Lidar Data