Abstract:Deep learning techniques have brought substantial performance gains to remote sensing image classification. Among them, convolutional neural networks (CNN) can extract rich spatial and spectral features from hyperspectral images in a short-range region, whereas graph convolutional networks (GCN) can model middle- and long-range spatial relations (or structural features) between samples on their graph structure. These different features make it possible to classify remote sensing images finely. In addition, hyperspectral images and light detection and ranging (LiDAR) images can provide spatial-spectral information and elevation information of targets on the Earth's surface, respectively. These multi-source remote sensing data can further improve classification accuracy in complex scenes. This paper proposes a classification method for HS and LiDAR data based on a dual-coupled CNN-GCN structure. The model can be divided into a coupled CNN and a coupled GCN. The former employs a weight-sharing mechanism to structurally fuse and simplify the dual CNN models and extracting the spatial features from HS and LiDAR data. The latter first concatenates the HS and LiDAR data to construct a uniform graph structure. Then, the dual GCN models perform structural fusion by sharing the graph structures and weight matrices of some layers to extract their structural information, respectively. Finally, the final hybrid features are fed into a standard classifier for the pixel-level classification task under a unified feature fusion module. Extensive experiments on two real-world hyperspectral and LiDAR data demonstrate the effectiveness and superiority of the proposed method compared to other state-of-the-art baseline methods, such as two-branch CNN and context CNN. In particular, the overall accuracy (99.11%) on Trento achieves the best classification performance reported so far.

DCG-Net: Enhanced Hyperspectral Image Classification with Dual-Branch Convolutional Neural Network and Graph Convolutional Neural Network Integration

A Dual-Branch Fusion of a Graph Convolutional Network and a Convolutional Neural Network for Hyperspectral Image Classification

CNN-Enhanced Graph Convolutional Network With Pixel- and Superpixel-Level Feature Fusion for Hyperspectral Image Classification

HDECGCN: A Heterogeneous Dual Enhanced Network Based on Hybrid CNNs Joint Multiscale Dynamic GCNs for Hyperspectral Image Classification

Graph Convolutional Network with Local and Global Feature Fusion for Hyperspectral Image Classification

Hyperspectral Image Classification Based on Fusion of Convolutional Neural Network and Graph Network

Dual-stream GNN fusion network for hyperspectral classification

Multi-feature fusion: Graph neural network and CNN combining for hyperspectral image classification

Attention Multihop Graph and Multiscale Convolutional Fusion Network for Hyperspectral Image Classification

Cross-Domain Hyperspectral Image Classification Based on Graph Convolutional Networks

Hyperspectral Image Classification Framework Based on Multichannel Graph Convolutional Networks and Class-Guided Attention Mechanism

Hyperspectral and SAR Image Classification Via Graph Convolutional Fusion Network

Superpixel Spectral–Spatial Feature Fusion Graph Convolution Network for Hyperspectral Image Classification

Dynamic Hypergraph Convolution and Recursive Gated Convolution Fusion Network for Hyperspectral Image Classification

Dual Graph U-Nets for Hyperspectral Image Classification.

Dual-Coupled CNN-GCN-Based Classification for Hyperspectral and LiDAR Data

Hyperspectral Image Classification with a Multiscale Fusion-Evolution Graph Convolutional Network Based on a Feature-Spatial Attention Mechanism

Fu-W:A Hyperspectral Image Classification Algorithm Combining Mini Graph Convolutional Networks and Convolutional Neural Network

Feature Fusion: Graph Attention Network and CNN Combing for Hyperspectral Image Classification

Hyperspectral Image Classification Based on Double-hop Graph Attention Multi-view Fusion Network