Abstract:Deep learning techniques have brought substantial performance gains to remote sensing image classification. Among them, convolutional neural networks (CNN) can extract rich spatial and spectral features from hyperspectral images in a short-range region, whereas graph convolutional networks (GCN) can model middle- and long-range spatial relations (or structural features) between samples on their graph structure. These different features make it possible to classify remote sensing images finely. In addition, hyperspectral images and light detection and ranging (LiDAR) images can provide spatial-spectral information and elevation information of targets on the Earth's surface, respectively. These multi-source remote sensing data can further improve classification accuracy in complex scenes. This paper proposes a classification method for HS and LiDAR data based on a dual-coupled CNN-GCN structure. The model can be divided into a coupled CNN and a coupled GCN. The former employs a weight-sharing mechanism to structurally fuse and simplify the dual CNN models and extracting the spatial features from HS and LiDAR data. The latter first concatenates the HS and LiDAR data to construct a uniform graph structure. Then, the dual GCN models perform structural fusion by sharing the graph structures and weight matrices of some layers to extract their structural information, respectively. Finally, the final hybrid features are fed into a standard classifier for the pixel-level classification task under a unified feature fusion module. Extensive experiments on two real-world hyperspectral and LiDAR data demonstrate the effectiveness and superiority of the proposed method compared to other state-of-the-art baseline methods, such as two-branch CNN and context CNN. In particular, the overall accuracy (99.11%) on Trento achieves the best classification performance reported so far.

A Deep Neural Network Combined CNN and GCN for Remote Sensing Scene Classification

A lightweight and stochastic depth residual attention network for remote sensing scene classification

Optimizing Spatial Relationships in GCN to Improve the Classification Accuracy of Remote Sensing Images

Fusing Deep Local And Global Features For Remote Sensing Image Scene Classification

Attention-Aware Deep Feature Embedding for Remote Sensing Image Scene Classification

A cnn-gcn framework for multi-label aerial image scene classification

A Deep Neural Network Combined With Context Features for Remote Sensing Scene Classification

Improving Remote Sensing Scene Classification By Integrating Global-Context And Local-Object Features

CNN-GCN Joint Network for Remote Sensing Scene Classification

Fusing Deep Features by Kernel Collaborative Representation for Remote Sensing Scene Classification

Remote Sensing Scene Classification Based on Global and Local Consistent Network.

Dual-Coupled CNN-GCN-Based Classification for Hyperspectral and LiDAR Data

Scene Classification Of High Resolution Remote Sensing Images Using Convolutional Neural Networks

Global Descriptors of Convolution Neural Networks for Remote Scene Images Classification

Integrating Multilayer Features of Convolutional Neural Networks for Remote Sensing Scene Classification.

Deep Feature Aggregation Framework Driven by Graph Convolutional Network for Scene Classification in Remote Sensing.

A Remote-Sensing Scene-Image Classification Method Based on Deep Multiple-Instance Learning with a Residual Dense Attention ConvNet

Multi-Output Network Combining GNN and CNN for Remote Sensing Scene Classification

GAN-Assisted Two-Stream Neural Network for High-Resolution Remote Sensing Image Classification.

Remote sensing scene classification based on high-order graph convolutional network

GLR-CNN: CNN-based Framework with Global Latent Relationship Embedding for High-resolution Remote Sensing Image Scene Classification