Abstract:To read the final version please go to IEEE TGRS on IEEE Xplore. Convolutional neural networks (CNNs) have been attracting increasing attention in hyperspectral (HS) image classification, owing to their ability to capture spatial-spectral feature representations. Nevertheless, their ability in modeling relations between samples remains limited. Beyond the limitations of grid sampling, graph convolutional networks (GCNs) have been recently proposed and successfully applied in irregular (or non-grid) data representation and analysis. In this paper, we thoroughly investigate CNNs and GCNs (qualitatively and quantitatively) in terms of HS image classification. Due to the construction of the adjacency matrix on all the data, traditional GCNs usually suffer from a huge computational cost, particularly in large-scale remote sensing (RS) problems. To this end, we develop a new mini-batch GCN (called miniGCN hereinafter) which allows to train large-scale GCNs in a mini-batch fashion. More significantly, our miniGCN is capable of inferring out-of-sample data without re-training networks and improving classification performance. Furthermore, as CNNs and GCNs can extract different types of HS features, an intuitive solution to break the performance bottleneck of a single model is to fuse them. Since miniGCNs can perform batch-wise network training (enabling the combination of CNNs and GCNs) we explore three fusion strategies: additive fusion, element-wise multiplicative fusion, and concatenation fusion to measure the obtained performance gain. Extensive experiments, conducted on three HS datasets, demonstrate the advantages of miniGCNs over GCNs and the superiority of the tested fusion strategies with regards to the single CNN or GCN models. The codes of this work will be available at <a class="link-external link-https" href="https://github.com/danfenghong/IEEE_TGRS_GCN" rel="external noopener nofollow">this https URL</a> for the sake of reproducibility.

Hypergraph Convolutional Network With Multiple Hyperedges Fusion for Hyperspectral Image Classification Under Limited Samples

Hypergraph Convolutional Network for Hyperspectral Image Classification.

Hyperspectral Image Classification Based on Fusion of Convolutional Neural Network and Graph Network

A Multi-hop Graph Rectify Attention and Spectral Overlap Grouping Convolutional Fusion Network for Hyperspectral Image Classification

A Multihop Graph Rectify Attention and Spectral Overlap Grouping Convolutional Fusion Network for Hyperspectral Image Classification

HDECGCN: A Heterogeneous Dual Enhanced Network Based on Hybrid CNNs Joint Multiscale Dynamic GCNs for Hyperspectral Image Classification

Adaptive Multi-Feature Fusion Graph Convolutional Network for Hyperspectral Image Classification

Hyperspectral image classification using spectral-spatial hypergraph convolution neural network

Hyperspectral Image Classification Framework Based on Multichannel Graph Convolutional Networks and Class-Guided Attention Mechanism

Cnn-assisted multi-hop graph attention network for hyperspectral image classification

Dynamic Hypergraph Convolution and Recursive Gated Convolution Fusion Network for Hyperspectral Image Classification

Attention Multihop Graph and Multiscale Convolutional Fusion Network for Hyperspectral Image Classification

Hyperspectral Image Classification Using Feature Fusion Hypergraph Convolution Neural Network

Graph Convolutional Networks for Hyperspectral Image Classification

Spectral–Spatial Graph Convolutional Network with Dynamic-Synchronized Multiscale Features for Few-Shot Hyperspectral Image Classification

Graph Convolutional Network with Local and Global Feature Fusion for Hyperspectral Image Classification

Hyperspectral Image Classification with a Multiscale Fusion-Evolution Graph Convolutional Network Based on a Feature-Spatial Attention Mechanism

Multiscale Feature Search-Based Graph Convolutional Network for Hyperspectral Image Classification

Pyramid Cascaded Convolutional Neural Network with Graph Convolution for Hyperspectral Image Classification