Abstract:Convolution neural networks (CNNs) are extensively utilized in hyperspectral image (HSI) classification due to their remarkable capability to extract features from patterns with fixed shapes. These networks have been shown to effectively capture features at the pixel level. However, the fixed shape of convolution kernels poses a challenge for CNNs to adapt to the diverse shapes found in HSIs. Graph neural networks (GNNs), particularly graph convolution networks (GCNs), possess robust feature extraction capabilities on graph structures and are extensively applied in HSI classification. However, one significant challenge in using GNNs is the selection of appropriate neighboring nodes for information aggregation. To address the existing challenges of GCN and CNN and leverage their respective advantages, this article introduces a novel patch-based CNN-GCN fusion classification network, named multiscale random-shape convolution and adaptive graph convolution fusion network (MRCAGCFN). It consists of a spectral transformation module (STM) and three main modules we proposed: a multiscale random-shape convolution (RSC) module for extracting convolution features, where the shape of the convolution kernel is randomized and a multiscale approach is applied to enhance adaptability to data with diverse shapes; an adaptive feature-fusion graph convolution module (AFGCM) for extracting graph convolution features, where the weights for neighborhood aggregation are learned adaptively to reduce feature fusion from dissimilar nodes and strengthen feature fusion from similar nodes; and an adaptive local feature processing module for processing features, where two different methods are employed to convert patch-level features to pixel-level features, thereby improving feature representation. MRCAGCFN combines the strengths of CNN and GCN while introducing enhancements to better accommodate diverse feature shapes. Experimental results on three HSI classification datasets demonstrate that our proposed MRCAGCFN outperforms some existing methods. The codes of our MRCAGCFN will be available at https://github.com/shengrunhua/MRCAGCFN.

HDECGCN: A Heterogeneous Dual Enhanced Network Based on Hybrid CNNs Joint Multiscale Dynamic GCNs for Hyperspectral Image Classification

Hypergraph Convolutional Network With Multiple Hyperedges Fusion for Hyperspectral Image Classification Under Limited Samples

CNN-Enhanced Graph Convolutional Network With Pixel- and Superpixel-Level Feature Fusion for Hyperspectral Image Classification

Semi-Supervised Multiscale Dynamic Graph Convolution Network for Hyperspectral Image Classification

Attention Multihop Graph and Multiscale Convolutional Fusion Network for Hyperspectral Image Classification

MSHCNet: Multi-Stream Hybridized Convolutional Networks with Mixed Statistics in Euclidean/Non-Euclidean Spaces and Its Application to Hyperspectral Image Classification

Hybrid network model based on 3D convolutional neural network and scalable graph convolutional network for hyperspectral image classification

Pyramid Cascaded Convolutional Neural Network with Graph Convolution for Hyperspectral Image Classification

Multi-scale feature learning via residual dynamic graph convolutional network for hyperspectral image classification

Hyperspectral Image Classification Framework Based on Multichannel Graph Convolutional Networks and Class-Guided Attention Mechanism

Hyperspectral Image Classification with a Multiscale Fusion-Evolution Graph Convolutional Network Based on a Feature-Spatial Attention Mechanism

Composite Neighbor-Aware Convolutional Metric Networks for Hyperspectral Image Classification

Spectral–Spatial Graph Convolutional Network with Dynamic-Synchronized Multiscale Features for Few-Shot Hyperspectral Image Classification

Multiscale Feature Search-Based Graph Convolutional Network for Hyperspectral Image Classification

Pixel-Superpixel Level Multiscale Graph and Spectral–Spatial Representation Fusion Network for Hyperspectral Image Classification

Multiscale Pixel-Level and Superpixel-Level Method for Hyperspectral Image Classification: Adaptive Attention and Parallel Multi-Hop Graph Convolution

Hyperspectral Image Classification Based on Fusion of Convolutional Neural Network and Graph Network

Multiscale Spatial-Spectral Convolutional Network with Image-Based Framework for Hyperspectral Imagery Classification.

Multiscale Random-Shape Convolution and Adaptive Graph Convolution Fusion Network for Hyperspectral Image Classification

Hypergraph Convolutional Network for Hyperspectral Image Classification.