Abstract:With the development of hyperspectral sensors, the availability of hyperspectral images (HSIs) has increased significantly, prompting advancements in deep learning-based hyperspectral image classification (HSIC) methods. Recently, graph convolutional networks (GCNs) have been proposed to process graph-structured data in non-Euclidean domains, and have been used for HSIC. The superpixel segmentation should be implemented first in the GCN-based methods, however, it is difficult to manually select the optimal superpixel segmentation sizes to obtain the useful information for classification. To solve this problem, we constructed a HSIC model based on a multiscale feature search-based graph convolutional network (MFSGCN) in this study. Firstly, pixel-level features of HSIs are extracted sequentially using 3D asymmetric decomposition convolution and 2D convolution. Then, superpixel-level features at different scales are extracted using multilayer GCNs. Finally, the neural architecture search (NAS) method is used to automatically assign different weights to different scales of superpixel features. Thus, a more discriminative feature map is obtained for classification. Compared with other GCN-based networks, the MFSGCN network can automatically capture features and obtain higher classification accuracy. The proposed MFSGCN model was implemented on three commonly used HSI datasets and compared to some state-of-the-art methods. The results confirm that MFSGCN effectively improves accuracy.

What problem does this paper attempt to address?

The paper primarily aims to address a problem in Hyperspectral Image Classification (HSIC): how to effectively utilize superpixel features of different scales to improve classification accuracy. Specifically, the paper proposes solutions to the following issues: 1. **The problem of manually selecting the optimal superpixel segmentation size**: In methods based on Graph Convolutional Networks (GCNs), superpixel segmentation is required first. However, manually selecting the optimal superpixel segmentation size to obtain useful information for classification is very challenging. 2. **The limitations of single-scale GCN methods**: Single-scale GCN methods have limitations in capturing the subtle adjacency relationships between superpixels and may unevenly allocate the importance of features at different scales, leading to the model's inability to fully utilize information from all scales. To overcome the above challenges, the paper proposes a Multiscale Feature Search-based Graph Convolutional Network (MFSGCN). The key points of this method include: - **Multiscale feature extraction**: First, different scales of superpixels are used to segment the original image, and then multi-layer GCNs are used to fuse these different scales of superpixel features from fine to coarse. - **Neural Architecture Search (NAS)**: NAS methods are used to automatically assign different weights to superpixel features of different scales. In this way, it is more efficient to determine which scales of features are more important for the classification task. - **Combining CNN and GCN**: To alleviate the huge computational burden brought by pixel-level graph structures, the paper also employs Convolutional Neural Networks (CNNs), specifically 3D asymmetric decomposition convolution, to extract pixel-level features. Through the above methods, MFSGCN can automatically capture features and achieve higher classification accuracy. Additionally, the method has been experimentally validated on three commonly used hyperspectral image datasets and compared with some state-of-the-art methods, demonstrating the effectiveness and superiority of MFSGCN.

Multiscale Feature Search-Based Graph Convolutional Network for Hyperspectral Image Classification

Multiscale graph convolution residual network for hyperspectral image classification

Multi-scale feature learning via residual dynamic graph convolutional network for hyperspectral image classification

Pixel-Superpixel Level Multiscale Graph and Spectral–Spatial Representation Fusion Network for Hyperspectral Image Classification

A Multi-hop Graph Rectify Attention and Spectral Overlap Grouping Convolutional Fusion Network for Hyperspectral Image Classification

A Multihop Graph Rectify Attention and Spectral Overlap Grouping Convolutional Fusion Network for Hyperspectral Image Classification

Hyperspectral Image Classification with a Multiscale Fusion-Evolution Graph Convolutional Network Based on a Feature-Spatial Attention Mechanism

Hyperspectral Image Classification with Multi-Scale Graph Convolution Network

Attention Multihop Graph and Multiscale Convolutional Fusion Network for Hyperspectral Image Classification

Semi-Supervised Multiscale Dynamic Graph Convolution Network for Hyperspectral Image Classification

Multiscale Pixel-Level and Superpixel-Level Method for Hyperspectral Image Classification: Adaptive Attention and Parallel Multi-Hop Graph Convolution

Multi-Level Graph Convolutional Network with Automatic Graph Learning for Hyperspectral Image Classification

Multiscale Fusion Graph Convolutional Networks for Hyperspectral Image Classification.

Adaptive Multi-Feature Fusion Graph Convolutional Network for Hyperspectral Image Classification

Multiscale Semantic Alignment Graph Convolution Network for Single-Shot Learning Based Hyperspectral Image Classification

Multilevel Superpixel Structured Graph U-Nets for Hyperspectral Image Classification

Hypergraph Convolutional Network With Multiple Hyperedges Fusion for Hyperspectral Image Classification Under Limited Samples

Hybrid network model based on 3D convolutional neural network and scalable graph convolutional network for hyperspectral image classification

Hyperspectral Image Classification Framework Based on Multichannel Graph Convolutional Networks and Class-Guided Attention Mechanism

Adaptive Cross-Attention-Driven Spatial-Spectral Graph Convolutional Network for Hyperspectral Image Classification