Abstract:Convolutional neural networks (CNNs) for hyperspectral image (HSI) classification have generated good progress. Meanwhile, graph convolutional networks (GCNs) have also attracted considerable attention by using unlabeled data, broadly and explicitly exploiting correlations between adjacent parcels. However, the CNN with a fixed square convolution kernel is not flexible enough to deal with irregular patterns, while the GCN using the superpixel to reduce the number of nodes will lose the pixel-level features, and the features from the two networks are always partial. In this article, to make good use of the advantages of CNN and GCN, we propose a novel multiple feature fusion model termed attention multihop graph and multiscale convolutional fusion network (AMGCFN), which includes two subnetworks of multiscale fully CNN and multihop GCN to extract the multilevel information of HSI. Specifically, the multiscale fully CNN aims to comprehensively capture pixel-level features with different kernel sizes, and a multihead attention fusion module (MAFM) is used to fuse the multiscale pixel-level features. The multihop GCN systematically aggregates the multihop contextual information by applying multihop graphs on different layers to transform the relationships between nodes, and an MAFM is adopted to combine the multihop features. Finally, we design a cross-attention fusion module (CAFM) to adaptively fuse the features of two subnetworks. The AMGCFN makes full use of multiscale convolution and multihop graph features, which is conducive to the learning of multilevel contextual semantic features. Experimental results on three benchmark HSI datasets show that the AMGCFN has a better performance than a few state-of-the-art methods. Code: https://github.com/EdwardHaoz/IEEE_TGRS_AMGCFN.

GAF-Net: Graph Attention Fusion Network for Multi-View Semi-Supervised Classification

Structure fusion based on graph convolutional networks for semi-supervised classification

Adaptive Graph Fusion Learning for Multi-View Spectral Clustering

Multi-graph Fusion Graph Convolutional Networks with pseudo-label supervision

Learnable Graph Convolutional Network and Feature Fusion for Multi-view Learning

Semi-Supervised and Self-Supervised Classification with Multi-View Graph Neural Networks

Generative Essential Graph Convolutional Network for Multi-View Semi-Supervised Classification

Joint learning of feature and topology for multi-view graph convolutional network

Heterogeneous graph convolutional network for multi-view semi-supervised classification

Dual-stream GNN fusion network for hyperspectral classification

Graph Convolutional Network With Self-Augmented Weights for Semi-Supervised Multi-View Learning

MVF-Net: A Multi-view Fusion Network for Event-based Object Classification

Multi-view semi-supervised learning with adaptive graph fusion

Multi-View Clustering and Semi-Supervised Classification with Adaptive Neighbours

Multi-directional guidance network for fine-grained visual classification

Multi-feature fusion: Graph neural network and CNN combining for hyperspectral image classification

Attention Multihop Graph and Multiscale Convolutional Fusion Network for Hyperspectral Image Classification

Semisupervised Graph Neural Networks for Graph Classification

Semi-supervised multi-view graph convolutional networks with application to webpage classification

Joint long and short span self-attention network for multi-view classification