Abstract:Convolutional neural networks (CNNs) for hyperspectral image (HSI) classification have generated good progress. Meanwhile, graph convolutional networks (GCNs) have also attracted considerable attention by using unlabeled data, broadly and explicitly exploiting correlations between adjacent parcels. However, the CNN with a fixed square convolution kernel is not flexible enough to deal with irregular patterns, while the GCN using the superpixel to reduce the number of nodes will lose the pixel-level features, and the features from the two networks are always partial. In this article, to make good use of the advantages of CNN and GCN, we propose a novel multiple feature fusion model termed attention multihop graph and multiscale convolutional fusion network (AMGCFN), which includes two subnetworks of multiscale fully CNN and multihop GCN to extract the multilevel information of HSI. Specifically, the multiscale fully CNN aims to comprehensively capture pixel-level features with different kernel sizes, and a multihead attention fusion module (MAFM) is used to fuse the multiscale pixel-level features. The multihop GCN systematically aggregates the multihop contextual information by applying multihop graphs on different layers to transform the relationships between nodes, and an MAFM is adopted to combine the multihop features. Finally, we design a cross-attention fusion module (CAFM) to adaptively fuse the features of two subnetworks. The AMGCFN makes full use of multiscale convolution and multihop graph features, which is conducive to the learning of multilevel contextual semantic features. Experimental results on three benchmark HSI datasets show that the AMGCFN has a better performance than a few state-of-the-art methods. Code: https://github.com/EdwardHaoz/IEEE_TGRS_AMGCFN.

Self-Adaption Multi-classifier Fusion Networks for Image Recognition

Multi-Scale Cross-Attention Fusion Network Based on Image Super-Resolution

Multiscale 3-D-2-D Mixed CNN and Lightweight Attention-Free Transformer for Hyperspectral and LiDAR Classification

AMFF-net: Adaptive Multi-Modal Feature Fusion Network for Image Classification

A Multi-Feature Fusion Model Based on Denoising Convolutional Neural Network and Attention Mechanism for Image Classification

Multilevel Features Fusion In Deep Convolutional Neural Networks

Attention Multihop Graph and Multiscale Convolutional Fusion Network for Hyperspectral Image Classification

On the Exploration of Convolutional Fusion Networks for Visual Recognition.

MCAFNet: Multi-Channel Attention Fusion Network-Based CNN For Remote Sensing Scene Classification

Multi-focus Image Fusion with Siamese Self-Attention Network

Multi-Scale Cross-Modal Spatial Attention Fusion for Multi-label Image Recognition.

A Global-Local Feature Adaptive Fusion Network for Image Scene Classification

Multilayer Feature Fusion Network With Spatial Attention and Gated Mechanism for Remote Sensing Scene Classification

MGFN: A Multi-Granularity Fusion Convolutional Neural Network for Remote Sensing Scene Classification

Multi-Stream Multi-Class Fusion of Deep Networks for Video Classification.

Multi-directional guidance network for fine-grained visual classification

Multi-modality Fusion Network for Action Recognition.

Fully Dense Multiscale Fusion Network for Hyperspectral Image Classification

Fusion that matters: convolutional fusion networks for visual recognition

A Multi-Scale Fusion Convolutional Neural Network for Face Detection.