Abstract:Convolutional neural network (CNN) is quite popular in computer vision, especially in image classification with excellent performance. However, limited by the convolution kernels, CNN-based classifiers are hard to extract global feature from the original image, while exact object locations in the environment are included in the global feature. One popular way to improve global feature extraction performance is to use graph neural network (GNN) which can aggregate global information through the connection relationship of different nodes. In this work, a novel end-to-end graph neural network architecture is proposed, in which local and global-attention feature are used simultaneously to achieve more accurate predictions. In this architecture, a CNN block is designed to learn local feature and graph convolutional neural network (GCN) is used to learn global feature. Global-attention feature for final prediction is down-sampled from global feature by the proposed global multi-head self-attention pooling (GMSAPool) based on self-attention mechanism, which reconstructs the input graph by introducing virtual node and automatically assigns different weights to each node to obtain a more representative global-attention feature. In addition, the proposed architecture can be trained without converting images to graphs in advance, and the computational burden can also be reduced. This approach is demonstrated on three open datasets (Agricultural Disease, Caltech256 and CIFAR-100) to validate the effectiveness. The determined experimental results showed that: (1) The proposed model achieve 84.46%, 77.80%, and 83.33% on the Macro-F1 in three datasets respectively, improving over the best baselines; (2) Global-attention feature that is more conducive to the final prediction is extracted by GMSAPool from numerous nodes, in which Macro-P,Macro-R and Macro-F1 are respectively improved 3.655%,1.12%,2.715% on average.

An Effective End-to-End Image Matching Network with Attentional Graph Neural Networks

Learning Feature Matching via Matchable Keypoint-Assisted Graph Neural Network

A Concurrent Multiscale Detector for End-to-End Image Matching

Improving Sparse Graph Attention for Feature Matching by Informative Keypoints Exploration.

Attention Graph: Learning Effective Visual Features for Large-Scale Image Classification

Learning to Match Features with Seeded Graph Matching Network

Learning to Match Features with Discriminative Sparse Graphneuralnetwork

Attend and Guide (AG-Net): A Keypoints-driven Attention-based Deep Network for Image Recognition

A Novel Neural Network for Remote Sensing Image Matching

ParaFormer: Parallel Attention Transformer for Efficient Feature Matching

End-to-End Stereo Matching Network with Local Adaptive Awareness

A GNN Architecture with Local and Global-Attention Feature for Image Classification

Weakly Supervised Learning for Image Keypoint Matching Using Graph Convolutional Networks.

Image Keypoint Matching using Graph Neural Networks

Rf-Net: An End-To-End Image Matching Network Based On Receptive Field

Keypoint Matching for Point Cloud Registration Using Multiplex Dynamic Graph Attention Networks

MSGA-Net: Progressive Feature Matching via Multi-layer Sparse Graph Attention

Reference-Aware Adaptive Network for Image-Text Matching

PA-GM: Position-Aware Learning of Embedding Networks for Deep Graph Matching.

A Hierarchical Consensus Attention Network for Feature Matching of Remote Sensing Images

An Image Classification Method Based on Adaptive Attention Mechanism and Feature Extraction Network