Abstract:Convolutional neural network (CNN) is quite popular in computer vision, especially in image classification with excellent performance. However, limited by the convolution kernels, CNN-based classifiers are hard to extract global feature from the original image, while exact object locations in the environment are included in the global feature. One popular way to improve global feature extraction performance is to use graph neural network (GNN) which can aggregate global information through the connection relationship of different nodes. In this work, a novel end-to-end graph neural network architecture is proposed, in which local and global-attention feature are used simultaneously to achieve more accurate predictions. In this architecture, a CNN block is designed to learn local feature and graph convolutional neural network (GCN) is used to learn global feature. Global-attention feature for final prediction is down-sampled from global feature by the proposed global multi-head self-attention pooling (GMSAPool) based on self-attention mechanism, which reconstructs the input graph by introducing virtual node and automatically assigns different weights to each node to obtain a more representative global-attention feature. In addition, the proposed architecture can be trained without converting images to graphs in advance, and the computational burden can also be reduced. This approach is demonstrated on three open datasets (Agricultural Disease, Caltech256 and CIFAR-100) to validate the effectiveness. The determined experimental results showed that: (1) The proposed model achieve 84.46%, 77.80%, and 83.33% on the Macro-F1 in three datasets respectively, improving over the best baselines; (2) Global-attention feature that is more conducive to the final prediction is extracted by GMSAPool from numerous nodes, in which Macro-P,Macro-R and Macro-F1 are respectively improved 3.655%,1.12%,2.715% on average.

ClusterGNN: Cluster-based Coarse-to-Fine Graph Neural Network for Efficient Feature Matching

Learning to Match Features with Discriminative Sparse Graphneuralnetwork

Improving Sparse Graph Attention for Feature Matching by Informative Keypoints Exploration.

Learning Feature Matching via Matchable Keypoint-Assisted Graph Neural Network

FilterGNN: Image Feature Matching with Cascaded Outlier Filters and Linear Attention

Ensemble Quadratic Assignment Network for Graph Matching

Learn to Cluster Faces with Better Subgraphs

Local Clustering Graph Neural Networks

GLMNet: Graph Learning-Matching Networks for Feature Matching

AdaBoosting Clusters on Graph Neural Networks

CaEGCN: Cross-Attention Fusion based Enhanced Graph Convolutional Network for Clustering

Enhancing Performance of Coarsened Graphs with Gradient-Matching.

A GNN Architecture with Local and Global-Attention Feature for Image Classification

Graph Neural Networks Need Cluster-Normalize-Activate Modules

CAGNN: Cluster-Aware Graph Neural Networks for Unsupervised Graph Representation Learning

A Novel Two-Channel Classification Approach Using Graph Attention Network with K-Nearest Neighbor

ECGN: A Cluster-Aware Approach to Graph Neural Networks for Imbalanced Classification

Confidence-Based Simple Graph Convolutional Networks for Face Clustering

Robust Clustering Model Based on Attention Mechanism and Graph Convolutional Network

Feature Matching via Graph Clustering with Local Affine Consensus

Attention-driven Graph Clustering Network.