Abstract:Convolutional neural network (CNN) is quite popular in computer vision, especially in image classification with excellent performance. However, limited by the convolution kernels, CNN-based classifiers are hard to extract global feature from the original image, while exact object locations in the environment are included in the global feature. One popular way to improve global feature extraction performance is to use graph neural network (GNN) which can aggregate global information through the connection relationship of different nodes. In this work, a novel end-to-end graph neural network architecture is proposed, in which local and global-attention feature are used simultaneously to achieve more accurate predictions. In this architecture, a CNN block is designed to learn local feature and graph convolutional neural network (GCN) is used to learn global feature. Global-attention feature for final prediction is down-sampled from global feature by the proposed global multi-head self-attention pooling (GMSAPool) based on self-attention mechanism, which reconstructs the input graph by introducing virtual node and automatically assigns different weights to each node to obtain a more representative global-attention feature. In addition, the proposed architecture can be trained without converting images to graphs in advance, and the computational burden can also be reduced. This approach is demonstrated on three open datasets (Agricultural Disease, Caltech256 and CIFAR-100) to validate the effectiveness. The determined experimental results showed that: (1) The proposed model achieve 84.46%, 77.80%, and 83.33% on the Macro-F1 in three datasets respectively, improving over the best baselines; (2) Global-attention feature that is more conducive to the final prediction is extracted by GMSAPool from numerous nodes, in which Macro-P,Macro-R and Macro-F1 are respectively improved 3.655%,1.12%,2.715% on average.

GDC Block: Gradient-Guided Direction-Aware Convolution Block for Image Classification

Joint Demosaicing and Denoising with Gradient Guidance in Quad Bayer CFA

Completely Automated CNN Architecture Design Based on Blocks

Gradient-Aligned convolution neural network

Generalized Enhanced Convolution Block for Super-Resolution Networks

Gradient Local Binary Pattern for Convolutional Neural Networks

Dynamic Group Convolution for Accelerating Convolutional Neural Networks

A GNN Architecture with Local and Global-Attention Feature for Image Classification

Automatically Evolving CNN Architectures Based on Blocks

Evolving Block-Based Convolutional Neural Network for Hyperspectral Image Classification

Visualizing and Analyzing Convolution Neural Networks with Gradient Information

GC-Net: Global and Class Attention Blocks for Automated Glaucoma Classification

Searching Discriminative Regions for Convolutional Neural Networks in Fundus Image Classification With Genetic Algorithms

Hybrid Gabor Convolutional Networks

Gradient Local Binary Pattern Layer to Initialize the Convolutional Neural Networks

Local Channel Transformation for Efficient Convolutional Neural Network.

Adaptive Gabor convolutional networks

CDTNet: Improved Image Classification Method Using Standard, Dilated and Transposed Convolutions

Applying Improved Convolutional Neural Network in Image Classification

Confusion-Aware Convolutional Neural Network For Image Classification

A Gradient Boosting Approach for Training Convolutional and Deep Neural Networks