Abstract:Convolutional neural network (CNN) is quite popular in computer vision, especially in image classification with excellent performance. However, limited by the convolution kernels, CNN-based classifiers are hard to extract global feature from the original image, while exact object locations in the environment are included in the global feature. One popular way to improve global feature extraction performance is to use graph neural network (GNN) which can aggregate global information through the connection relationship of different nodes. In this work, a novel end-to-end graph neural network architecture is proposed, in which local and global-attention feature are used simultaneously to achieve more accurate predictions. In this architecture, a CNN block is designed to learn local feature and graph convolutional neural network (GCN) is used to learn global feature. Global-attention feature for final prediction is down-sampled from global feature by the proposed global multi-head self-attention pooling (GMSAPool) based on self-attention mechanism, which reconstructs the input graph by introducing virtual node and automatically assigns different weights to each node to obtain a more representative global-attention feature. In addition, the proposed architecture can be trained without converting images to graphs in advance, and the computational burden can also be reduced. This approach is demonstrated on three open datasets (Agricultural Disease, Caltech256 and CIFAR-100) to validate the effectiveness. The determined experimental results showed that: (1) The proposed model achieve 84.46%, 77.80%, and 83.33% on the Macro-F1 in three datasets respectively, improving over the best baselines; (2) Global-attention feature that is more conducive to the final prediction is extracted by GMSAPool from numerous nodes, in which Macro-P,Macro-R and Macro-F1 are respectively improved 3.655%,1.12%,2.715% on average.

Gaussian process image classification based on multi-layer convolution kernel function

Research on Image Classification Method of Features of Combinatorial Convolution

Large-margin multi-view Gaussian process for image classification

Exploring Kernel Based Spatial Context for CNN Based Hyperspectral Image Classification.

Image Classification Method Rationally Utilizing Spatial Information of the Image

Hyperspectral Image Classification Based on Spatial and Spectral Kernels Generation Network

Research on image classification method based on convolutional neural network

Deep Gabor Scattering Network for Image Classification.

Faster hyperspectral image classification based on selective kernel mechanism using deep convolutional networks

Deep convolutional Gaussian processes

Image Classification with Densely Sampled Image Windows and Generalized Adaptive Multiple Kernel Learning

Image classification using multiple kernel learning and sparse coding

Multi-dimensional deep dense residual networks and multiple kernel learning for hyperspectral image classification

A Multi-Kernel Mode Using a Local Binary Pattern and Random Patch Convolution for Hyperspectral Image Classification

A GNN Architecture with Local and Global-Attention Feature for Image Classification

Study On Image Classification With Convolution Neural Networks

An Effective Image Representation Method Using Kernel Classification

A Hierarchical Kernel for Image Classification Based on Layered Representation.

Midcn: A Multiple Instance Deep Convolutional Network For Image Classification

Large-margin multi-view Gaussian process

Kernel Product Neural Networks