Abstract:Recently, it is generally acknowledged that the receptive field size of visual cortical neurons are regulated by the stimulus in the neuroscience community. Thus, once the global receptive field is obtained, the network performance can be greatly improved. Unfortunately, the larger receptive field method has been rarely considered in constructing CNNs. Recent studies on network design have demonstrated that the key to improving model performance is channel attention. However, they usually neglect the location information. Hence, it is difficult to capture the long-term dependency of location information. In particular, the location information is important for generating spatially selective attention blocks. Therefore, in this paper, we propose a novel attention neural network termed "GEA" by embedding global context information into channel attention. Firstly, instead of channel attention, which is transformed from feature tensor to single feature vector via 2D pooling, our method decomposes the channel attention into two 1D feature encoding processes that aggregate features along two spatial directions. In particular, the long-term dependency can be captured by using one spatial direction as well as preserving accurate location information in the opposite direction. Then, we concatenate the results of the two directions, while carry out batch normalization and use relu activation function. In addition, the cross channel soft attention is used to adaptively select different spatial scales of the information. Finally, our method is simple and can be flexibly inserted into classic networks, such as ResNet and EfficientNet, with limited computational overhead. A large number of experiments show that our method is not only conducive to the classification of COCO and ImageNet, but also demonstrates promising performance for 3D features, such as Magnetic Resonance Imaging(MRI).

Global-Sampling Spatial-Attention Module and Its Application in Image Classification and Small Object Detection and Recognition

Nonlocal Spatial Attention Module for Image Classification

HAM: Hybrid Attention Module in Deep Convolutional Neural Networks for Image Classification

Attention Graph: Learning Effective Visual Features for Large-Scale Image Classification

Adaptive Attention Module for Image Recognition Systems in Autonomous Driving

Improved deep CNNs based on Nonlinear Hybrid Attention Module for image classification

Local-Global Attention: An Adaptive Mechanism for Multi-Scale Feature Integration

A Symmetric Efficient Spatial and Channel Attention (ESCA) Module Based on Convolutional Neural Networks

Object detection based on an adaptive attention mechanism

Spatial Global Context Attention for Convolutional Neural Networks: an Efficient Method

An Attention Module for Convolutional Neural Networks

Mixed Attention Mechanism for Small-Sample Fine-grained Image Classification

Lightweight Attention Module for Deep Learning on Classification and Segmentation of 3-D Point Clouds

GEA-net - Global Embedded Attention Neural Network for Image Classification.

Efficient-Receptive Field Block with Group Spatial Attention Mechanism for Object Detection.

Spatial Group and Cross-Channel Attention: Make Smaller Models More Effective, Focus on High-Level Semantic Features

Learn to Pay Attention Via Switchable Attention for Image Recognition

Small object detection based on attention mechanism and enhanced network

All the attention you need: Global-local, spatial-channel attention for image retrieval

Research on A Three-Dimensional Attention Module.

A Novel Global Spatial Attention Mechanism in Convolutional Neural Network for Medical Image Classification