Abstract:Lightweight, high‐performance networks are important in vision perception systems. Recent research on convolutional neural networks has shown that attention mechanisms can significantly improve the network performance. However, existing approaches either ignore the significance of using both types of attention mechanisms (channel and space) simultaneously or increase the model complexity. In this study, we propose the adaptive attention module (AAM), which is a truly lightweight yet effective module that comprises channel and spatial submodules to balance model performance and complexity. The AAM initially utilizes the channel submodule to generate intermediate channel‐refined features. In this module, an adaptive mechanism enables the model to autonomously learn the weights between features extracted by global max pooling and global average pooling to adapt to different stages of the model, thus enhancing performance. The spatial submodule employs a group‐interact‐aggregate strategy to enhance the expression of important features. It groups the intermediate channel‐refined features along the channel dimension into multiple subfeatures for parallel processing and generates spatial attention feature descriptors and channelwise refined subfeatures for each subfeature; subsequently, it aggregates all the refined subfeatures and employs a "channel shuffle" operator to transfer information between different subfeatures, thereby generating the final refined features and adaptively emphasizing important regions. Additionally, AAM is a plug‐and‐play architectural unit that can be directly used to replace standard convolutions in various convolutional neural networks. Extensive tests on CIFAR‐100, ImageNet‐1k, BDD100K, and MS COCO demonstrate that AAM improves the baseline network performance under various models and tasks, thereby validating its versatility.

An Improved Method and Application of Recurrent Convolutional Neural Network with Self-attention Mechanism

Accurate salient object detection via dense recurrent connections and residual-based hierarchical feature integration.

Improved deep CNNs based on Nonlinear Hybrid Attention Module for image classification

Look Closer to See Better: Recurrent Attention Convolutional Neural Network for Fine-Grained Image Recognition

HAM: Hybrid Attention Module in Deep Convolutional Neural Networks for Image Classification

Improve Image Captioning By Self-Attention

Self-attentional Convolution for Neural Networks

Improvement of Residual Attention Network for Image Classification

An Image Classification Method Based on Adaptive Attention Mechanism and Feature Extraction Network

Enhanced Multihead Self-Attention Block Network for Remote Sensing Image Scene Classification

EAANet: Efficient Attention Augmented Convolutional Networks

Learning of Recurrent Convolutional Neural Networks with Applications in Pattern Recognition

Fine-grained Image Recognition Via Attention Interaction and Counterfactual Attention Network

Improved Inception-Residual Convolutional Neural Network for Object Recognition

Attend It Again: Recurrent Attention Convolutional Neural Network for Action Recognition

Generating Self-Attention Activation Maps for Visual Interpretations of Convolutional Neural Networks

Image Target Recognition Based on Improved Convolutional Neural Network

Adaptive Attention Module for Image Recognition Systems in Autonomous Driving

An Attention Module for Convolutional Neural Networks

Self-Attention Capsule Networks for Object Classification

An Improved Siamese Tracking Network Based on Self-Attention and Cross-Attention