Abstract:Recently, many researches have demonstrated that the attention mechanism has great potential in improving the performance of deep convolutional neural networks (CNNs). However, the existing methods either ignore the importance of using channel attention and spatial attention mechanisms simultaneously or bring much additional model complexity. In order to achieve a balance between performance and model complexity, we propose the Hybrid Attention Module (HAM), a really lightweight yet efficient attention module. Given an intermediate feature map as the input feature, HAM firstly produces one channel attention map and one channel refined feature through the channel submodule, and then based on the channel attention map, the spatial submodule divides the channel refined feature into two groups along the channel axis to generate a pair of spatial attention descriptors. By applying saptial attention descriptors, the spatial submodule generates the final refined feature which can adaptively emphasize the important regions. Besides, HAM is a simple and general module, it can be embedded into various mainstream deep CNN architectures seamlessly and can be trained with base CNNs in the end-to-end way. We evaluate HAM through abundant of experiments on CIFAR-10, CIFAR-10 0 and STL-10 datasets. The experimental results show that HAM-integrated networks achieve accuracy improvements and further reduce the negative impact of less training data on deeper networks performance than its counterparts, which proves the effectiveness of HAM.(c) 2022 Elsevier Ltd. All rights reserved.

HOCA: HIGHER-ORDER CHANNEL ATTENTION FOR SINGLE IMAGE SUPER-RESOLUTION

Parallel-Connected Residual Channel Attention Network for Remote Sensing Image Super-Resolution

Image Super-Resolution Using Hybrid Attention Mechanism

Hyperspectral Image Super-Resolution with 1D-2D Attentional Convolutional Neural Network.

Second-Order Attention Network For Single Image Super-Resolution

Orientation-Aware Deep Neural Network for Real Image Super-Resolution.

HAM: Hybrid Attention Module in Deep Convolutional Neural Networks for Image Classification

Image Super-Resolution Using Very Deep Residual Channel Attention Networks

Kernel Attention Network for Single Image Super-Resolution

Efficient Residual Attention Network for Single Image Super-Resolution

Channel Attention and Multi-level Features Fusion for Single Image Super-Resolution

A Multi-Scale Layer-Channel Attention Network for Image Super-Resolution

Remote Sensing Image Super-Resolution via Mixed High-Order Attention Network

Hybrid Local and Nonlocal 3-D Attentive CNN for Hyperspectral Image Super-Resolution

Wider Channel Attention Network for Remote Sensing Image Super-resolution

Channel attention based wavelet cascaded network for image super-resolution

Hierarchical Accumulation Network with Grid Attention for Image Super-Resolution.

Mixed High-Order Non-Local Attention Network for Single Image Super-Resolution.

A Two-Stage Attentive Network for Single Image Super-Resolution

Remote Sensing Image Super-Resolution Based on Dense Channel Attention Network

Attention in Attention Network for Image Super-Resolution