Abstract:Recently, deep convolutional neural network (CNN) have been widely used in image restoration and obtained great success. However, most of existing methods are limited to local receptive field and equal treatment of different types of information. Besides, existing methods always use a multi-supervised method to aggregate different feature maps, which can not effectively aggregate hierarchical feature information. To address these issues, we propose an attention cube network (A-CubeNet) for image restoration for more powerful feature expression and feature correlation learning. Specifically, we design a novel attention mechanism from three dimensions, namely spatial dimension, channel-wise dimension and hierarchical dimension. The adaptive spatial attention branch (ASAB) and the adaptive channel attention branch (ACAB) constitute the adaptive dual attention module (ADAM), which can capture the long-range spatial and channel-wise contextual information to expand the receptive field and distinguish different types of information for more effective feature representations. Furthermore, the adaptive hierarchical attention module (AHAM) can capture the long-range hierarchical contextual information to flexibly aggregate different feature maps by weights depending on the global context. The ADAM and AHAM cooperate to form an 'attention in attention' structure, which means AHAM's inputs are enhanced by ASAB and ACAB. Experiments demonstrate the superiority of our method over state-of-the-art image restoration methods in both quantitative comparison and visual analysis.

Graph Attention Neural Network for Image Restoration.

Synergic feature attention for image restoration

Dynamic Attentive Graph Learning for Image Restoration

COLA-Net: Collaborative Attention Network for Image Restoration

Local to non-local: Multi-scale progressive attention network for image restoration

Dilated Strip Attention Network for Image Restoration

Efficient and Explicit Modelling of Image Hierarchies for Image Restoration

Pyramid Attention Networks for Image Restoration

SCGA‐Net: Skip Connections Global Attention Network for Image Restoration

Accurate Image Restoration with Attention Retractable Transformer

Mix-order Attention Networks for Image Restoration.

Pyramid Attention Network for Image Restoration

Image Restoration Via Deep Memory-Based Latent Attention Network

Non-Local Auto-Encoder With Collaborative Stabilization for Image Restoration.

Attention Cube Network for Image Restoration

Image Aesthetics Assessment Using Graph Attention Network

CAFIN: cross-attention based face image repair network

Aggregative and Contrastive Dual-View Graph Attention Network for Hyperspectral Image Classification

Attention-Based Real Image Restoration

Emphasizing Crucial Features for Efficient Image Restoration

Full-Attention Driven Graph Contrastive Learning: with Effective Mutual Information Insight