Window Attention with Multiple Patterns for Single Image Super-Resolution

Xianwei Xiao,Baojiang Zhong

DOI: https://doi.org/10.1109/ictai59109.2023.00113

2023-01-01

Abstract:The non-local attention (NLA) is a generic method-ology that has proven its effectiveness in solving various image processing and computer vision tasks. Unfortunately, the NLA over the entire input image requires extremely high computational burden. A potential solution is to use the window attention instead, which restricts the NLA computation within a square window. However, this will sacrifice the capacity of capturing long-range dependencies (LRDs). To overcome the difficulty, a novel attention module termed the window attention with multiple patterns (WAMP) is proposed. In our WAMP, three window patterns are jointly exploited, including the square, horizontal, and vertical patterns, by which the attention receptive field can be expanded to the entire image for measuring LRDs with favorably low computational complexity. To cope with image features at different granularity levels, our WAMP is further performed with multiple window granularities. Moreover, by blending our WAMP with shift convolutions, a novel architectural element is also proposed, which incorporates non-local attention with local image information for boosting the model performance. To verify the effectiveness of our proposed attention module, a WAMP network is finally developed for conducting single image super-resolution (SISR). Extensive experimental results clearly demonstrate the superiority of our WAMP network over the state-of-the-art SISR methods.