Hybrid Attention Feature Refinement Network for Lightweight Image Super-Resolution in Metaverse Immersive Display

Kexin Wang,Xiaomin Yang,Gwanggil Jeon
DOI: https://doi.org/10.1109/tce.2023.3329813
2024-01-01
IEEE Transactions on Consumer Electronics
Abstract:Recently, single image super-resolution (SISR) has been an activate research topic for decades, which is a classical fundamental problem in low-level computer vision tasks. With the growth of digital twins technology, metaverse is constructed successfully in many areas. Then with the development of VR/AR equipment, a more efficient SISR network urgently needs to be proposed to meet the application needs of consumer electronics. However, in most SISR methods, the heavy computation and parameters are detrimental to the application in mobile edge computing. And the most lightweight methods lack the ability to retain long-range information and account to a nasty degradation of SR results. To alleviate above problems, we design a hybrid attention feature refinement network (HAFRN) to achieve multi-level information with a few parameters. Moreover, we also propose a newly local concatenate learning strategy, which can use coarse feature maps of shallow layers to maximum the authenticity of SR images step-by-step. In order to capture more feature details in channel, spatial and pixel, an efficient attention mechanism is performed on the network to make sure the interaction among different dimensions. Extensive experiments on five benchmark datasets have proven that the advantages of our method over the state-of-the-art approaches.
What problem does this paper attempt to address?