Nested Multi-Axis Learning Network for Single Image Super-Resolution

Xianwei Xiao,Baojiang Zhong
DOI: https://doi.org/10.1007/978-3-031-20868-3_36
2022-01-01
Abstract:Real-world images usually contain rich features at different granularity levels, such as illumination, edges, and textures. Performance of a deep-learning method for single image super-resolution (SISR) could be degraded if it fails to extract features over all granularity levels. To address this problem, a novel deep-learning network is proposed, which consists of a set of nested multi-axis learning blocks (NMLBs) and is thus termed the nested multi-axis learning network (NMLNet). Each NMLB has an outer multi-axis structure that contains 3 axes dedicated to extracting coarse-, medium-, and fine-grained features, respectively. With the concern that our human visual system is more sensitive to the medium-grained features (e.g., edges), the medium-grained axis further has an inner multi-axis structure, by which edge features are captured at a wide range of network depths. By transmitting image features via the nested multi-axis structure, efficient information propagation is achieved throughout our developed network. To boost the network performance, a two-tier attention block is also proposed, which adaptively rescales the extracted features in both channel and spatial domains to maximize the representation capacity of our network. Extensive experimental results show that the proposed NMLNet can deliver superior performance over a number of state-of-the-art SISR methods, especially with respect to the reconstruction quality of image edges.
What problem does this paper attempt to address?