Efficient Dual-branch Information Interaction Network for Lightweight Image Super-Resolution

Haonan Jin,Guangwei Gao,Juncheng Li,Zhenhua Guo,Yi Yu

DOI: https://doi.org/10.1109/tim.2024.3450063

IF: 5.6

2024-01-01

IEEE Transactions on Instrumentation and Measurement

Abstract:Recently, deep convolutional neural networks (CNNs) have achieved remarkable success in single-image super-resolution (SISR) tasks. However, these methods often suffer from high computational and memory requirements, limiting their practicality for real-world applications. To address this challenge, we propose a lightweight and efficient dual-branch information interaction network (DIIN) for SISR. DIIN adopts a dual-branch structure that differs from the typical serial network architectures. Specifically, we design the CNN branch and Transformer branch as parallel structures. In the CNN branch, we employ a symmetric dual-branch feature interaction module (DFIM) to extract valuable local feature information. Concurrently, the Transformer branch utilizes a recursive Transformer to capture long-term global information and enhance reconstructed image details. By simultaneously considering these two branches, our model effectively combines the strengths of CNN in extracting local information and Transformer in capturing global information. Recognizing the complementarity of these two branches in SISR, we further incorporate a coefficient learning scheme to enhance their information interaction and obtain more comprehensive feature information, thereby improving overall model performance. Extensive experiments demonstrate that our DIIN outperforms competitive methods while consuming fewer computational resources and memory.