AdaRevD: Adaptive Patch Exiting Reversible Decoder Pushes the Limit of Image Deblurring

Xintian Mao,Qingli Li,Yan Wang

2024-06-13

Abstract:Despite the recent progress in enhancing the efficacy of image deblurring, the limited decoding capability constrains the upper limit of State-Of-The-Art (SOTA) methods. This paper proposes a pioneering work, Adaptive Patch Exiting Reversible Decoder (AdaRevD), to explore their insufficient decoding capability. By inheriting the weights of the well-trained encoder, we refactor a reversible decoder which scales up the single-decoder training to multi-decoder training while remaining GPU memory-friendly. Meanwhile, we show that our reversible structure gradually disentangles high-level degradation degree and low-level blur pattern (residual of the blur image and its sharp counterpart) from compact degradation representation. Besides, due to the spatially-variant motion blur kernels, different blur patches have various deblurring difficulties. We further introduce a classifier to learn the degradation degree of image patches, enabling them to exit at different sub-decoders for speedup. Experiments show that our AdaRevD pushes the limit of image deblurring, e.g., achieving 34.60 dB in PSNR on GoPro dataset.

Computer Vision and Pattern Recognition

What problem does this paper attempt to address?

The problem that this paper attempts to solve is that in the image deblurring task, existing methods reach performance saturation due to insufficient decoding capabilities. Although progress has been made in recent years in improving the effectiveness of image deblurring, the limited decoding capabilities limit the upper limit of existing state - of - the - art (SOTA) methods. For this reason, the paper proposes an innovative work - the Adaptive Patch Exiting Reversible Decoder (AdaRevD), aiming to explore the insufficient decoding capabilities of these methods.

Specifically, AdaRevD reconstructs a reversible decoder by inheriting the weights of a well - trained encoder, which not only expands the scale from single - decoder training to multi - decoder training, but also maintains GPU - memory - friendliness. In addition, this method gradually separates high - level degradation levels and low - level blur patterns (the residuals between the blurred image and its clear counterpart). For further optimization, the paper introduces a classifier to learn the degradation levels of image patches, enabling patches of different difficulties to exit at different sub - decoders, thereby achieving acceleration.

Experimental results show that AdaRevD significantly improves the limit of image deblurring. For example, a PSNR value of 34.60 dB is achieved on the GoPro dataset.