Spatial Adaptive Filter Network With Scale-Sharing Convolution for Image Demoiréing

Yong Xu,Zhiyu Wei,Ruotao Xu,Zihan Zhou,Zhuliang Yu

DOI: https://doi.org/10.1109/lsp.2024.3451948

2024-09-27

IEEE Signal Processing Letters

Abstract:Removing moiré patterns is a challenging task as it is a spatially varying degradation that varies in shape, color and scale. Existing image restoration models often rely on static convolutional neural networks (CNNs)-based architectures, and hence potentially suboptimal for addressing the diverse manifestations of moiré patterns across different images and spatial positions. To this end, we propose a spatially adaptive neural network for image demoiréing. This network introduces a dual-branch filter prediction module engineered to predict pixel-wise adaptive filters that can process moiré patterns of varying orientations and color-shift issues. To further tackle the challenge presented by scale variability, a scale-sharing convolution module is proposed, utilizing pixel-wise adaptive filters with multiple dilations to handle moiré patterns of different sizes but similar shapes effectively. Upon extensive evaluations of three benchmark datasets, our model consistently outperforms existing methods, yielding a PSNR improvement of over 0.37dB across all evaluated datasets and providing additional benefits in terms of model size.

engineering, electrical & electronic