Abstract:Photographing optoelectronic displays often introduces unwanted moiré patterns due to analog signal interference between the pixel grids of the display and the camera sensor arrays. This work identifies two problems that are largely ignored by existing image demoiréing approaches: 1) moiré patterns vary across different channels (RGB); 2) repetitive patterns are constantly observed. However, employing conventional convolutional (CNN) layers cannot address these problems. Instead, this paper presents the use of our recently proposed Shape concept. It was originally employed to model consistent features from fragmented regions, particularly when identical or similar objects coexist in an RGB-D image. Interestingly, we find that the Shape information effectively captures the moiré patterns in artifact images. Motivated by this discovery, we propose a ShapeMoiré method to aid in image demoiréing. Beyond modeling shape features at the patch-level, we further extend this to the global image-level and design a novel Shape-Architecture. Consequently, our proposed method, equipped with both ShapeConv and Shape-Architecture, can be seamlessly integrated into existing approaches without introducing additional parameters or computation overhead during inference. We conduct extensive experiments on four widely used datasets, and the results demonstrate that our ShapeMoiré achieves state-of-the-art performance, particularly in terms of the PSNR metric. We then apply our method across four popular architectures to showcase its generalization capabilities. Moreover, our ShapeMoiré is robust and viable under real-world demoiréing scenarios involving smartphone photographs.

Removing Moiré Patterns from Single Images

A Moiré Removal Method Based on Peak Filtering and Image Enhancement

On Tracing Screen Photos-A Moiré Pattern-based Approach

Mid: Tracing Screen Photos Via Moiré Patterns

Textured Image Demoiréing Via Signal Decomposition and Guided Filtering.

ShapeMoiré: Channel-Wise Shape-Guided Network for Image Demoiréing

Demoiréing of Camera-Captured Screen Images Using Deep Convolutional Neural Network

Adaptive detail extraction network for moiré pattern removal in screen photography

Coarse-to-fine Disentangling Demoiring Framework for Recaptured Screen Images

Single image veiling glare removal

Beyond Camera Motion Removing: How to Handle Outliers in Deblurring

Multi-frame Partially Saturated Images Blind Deconvolution

Image Deblurring Utilizing Inertial Sensors and a Short-Long-Short Exposure Strategy.

Mop Moiré Patterns Using MopNet

Self-Adaptively Learning to Demoiré from Focused and Defocused Image Pairs

Multibranch Wavelet-Based Network for Image Demoiréing

Self-Adaptively Learning to Demoire from Focused and Defocused Image Pairs

Spatial Adaptive Filter Network With Scale-Sharing Convolution for Image Demoiréing

Video Demoiréing with Deep Temporal Color Embedding and Video-Image Invertible Consistency

Toward Moiré-Free and Detail-Preserving Demosaicking

Recaptured Raw Screen Image and Video Demoiréing via Channel and Spatial Modulations