Abstract:Image degradation caused by noise and blur remains a persistent challenge in imaging systems, stemming from limitations in both hardware and methodology. Single-image solutions face an inherent tradeoff between noise reduction and motion blur. While short exposures can capture clear motion, they suffer from noise amplification. Long exposures reduce noise but introduce blur. Learning-based single-image enhancers tend to be over-smooth due to the limited information. Multi-image solutions using burst mode avoid this tradeoff by capturing more spatial-temporal information but often struggle with misalignment from camera/scene motion. To address these limitations, we propose a physical-model-based image restoration approach leveraging a novel dual-exposure Quad-Bayer pattern sensor. By capturing pairs of short and long exposures at the same starting point but with varying durations, this method integrates complementary noise-blur information within a single image. We further introduce a Quad-Bayer synthesis method (B2QB) to simulate sensor data from Bayer patterns to facilitate training. Based on this dual-exposure sensor model, we design a hierarchical convolutional neural network called QRNet to recover high-quality RGB images. The network incorporates input enhancement blocks and multi-level feature extraction to improve restoration quality. Experiments demonstrate superior performance over state-of-the-art deblurring and denoising methods on both synthetic and real-world datasets. The code, model, and datasets are publicly available at <a class="link-external link-https" href="https://github.com/zhaoyuzhi/QRNet" rel="external noopener nofollow">this https URL</a>.

Learning to Joint Remosaic and Denoise in Quad Bayer CFA via Universal Multi-scale Channel Attention Network.

Joint Demosaicing and Denoising with Gradient Guidance in Quad Bayer CFA

Inheriting Bayer's Legacy-Joint Remosaicing and Denoising for Quad Bayer Image Sensor

Dual-Focal Camera Hdr Imaging Based On Convolutional Neural Network

Inheriting Bayer's Legacy: Joint Remosaicing and Denoising for Quad Bayer Image Sensor

Frequency-Relevant Residual Learning for Multi-Modal Image Denoising.

Joint learning of RGBW color filter arrays and demosaicking

QCGFNet: A Lightweight Color Image Denoising Network

An Efficient Transformer For Demosaicing Via Compressed Multi-Branch Attention Mechanism.

Two-Stage CNN Model for Joint Demosaicing and Denoising of Burst Bayer Images

Modeling Dual-Exposure Quad-Bayer Patterns for Joint Denoising and Deblurring

A Two-Stage Convolutional Neural Network for Joint Demosaicking and Super-Resolution

Joint Demosaicking and Denoising Benefits from a Two-stage Training Strategy

Efficient Unified Demosaicing for Bayer and Non-Bayer Patterned Image Sensors

Joint Denoising and demosaicking of noisy CFA images based on inter-color correlation

Beyond Joint Demosaicking and Denoising: An Image Processing Pipeline for a Pixel-bin Image Sensor

Abandoning the Bayer-Filter to See in the Dark

Dual-branch feature fusion dehazing network via multispectral channel attention

Multispectral Fusion of RGB and NIR Images Using Weighted Least Squares and Convolution Neural Networks

Enhanced Coarse-to-Fine Network for Image Restoration from Under-Display Cameras.

Spatial Adaptive Filter Network With Scale-Sharing Convolution for Image Demoiréing