Abstract:Color demosaicing is an essential step in the camera image processing pipeline, especially on hardware platforms for real-time video applications. Though many demosaicing algorithms have been proposed in the past two decades, there remains a substantial gap between industrial needs and academic research. On one hand, industry requires a high perceptual quality, artifact-free, and low-cost demosaicing algorithm that is noniterative and small window based ready to be implemented on a hardware platform with a limited line buffer. On the other hand, academia is targeting high PSNR/SSIM, with the computation cost and line buffer receiving second priority, and often a frame buffer and iterative operation are used. The cost, large line buffer and iteration requirement make most existing demosaicing algorithms inapplicable on hardware platforms. In this paper, we introduce a novel low-cost demosaicing algorithm to narrow the gap. We keep the operation window size and computation cost as the first priority and achieve both high PSNR/SSIM and visual perceptual quality compared to previous state-of-the-art methods on standard test datasets. We fully investigate the a priori knowledge of natural scene raw images and find several key cues that are beneficial to demosaicing. Our demosaicing algorithm is a smart fusion of these useful cues. Furthermore, we solve typical demosaicing issues that occur in many traditional methods, including false color artifacts, T-section closing, and zippering artifacts. The proposed method has no learning stage, no iteration operation, a small line buffer and a limited number of parameters, so it can easily be applied to hardware platforms.

An Efficient Combined Demosaicing and Zooming Algorithm for Digital Camera

Research on Zoom Algorithm Based on Dual Resolution Camera

A Plug-and-play Demosaicing and Denoising Method on Mobile Cameras

Photo-realistic continuous digital zooming for an asymmetrical dual camera system

Continuous Digital Zoom with Cross Attention for Dual Camera System

Continuous Digital Zooming Using Generative Adversarial Networks for Dual Camera System

MCFD: A Hardware-Efficient Noniterative Multicue Fusion Demosaicing Algorithm.

An Efficient Transformer For Demosaicing Via Compressed Multi-Branch Attention Mechanism.

Improved Color Image Demosaicing with Signal Correlation

A Demosaicing Algorithm Based on Adaptive Edge Sensitive and Fuzzy Assignment in CMOS Image Sensor

Low Cost Edge Sensing for High Quality Demosaicking

Demosaicing with improved edge direction detection

Joint Demosaicing and Subpixel-Based Down-Sampling for Bayer Images: A Fast Frequency-Domain Analysis Approach

Effective Color Filter Array Demosaicing Method

An advanced Demosaicing Algorithm and Hardware Design

An Improved Color Image Demosaicking Algorithm

DemosaicFormer: Coarse-to-Fine Demosaicing Network for HybridEVS Camera

A Mathematical Analysis and Implementation of Residual Interpolation Demosaicking Algorithms

Edge Pattern Based Demosaicking Algorithm of Color Filter Array

Efficient Unified Demosaicing for Bayer and Non-Bayer Patterned Image Sensors

Low Complexity Algorithm and VLSI Design of Joint Demosaicing and Denoising for Digital Still Camera