Abstract:Color demosaicing is an essential step in the camera image processing pipeline, especially on hardware platforms for real-time video applications. Though many demosaicing algorithms have been proposed in the past two decades, there remains a substantial gap between industrial needs and academic research. On one hand, industry requires a high perceptual quality, artifact-free, and low-cost demosaicing algorithm that is noniterative and small window based ready to be implemented on a hardware platform with a limited line buffer. On the other hand, academia is targeting high PSNR/SSIM, with the computation cost and line buffer receiving second priority, and often a frame buffer and iterative operation are used. The cost, large line buffer and iteration requirement make most existing demosaicing algorithms inapplicable on hardware platforms. In this paper, we introduce a novel low-cost demosaicing algorithm to narrow the gap. We keep the operation window size and computation cost as the first priority and achieve both high PSNR/SSIM and visual perceptual quality compared to previous state-of-the-art methods on standard test datasets. We fully investigate the a priori knowledge of natural scene raw images and find several key cues that are beneficial to demosaicing. Our demosaicing algorithm is a smart fusion of these useful cues. Furthermore, we solve typical demosaicing issues that occur in many traditional methods, including false color artifacts, T-section closing, and zippering artifacts. The proposed method has no learning stage, no iteration operation, a small line buffer and a limited number of parameters, so it can easily be applied to hardware platforms.

Efficient VLSI Architecture for Edge Sensing Anti-Aliasing Demosaicing

A Reconfigurable Convolution-in-Pixel CMOS Image Sensor Architecture

Weighted edge-based low-cost artifacts-free high-quality VLSI implementation for demosaicking

A Hardware Friendly Demosaicking Algorithm Based on Edge Sensing

Low Cost Edge Sensing for High Quality Demosaicking

Cost effective hardware based demosaicking algorithm for embedded system

MCFD: A Hardware-Efficient Noniterative Multicue Fusion Demosaicing Algorithm.

FPGA-based hardware implementation of new edge-directed interpolation algorithm

An Efficient Transformer For Demosaicing Via Compressed Multi-Branch Attention Mechanism.

PPI Edge Infused Spatial-Spectral Adaptive Residual Network for Multispectral Filter Array Image Demosaicing

Efficient Unified Demosaicing for Bayer and Non-Bayer Patterned Image Sensors

Adaptive joint demosaicing and Subpixel-based Down-sampling for Bayer image

VLSI Architecture for H.264 Integer-Pel Motion Estimation with Minimum Memory Bandwidth Requirement

Effective Color Filter Array Demosaicing Method

Joint Demosaicing and Subpixel-Based Down-Sampling for Bayer Images: A Fast Frequency-Domain Analysis Approach

An adaptive edge enhancement algorithm and hardware implementation

Hardware-Oriented Adaptive Multi-Resolution Motion Estimation Algorithm and Its Vlsi Architecture

FPGA Implementation of Feature Detection Algorithm Based on High Level Synthesis

An Efficient Adaptive Interpolation for Bayer CFA Demosaicking

Sub-pixel Downsampling of Video with Matching Highly Data Re-Use Hardware Architecture.

Inheriting Bayer's Legacy: Joint Remosaicing and Denoising for Quad Bayer Image Sensor