Abstract:Color demosaicing is an essential step in the camera image processing pipeline, especially on hardware platforms for real-time video applications. Though many demosaicing algorithms have been proposed in the past two decades, there remains a substantial gap between industrial needs and academic research. On one hand, industry requires a high perceptual quality, artifact-free, and low-cost demosaicing algorithm that is noniterative and small window based ready to be implemented on a hardware platform with a limited line buffer. On the other hand, academia is targeting high PSNR/SSIM, with the computation cost and line buffer receiving second priority, and often a frame buffer and iterative operation are used. The cost, large line buffer and iteration requirement make most existing demosaicing algorithms inapplicable on hardware platforms. In this paper, we introduce a novel low-cost demosaicing algorithm to narrow the gap. We keep the operation window size and computation cost as the first priority and achieve both high PSNR/SSIM and visual perceptual quality compared to previous state-of-the-art methods on standard test datasets. We fully investigate the a priori knowledge of natural scene raw images and find several key cues that are beneficial to demosaicing. Our demosaicing algorithm is a smart fusion of these useful cues. Furthermore, we solve typical demosaicing issues that occur in many traditional methods, including false color artifacts, T-section closing, and zippering artifacts. The proposed method has no learning stage, no iteration operation, a small line buffer and a limited number of parameters, so it can easily be applied to hardware platforms.

A Hardware Friendly Demosaicking Algorithm Based on Edge Sensing

Cost effective hardware based demosaicking algorithm for embedded system

Efficient VLSI Architecture for Edge Sensing Anti-Aliasing Demosaicing

MCFD: A Hardware-Efficient Noniterative Multicue Fusion Demosaicing Algorithm.

FPGA-based hardware implementation of new edge-directed interpolation algorithm

Low Cost Edge Sensing for High Quality Demosaicking

A Plug-and-play Demosaicing and Denoising Method on Mobile Cameras

An Efficient Adaptive Interpolation for Bayer CFA Demosaicking

PPI Edge Infused Spatial-Spectral Adaptive Residual Network for Multispectral Filter Array Image Demosaicing

Hardware-Oriented Shallow Joint Demosaicing and Denoising.

Improved Bayer-pattern Demosaicking and Its Hardware Design

Bayer Demosaicking With Polynomial Interpolation

DemosaicFormer: Coarse-to-Fine Demosaicing Network for HybridEVS Camera

An adaptive edge enhancement algorithm and hardware implementation

Weighted edge-based low-cost artifacts-free high-quality VLSI implementation for demosaicking

Color demosaicking via fully directional estimation

An Efficient Transformer For Demosaicing Via Compressed Multi-Branch Attention Mechanism.

An Improved Color Image Demosaicking Algorithm

Low Complexity Algorithm and VLSI Design of Joint Demosaicing and Denoising for Digital Still Camera

A Hardware Friendly Haze Removal Method and Its Implementation