Abstract:Demosaicking is the problem of reconstructing a color image from the raw image captured by a digital color camera that covers its only imaging sensor with a color filter array (CFA). Sparse representation-based demosaicking has been shown to produce superior reconstruction quality. However, almost all existing algorithms in this category use the CFAs, which are not specifically optimized for the algorithms. In this paper, we consider optimally designing CFAs for sparse representation-based demosaicking, where the dictionary is well-chosen. The fact that CFAs correspond to the projection matrices used in compressed sensing inspires us to optimize CFAs via minimizing the mutual coherence. This is more challenging than that for traditional projection matrices because CFAs have physical realizability constraints. However, most of the existing methods for minimizing the mutual coherence require that the projection matrices should be unconstrained, making them inapplicable for designing CFAs. We consider directly minimizing the mutual coherence with the CFA’s physical realizability constraints as a generalized fractional programming problem, which needs to find sufficiently accurate solutions to a sequence of nonconvex nonsmooth minimization problems. We adapt the redistributed proximal bundle method to address this issue. Experiments on benchmark images testify to the superiority of the proposed method. In particular, we show that a simple sparse representation-based demosaicking algorithm with our specifically optimized CFA can outperform LSSC [1]. To the best of our knowledge, it is the first sparse representation-based demosaicking algorithm that beats LSSC in terms of CPSNR.

Color Demosaicking with an Image Formation Model and Adaptive PCA.

Color demosaicking with sparse representations

Color demosaicking with the spatial alignment property of spectral Laplacians

Robust color demosaicking with adaptation to varying spectral correlations.

Demosaicking Enhancement Method for Color Image Based on Low-Rank Constraint

Color demosaicking via fully directional estimation

An Improved Color Image Demosaicking Algorithm

Deep Color Image Demosaicking with Feature Pyramid Channel Attention

Color image demosaicking via deep residual learning

Wavelet Frame Based Color Image Demosaicing

Convolutional Sparse Coding for Demosaicking with Panchromatic Pixels.

PPI Edge Infused Spatial-Spectral Adaptive Residual Network for Multispectral Filter Array Image Demosaicing

Channel-by-Channel Demosaicking Networks with Embedded Spectral Correlation

Demosaicking Based on Channel-Correlation Adaptive Dictionary Learning

Improved Color Demosaicking in Weak Spectral Correlation

Novel Color Demosaicking for Noisy Color Filter Array Data

Adaptive Multispectral Demosaicking Based on Frequency-Domain Analysis of Spectral Correlation

Multispectral Demosaicing Via Non-Local Low-Rank Regularization

Sparse Representation-Based Demosaicking Method for Joint Chromatic and Polarimetric Imagery

Optimized Color Filter Arrays for Sparse Representation-Based Demosaicking