Abstract:Image demosaicing and denoising are two important processes in the ISP pipeline of mobile cameras, because almost all mobile cameras in use today require colorful images generated by demosaicing algorithm, and the small sensor area of mobile cameras triggers low signal-to-noise ratio. Over the years, a considerable number of sequential demosaicing and denoising methods have been proposed, while they suffer from estimating the noise distribution and adjusting the hyper-parameters in order to balance demosaicing and denoising. There exit simultaneous demosaicing and denoising methods solving these problems. But they lack guidelines designed for mobile cameras. We propose a Plug-and-Play (PnP) demosaicing and denoising method on mobile cameras. Our method is built on PnP demosaicing framework which is derived from variable splitting theory. Any color demosaicing algorithm (i.e., bilinear, Malvar) can be plugged into our framework. We novelly trained an ISO conditioned denoiser for the framework and iteratively apply the denoiser in it. The ISO conditioned denoiser not only removes noise from the demosaicing procedure itself but also noise from camera sensors. By introducing ISO settings to the denoiser, our method takes possession of the adaptability and robustness in various capturing environments under different camera settings. Our method has only two hyperparameters to tune, which eases the hyper-parameter adjustment in sequential demosaicing and denoising methods. Extensive experiments on synthetic datasets show that our method performs better than sequential demosaicing and denoising methods and is practical for mobile cameras.

A Microscopic Image Enhancement Algorithm and Its Implementation on Mobile Platforms

Microscopic image detail enhancement based on local window and extremum

Micro-image Definition Evaluation Using Multi-Scale Decomposition and Gradient Absolute Value

Smart-phone Phase Contrast Microscope with a Singlet Lens and Deep Learning

A Plug-and-play Demosaicing and Denoising Method on Mobile Cameras

Extreme-Quality Computational Imaging via Degradation Framework

Advancements in Quantitative Evaluation Methods for Optical Microscopic Images(Invited)

Practical Deep Raw Image Denoising on Mobile Devices

Image Display—Mobile Imaging and Interactive Image Processing

A Real-time Fusion System for Multi-focus Microscopic Images Based on Mobile Platform

Mobile-Deblur: A Clear Image Will on the Smart Device

Deep learning enhanced mobile-phone microscopy

The Study of Image Processing for Retinal Prosthesis Based on Android

Portable Microfluidic Chip Detection System for Cell Images

Rapid Image Deconvolution and Multiview Fusion for Optical Microscopy.

Efficient and Accurate Quantized Image Super-Resolution on Mobile NPUs, Mobile AI & AIM 2022 Challenge: Report

Joint RGB-Spectral Decomposition Model Guided Image Enhancement in Mobile Photography

A smartphone-supported portable micro-spectroscopy/imaging system to characterize morphology and spectra of samples at the microscale.

Comparative Sharpness Evaluation for Mobile Phone Photos.

Perceptual Image Enhancement for Smartphone Real-Time Applications