Abstract:With the development of modern image sensors enabling flexible image acquisition, single shot high dynamic range (HDR) imaging is becoming increasingly popular. In this work, we capture single shot HDR images using an imaging sensor with spatially varying gain/ISO. This allows all incoming photons to be used in the imaging. Previous methods on single shot HDR capture use spatially varying neutral density (ND) filters which lead to wasting incoming light. The main technical contribution in this work is an extension of previous HDR reconstruction approaches for single shot HDR imaging based on local polynomial approximations (Kronander et al., Unified HDR reconstruction from raw CFA data, 2013; Hajisharif et al., HDR reconstruction for alternating gain (ISO) sensor readout, 2014). Using a sensor noise model, these works deploy a statistically informed filtering operation to reconstruct HDR pixel values. However, instead of using a fixed filter size, we introduce two novel algorithms for adaptive filter kernel selection. Unlike a previous work, using adaptive filter kernels (Signal Process Image Commun 29(2):203–215, 2014), our algorithms are based on analyzing the model fit and the expected statistical deviation of the estimate based on the sensor noise model. Using an iterative procedure, we can then adapt the filter kernel according to the image structure and the statistical image noise. Experimental results show that the proposed filter de-noises the noisy image carefully while well preserving the important image features such as edges and corners, outperforming previous methods. To demonstrate the robustness of our approach, we have exploited input images from raw sensor data using a commercial off-the-shelf camera. To further analyze our algorithm, we have also implemented a camera simulator to evaluate different gain patterns and noise properties of the sensor.

Dynamic range enhancement algorithms for CMOS sensors with non-destructive readout

An Arithmetic of Enhancing Dynamic Range of CMOS Image Sensor

An Extending Dynamic Range Method Based on Digital Image Synthesis

A novel high dynamic range microscopic video system based on REC.2020

Adaptive dualISO HDR reconstruction

An Over 90 dB Intra-Scene Single-Exposure Dynamic Range CMOS Image Sensor Using a 3.0 μm Triple-Gain Pixel Fabricated in a Standard BSI Process

HDR Imaging with Quanta Image Sensors: Theoretical Limits and Optimal Reconstruction

Calibration based Minimalistic Multi-Exposure Digital Sensor Camera Robust Linear High Dynamic Range Enhancement Technique Demonstration

Using Spatially Varying Pixels Exposures and Bayer-covered Photosensors for High Dynamic Range Imaging

Enhancing the Surveillance Detection Range of Image Sensors Using HDR Techniques

Noise and dynamic range optimal computational imaging

A closed-loop all-electronic pixel-wise adaptive imaging system for high dynamic range video

An Advanced Noise Reduction and Edge Enhancement Algorithm

A Picture is Worth a Billion Bits: Real-Time Image Reconstruction from Dense Binary Pixels

Global shutter CMOS vision sensors and event cameras for on‐chip dynamic information

Learning Rank-1 Diffractive Optics for Single-Shot High Dynamic Range Imaging

HDR Imaging with Spatially Varying Signal-to-Noise Ratios

RTS Noise Reduction in CMOS Image Sensors Using Correlated Extrema Cancellation

High Dynamic Range Imaging of Dynamic Scenes with Saturation Compensation but without Explicit Motion Compensation

Extending Effective Dynamic Range of Hyperspectral Line Cameras for Short Wave Infrared Imaging

Pix2HDR -- A pixel-wise acquisition and deep learning-based synthesis approach for high-speed HDR videos