Abstract:Method for automated asynchronous adaptation to high dynamic range lighting conditions during image acquisition. This paper introduces an image formation technique that realizes automatic adaptation to the illumination conditions during image capture. This adaptation takes place asynchronously in a single shot, requiring neither external control nor iterations on the exposure setting. These characteristics are especially suitable for applications such as visual robot navigation, where illumination may abruptly change and immediate decisions must be made. The equations that model the proposed technique show exposure‐time independence. Moreover, each pixel adapts itself according to the ratio between local and global illuminations. The dependence on this ratio—which is a relative rather than absolute magnitude—along with the aforementioned independence on exposure time means that, theoretically, any illumination scenario can be represented within an arbitrary signal range. We also address the CMOS implementation of this technique. An extensive set of electrical simulations confirms its auto‐exposure and high‐dynamic‐range encoding capabilities. In particular, we simulated the capture of a 118‐dB scene on a 160×120 ‐px array over five orders of magnitude of ambient illumination. Corner and mismatch simulations reveal strong robustness of the proposed circuitry against fabrication non‐idealities. Finally, although we aim to applications in which large image resolution is not a critical specification, strategies to minimize the impact of the required focal‐plane circuit elements on the pixel pitch are examined.

A closed-loop all-electronic pixel-wise adaptive imaging system for high dynamic range video

A closed-loop, all-electronic pixel-wise adaptive imaging system for high dynamic range videography

A Reconfigurable Convolution-in-Pixel CMOS Image Sensor Architecture

A novel high dynamic range microscopic video system based on REC.2020

Compressive Single-Pixel Hyperspectral Imaging Using RGB Sensors

Pix2HDR -- A pixel-wise acquisition and deep learning-based synthesis approach for high-speed HDR videos

Pixel-wise Exposure Control for Single-Shot HDR Imaging: A Joint Optimization Approach

Single‐Shot Auto‐Exposure and High Dynamic Range Imaging Based on Asynchronous Operation of Pixel Array Circuitry

A real-time high dynamic range intensified complementary metal oxide semiconductor camera based on FPGA

A 39,000 Subexposures/s CMOS Image Sensor with Dual-tap Coded-exposure Data-memory Pixel for Adaptive Single-shot Computational Imaging

Dynamically Tunable Hemispherical Electronic Eye Camera System with Adjustable Zoom Capability

39 000-Subexposures/s Dual-ADC CMOS Image Sensor With Dual-Tap Coded-Exposure Pixels for Single-Shot HDR and 3-D Computational Imaging

An Over 90 dB Intra-Scene Single-Exposure Dynamic Range CMOS Image Sensor Using a 3.0 μm Triple-Gain Pixel Fabricated in a Standard BSI Process

HDR CCD Image Sensor System Through Double-A/D Convertors

A 3.0 µm Pixels and 1.5 µm Pixels Combined Complementary Metal-Oxide Semiconductor Image Sensor for High Dynamic Range Vision beyond 106 dB

Pixel-wise programmability enables dynamic high-SNR cameras for high-speed microscopy

Pixel-wise Optical Encoder Driven by Video Prediction: Towards Single-Shot High Dynamic Range Moving Object Recognition

Event-based Asynchronous HDR Imaging by Temporal Incident Light Modulation

Data-Driven Pixel Control: Challenges and Prospects

Using Spatially Varying Pixels Exposures and Bayer-covered Photosensors for High Dynamic Range Imaging

A 316MP, 120FPS, High Dynamic Range CMOS Image Sensor for Next Generation Immersive Displays