Abstract:We introduce a hybrid 4096 $\times $ 3680 CMOS image sensor (CIS) with an embedded 1032 $\times $ 928 event-based vision sensor (EVS). Within a four-by-four cluster of CIS pixels, one color channel is substituted to provide a photocurrent for an EVS pixel. The EVS readout circuit is allocated on a second wafer and wrapped behind the four-by-four pixel cluster. A third wafer is used to integrate all peripheral readout circuitry for the EVS and CIS functions while achieving a compact sensor footprint. The EVS pixel achieves sub-1 Hz noise rates and 3% contrast non-uniformity (CTNU) at a linear nominal contrast threshold (NCT) of 15%. The row and column readout circuitry bypasses elements without events in a fraction of a clock cycle. Furthermore, a skip function is realized that reads only bordering pixels of a connected set of events. This achieves an event rate of up to 4.6 GEvents/s (GEps). The sensor captures in-pixel time stamps through sampling of a gray code timer realizing a time-to-digital conversion (TDC). Image and event signal processors (ISP & ESP) are integrated on-chip. The ESP provides global ambient and global activity monitoring functions. The sensor supports various flicker mitigation approaches such as adjustment of contrast threshold, in-pixel bandpass filter function and region-of-interest (ROI), and deterministic or random subsampling. The hybrid sensor mitigates challenges in synchronization and parallax error compared with a two-sensor solution using a dedicated CIS and dedicated EVS sensor. Furthermore, only one package and lens are required reducing footprint and cost.

A High Full Well Capacity CMOS Image Sensor for Space Applications

A Cmos Image Sensor For Monochromatic Spectrum Imaging

A 14-bit 150KS/s SAR ADC with PGA for CMOS Image Sensor

A 64Mpixel CMOS Image Sensor with $0.50 \mu\mathrm{m}$ Unit Pixels Separated by Front Deep-Trench Isolation

14-Bit Column Readout Circuits with Single-to-differential PGA Using Intentional Offset and Two-Step Scaled-Reference SAR ADC for CMOS Image Sensors

A Reconfigurable Convolution-in-Pixel CMOS Image Sensor Architecture

A 14-Bit Column-Parallel Two-Step SA ADC with Digital Calibration Based on Scaled References and Redundancy for CMOS Image Sensors

High Performance CMOS Image Sensor for Low Light Imaging

A Centripetal Collection Image Sensor(ccis) Based on Back Gate Modulation Achieving 1T Submicron Pixel

An Intrascene Wide Dynamic Range CMOS Image Sensor Using Dual-Gain Ramp Generator for Machine Vision Applications

Development of 3-layer stacked global shutter CMOS image sensor with pixel pitch Cu-to-Cu interconnection and high-capacity capacitors

A Three-Wafer-Stacked Hybrid 15-MPixel CIS + 1-MPixel EVS With 4.6-GEvent/s Readout, In-Pixel TDC, and On-Chip ISP and ESP Function

A 1/2.5 Inch Vga 400 Fps Cmos Image Sensor with High Sensitivity for Machine Vision

Simulations and Design of a Single-Photon CMOS Imaging Pixel Using Multiple Non-Destructive Signal Sampling

Development of 0.5 μm Pixel 3-Wafers Stacked CMOS Image Sensor with through Silicon Deep Contact and In-pixel Cu-Cu Bonding Process

A 3.0 µm Pixels and 1.5 µm Pixels Combined Complementary Metal-Oxide Semiconductor Image Sensor for High Dynamic Range Vision beyond 106 dB

A Low-Noise CTIA-based Pixel with CDS for SWIR Focal Plane Arrays

A Thin-Film Pinned-Photodiode Imager Pixel with Fully Monolithic Fabrication and beyond 1Me- Full Well Capacity

Design Of A High Flexible Block-Based Computational Cmos Image Sensor

CMOS Image Sensor Data-Readout Method for Convolutional Operations with Processing Near Sensor Architecture.

Efficiency enhancement in a backside illuminated 1.12 μm pixel CMOS image sensor via parabolic color filters