Abstract:We introduce a hybrid 4096 $\times $ 3680 CMOS image sensor (CIS) with an embedded 1032 $\times $ 928 event-based vision sensor (EVS). Within a four-by-four cluster of CIS pixels, one color channel is substituted to provide a photocurrent for an EVS pixel. The EVS readout circuit is allocated on a second wafer and wrapped behind the four-by-four pixel cluster. A third wafer is used to integrate all peripheral readout circuitry for the EVS and CIS functions while achieving a compact sensor footprint. The EVS pixel achieves sub-1 Hz noise rates and 3% contrast non-uniformity (CTNU) at a linear nominal contrast threshold (NCT) of 15%. The row and column readout circuitry bypasses elements without events in a fraction of a clock cycle. Furthermore, a skip function is realized that reads only bordering pixels of a connected set of events. This achieves an event rate of up to 4.6 GEvents/s (GEps). The sensor captures in-pixel time stamps through sampling of a gray code timer realizing a time-to-digital conversion (TDC). Image and event signal processors (ISP & ESP) are integrated on-chip. The ESP provides global ambient and global activity monitoring functions. The sensor supports various flicker mitigation approaches such as adjustment of contrast threshold, in-pixel bandpass filter function and region-of-interest (ROI), and deterministic or random subsampling. The hybrid sensor mitigates challenges in synchronization and parallax error compared with a two-sensor solution using a dedicated CIS and dedicated EVS sensor. Furthermore, only one package and lens are required reducing footprint and cost.

Development of 3-layer stacked global shutter CMOS image sensor with pixel pitch Cu-to-Cu interconnection and high-capacity capacitors

Development of 0.5 μm Pixel 3-Wafers Stacked CMOS Image Sensor with through Silicon Deep Contact and In-pixel Cu-Cu Bonding Process

A Reconfigurable Convolution-in-Pixel CMOS Image Sensor Architecture

A 64Mpixel CMOS Image Sensor with $0.50 \mu\mathrm{m}$ Unit Pixels Separated by Front Deep-Trench Isolation

5.1 A Stacked Global-Shutter CMOS Imager with SC-Type Hybrid-GS Pixel and Self-Knee Point Calibration Single Frame HDR and On-Chip Binarization Algorithm for Smart Vision Applications

A High Full Well Capacity CMOS Image Sensor for Space Applications

A Three-Wafer-Stacked Hybrid 15-MPixel CIS + 1-MPixel EVS With 4.6-GEvent/s Readout, In-Pixel TDC, and On-Chip ISP and ESP Function

A 216 × 216 Global-Shutter CMOS Image Sensor With Embedded Analog Memory and Automatic Exposure Control for Under-Display Optical Fingerprint Sensing Applications

Color-Filter-Free Three-Layer-Stacked Image Sensor Using Blue/Green-Selective Organic Photoconductive Films with Thin-Film Transistor Circuits on CMOS Image Sensors

A Novel Low Dark Current 9T Global Shutter Pixel with Merged Active Area

Design and fabrication of vertically-integrated CMOS image sensors

A 70-dB SNR High-Speed Global Shutter CMOS Image Sensor for in Situ Fluid Concentration Distribution Measurements

Development and Reliability Study of 3D WLCSP for CMOS Image Sensor Using Vertical TSVs with 3:1 Aspect Ratio

A Centripetal Collection Image Sensor(ccis) Based on Back Gate Modulation Achieving 1T Submicron Pixel

Design Of A High Flexible Block-Based Computational Cmos Image Sensor

Development of a Charge-Multiplication CMOS Image Sensor Based on Capacitive Trench for Low-Light-Level Imaging

An Intrascene Wide Dynamic Range CMOS Image Sensor Using Dual-Gain Ramp Generator for Machine Vision Applications

CMOS Image Sensor Data-Readout Method for Convolutional Operations with Processing Near Sensor Architecture.

A Single-Transistor Active Pixel Cmos Image Sensor Architecture

Development of CMOS-process-compatible interconnect technology for 3D-stacking of NAND flash memory chips

A Monolithically Integrated 640 × 512 CMOS-Perovskite Image Sensor