Abstract:Traditional computer-vision technology that relies on image sensors coupled with cloud processing or on-chip Artificial Intelligence (AI) processors have encountered significant challenges in terms of power consumption, delays arising from data transmission, and/or memory access. In-sensor and near-sensor computing have been reported to solve this issue by applying pixel or array level feature extraction [2–6]. In [2, 4], capacitors are utilized for analog-domain Haar filtering to reduce the processing power consumption, but sacrificing the Fill Factor (FF) due to the use of the capacitor array [2], or complicated pixel-level logic [4]. An image sensor in introduced in [3] with Hog feature-based object detection, achieving both low power and high accuracy for the detection of up to three object classes. However, it does not work on more complex tasks. Convolutional Neural Networks (CNNs) [5, 6] offer enhanced accuracy in practical applications, but increase the power consumption and circuit complexity. Optical-domain processing [7] is capable of parallel information processing through an optical architecture based on free space. However, in [7] this is based on diffraction and requires coherent light as input, which constrains the practicality for edge computing. This paper presents a Pulse Width Modulation (PWM) pixel-based image sensor array that integrates an optical-electronic hybrid 3-layer convolutional processing unit. The first layer of the convolution is performed in the optical domain without introducing extra power consumption. The integration of optical convolution with electrical convolution offers the potential to leverage the energy-efficient advantages of optical convolution, while simultaneously providing the essential programmability needed to address multiple use-cases through reprogramming within a single device. A dual-mode Processing Element (PE) is proposed enables both acquisition mode and calculation mode. The integration of a sum/differential dual-counter design and the incorporation of two different pixel reset methods are employed in the co-design of PWM pixels and PEs to effectively mitigate computational power consumption.

A Two-Tap Indirect Time-of-Flight CMOS Image Sensor With Pump Gate Modulator for Low-Power Applications

A Backside-Illuminated 3.5 mu m Pixel With 86% Demodulation Contrast at 1.0 V Voltage Swing for Indirect Time-of-Flight Image Sensors

A Reconfigurable Convolution-in-Pixel CMOS Image Sensor Architecture

A 16-Channel Analog CMOS SiPM with On-Chip Front-End for D-ToF LiDAR

A CMOS Integrated W-band Passive Imager

A 320x240 I-ToF CMOS Image Sensor with 2-Tap 5.6m Pixel and Mismatch-Nonlinearity Suppression

A Low-Power i-ToF LiDAR With Nonlinearity Self-Calibration Technique

A low-power DTOF image sensor with double-frame-multiplexing mode for long-range detection

A CMOS Time-of-Flight Image Sensor with High Dynamic Range Digital Pixel

Compact Numerical Modeling of Indirect Time-of-Flight CMOS Image Sensors

SOI CMOS Imager with Suppression of Cross-Talk

Method for power reduction of demodulation driver circuit in indirect time-of-flight CMOS image sensor

An 8-Tap CMOS Lock-In Pixel Image Sensor for Short-Pulse Time-of-Flight Measurements

A Dual-Mode CMOS Image Sensor Based on In-Pixel Frame Differencing

A Low Power Multi-Mode Cmos Image Sensor with Integrated On-Chip Motion Detection

Development of a High Performance Digital Silicon Photomultiplier (dSiPM) for ToF PET Imaging

Novel CMOS Image Sensor Pixel to Improve Charge Transfer Speed and Efficiency by Overlapping Gate and Temporary Storage Diffusing Node*

A 2.17μw@120fps Ultra-Low-Power Dual-Mode CMOS Image Sensor with Senputing Architecture

A Time-to-Digital Converter for Low-Power Consumption Single Slope Analog-to-Digital Converters in a High-Speed CMOS Image Sensor

A Time-to-Amplitude Converter With High Impedance Switch Topology for Single-Photon Time-of-Flight Measurement

6.9 A 0.35V 0.367TOPS/W Image Sensor with 3-Layer Optical-Electronic Hybrid Convolutional Neural Network