Abstract:Traditional computer-vision technology that relies on image sensors coupled with cloud processing or on-chip Artificial Intelligence (AI) processors have encountered significant challenges in terms of power consumption, delays arising from data transmission, and/or memory access. In-sensor and near-sensor computing have been reported to solve this issue by applying pixel or array level feature extraction [2–6]. In [2, 4], capacitors are utilized for analog-domain Haar filtering to reduce the processing power consumption, but sacrificing the Fill Factor (FF) due to the use of the capacitor array [2], or complicated pixel-level logic [4]. An image sensor in introduced in [3] with Hog feature-based object detection, achieving both low power and high accuracy for the detection of up to three object classes. However, it does not work on more complex tasks. Convolutional Neural Networks (CNNs) [5, 6] offer enhanced accuracy in practical applications, but increase the power consumption and circuit complexity. Optical-domain processing [7] is capable of parallel information processing through an optical architecture based on free space. However, in [7] this is based on diffraction and requires coherent light as input, which constrains the practicality for edge computing. This paper presents a Pulse Width Modulation (PWM) pixel-based image sensor array that integrates an optical-electronic hybrid 3-layer convolutional processing unit. The first layer of the convolution is performed in the optical domain without introducing extra power consumption. The integration of optical convolution with electrical convolution offers the potential to leverage the energy-efficient advantages of optical convolution, while simultaneously providing the essential programmability needed to address multiple use-cases through reprogramming within a single device. A dual-mode Processing Element (PE) is proposed enables both acquisition mode and calculation mode. The integration of a sum/differential dual-counter design and the incorporation of two different pixel reset methods are employed in the co-design of PWM pixels and PEs to effectively mitigate computational power consumption.

Low-power In-Pixel Buffer Circuit for Smart Image Sensor

A Reconfigurable Convolution-in-Pixel CMOS Image Sensor Architecture

A 14-Bit Column-Parallel Two-Step SA ADC with Digital Calibration Based on Scaled References and Redundancy for CMOS Image Sensors

14-Bit Column Readout Circuits with Single-to-differential PGA Using Intentional Offset and Two-Step Scaled-Reference SAR ADC for CMOS Image Sensors

SOI CMOS Imager with Suppression of Cross-Talk

A Low Power Dissipation High-Speed CMOS Image Sensor with Column-Parallel Sigma-Delta ADCs

A 14-Bit Column-Parallel Two-Step SA ADC with On-Chip Scaled Reference Voltages Self-Calibration for CMOS Image Sensor

A Low-Power Column-Parallel Gain-Adaptive Single-Slope ADC for CMOS Image Sensors

A 51-Pj/pixel 33.7-Db PSNR 4× Compressive CMOS Image Sensor with Column-Parallel Single-Shot Compressive Sensing

A Low-Power i-ToF LiDAR With Nonlinearity Self-Calibration Technique

Low Power High Efficiency CMOS Image Sensor Design Based on Compressed Sensing

A Low-Power-Consumption 9bit 10ms/s Pipeline ADC for CMOS Image Sensors

Low-power In-pixel Computing with Current-modulated Switched Capacitors

A 5.9μw Ultra-Low-Power Dual-Resolution CIS Chip of Sensing-with-Computing for Always-on Intelligent Visual Devices

A 10bit Small Area Low Power Pipelined Sar Adc Used in Cmos Image Sensor

A low power CMOS image sensor design for wireless endoscopy capsule

6.9 A 0.35V 0.367TOPS/W Image Sensor with 3-Layer Optical-Electronic Hybrid Convolutional Neural Network

A high speed, low power consumption LVDS interface for CMOS pixel sensors

An area‐effective and low‐power single‐slope ADC for DCG imaging CMOS image sensor

Processing Near Sensor Architecture in Mixed-Signal Domain with CMOS Image Sensor of Convolutional-Kernel-Readout Method

A Low-Power Column-Parallel Adc For High-Speed Cmos Image