Abstract:Traditional computer-vision technology that relies on image sensors coupled with cloud processing or on-chip Artificial Intelligence (AI) processors have encountered significant challenges in terms of power consumption, delays arising from data transmission, and/or memory access. In-sensor and near-sensor computing have been reported to solve this issue by applying pixel or array level feature extraction [2–6]. In [2, 4], capacitors are utilized for analog-domain Haar filtering to reduce the processing power consumption, but sacrificing the Fill Factor (FF) due to the use of the capacitor array [2], or complicated pixel-level logic [4]. An image sensor in introduced in [3] with Hog feature-based object detection, achieving both low power and high accuracy for the detection of up to three object classes. However, it does not work on more complex tasks. Convolutional Neural Networks (CNNs) [5, 6] offer enhanced accuracy in practical applications, but increase the power consumption and circuit complexity. Optical-domain processing [7] is capable of parallel information processing through an optical architecture based on free space. However, in [7] this is based on diffraction and requires coherent light as input, which constrains the practicality for edge computing. This paper presents a Pulse Width Modulation (PWM) pixel-based image sensor array that integrates an optical-electronic hybrid 3-layer convolutional processing unit. The first layer of the convolution is performed in the optical domain without introducing extra power consumption. The integration of optical convolution with electrical convolution offers the potential to leverage the energy-efficient advantages of optical convolution, while simultaneously providing the essential programmability needed to address multiple use-cases through reprogramming within a single device. A dual-mode Processing Element (PE) is proposed enables both acquisition mode and calculation mode. The integration of a sum/differential dual-counter design and the incorporation of two different pixel reset methods are employed in the co-design of PWM pixels and PEs to effectively mitigate computational power consumption.

Always-on Low Standby Power Active Pressure Sensor Pixel Based on LTPO Hybrid Thin Film Transistor Integration

A Reconfigurable Convolution-in-Pixel CMOS Image Sensor Architecture

An AMOLED Pixel Circuit Based on LTPS Thin-film Transistors with Mono-Type Scanning Driving

A Low Power and IR Drop Compensable AMOLED Pixel Circuit Based on Low-Temperature Poly-Si and Oxide (LTPO) TFTs Hybrid Technology

A Low-Power i-ToF LiDAR With Nonlinearity Self-Calibration Technique

Design of a Pixel Readout ASIC Using Super Pixel Circuits with a Built-in LDO Regulator for Hybrid X-ray Imaging Detectors

P‐1: LTPO Technology for Low Power Comsumption

Low-power In-Pixel Buffer Circuit for Smart Image Sensor

12.2: High Performance AMOLED Pixel Circuit Using Interleaved Emit Signals Based on Low‐Temperature Poly‐Si and Oxide (LTPO) TFTs

A New Low Temperature Polycrystalline Silicon Thin Film Transistor Pixel Circuit for Active Matrix Organic Light Emitting Diode

Active pixel sensor matrix based on monolayer MoS2 phototransistor array

38.2: An Accurate and Stable PWM Pixel Circuit Based on LTPO TFTs for AM‐Micro‐LED Display

A 200 Ma Low-Area, Low-Noise, Low-Dropout Linear Regulator for Monolithic Active Pixel Sensors

A Five-Transistor Active Pixel Sensor with a Wide Dynamic Range and a High-Speed Pixel Operation

New AMOLED Pixel Circuit to Compensate Characteristics Variations of LTPS TFTs and Voltage Drop

Low Voltage Active Pixel Sensor Based on PMOS Restoration Transistor

A low-noise and low-area-consumption power management dedicated to CMOS pixel sensors for high energy physics experiments

A Two-Tap Indirect Time-of-Flight CMOS Image Sensor With Pump Gate Modulator for Low-Power Applications

6.9 A 0.35V 0.367TOPS/W Image Sensor with 3-Layer Optical-Electronic Hybrid Convolutional Neural Network

A 140-Db Dynamic Range Digital PPG Front-end IC with an Integrated MoSe2 Photodiode for Wearable Non-invasive Pulse Oximetry

Compensable A-PWM µLED Pixel Circuit with 381 PPI by Reusing Reference Lines Based on p-type LTPS TFTs