Abstract:Traditional computer-vision technology that relies on image sensors coupled with cloud processing or on-chip Artificial Intelligence (AI) processors have encountered significant challenges in terms of power consumption, delays arising from data transmission, and/or memory access. In-sensor and near-sensor computing have been reported to solve this issue by applying pixel or array level feature extraction [2–6]. In [2, 4], capacitors are utilized for analog-domain Haar filtering to reduce the processing power consumption, but sacrificing the Fill Factor (FF) due to the use of the capacitor array [2], or complicated pixel-level logic [4]. An image sensor in introduced in [3] with Hog feature-based object detection, achieving both low power and high accuracy for the detection of up to three object classes. However, it does not work on more complex tasks. Convolutional Neural Networks (CNNs) [5, 6] offer enhanced accuracy in practical applications, but increase the power consumption and circuit complexity. Optical-domain processing [7] is capable of parallel information processing through an optical architecture based on free space. However, in [7] this is based on diffraction and requires coherent light as input, which constrains the practicality for edge computing. This paper presents a Pulse Width Modulation (PWM) pixel-based image sensor array that integrates an optical-electronic hybrid 3-layer convolutional processing unit. The first layer of the convolution is performed in the optical domain without introducing extra power consumption. The integration of optical convolution with electrical convolution offers the potential to leverage the energy-efficient advantages of optical convolution, while simultaneously providing the essential programmability needed to address multiple use-cases through reprogramming within a single device. A dual-mode Processing Element (PE) is proposed enables both acquisition mode and calculation mode. The integration of a sum/differential dual-counter design and the incorporation of two different pixel reset methods are employed in the co-design of PWM pixels and PEs to effectively mitigate computational power consumption.

A Single-Pixel Sensor for Near-field Imaging Based on Startup Time of Oscillator

A CMOS Integrated W-band Passive Imager

100 Ghz Integrated Cmos Passive Imager with > 100 Mv/W Responsivity, 23fw/root Hz Nep

A High-resolution Colloidal Quantum Dot Imager by Monolithic Integration

A D-Band Passive Imager in 65 Nm CMOS

Design Realization and Characterization of A Position Sensitive Detector for Fast Optical Measurement

A LOW POWER, LOW PHASE NOISE FBAR OSCILLATOR

Ultra-sensitive magnetic field sensor based on a low-noise magnetoelectric MEMS-CMOS oscillator

A Two-Tap Indirect Time-of-Flight CMOS Image Sensor With Pump Gate Modulator for Low-Power Applications

An Oscillator-Based Cmos Magneto-Sensitive Biosensor with In-Situ Switched Capacitor Calibration Scheme

A Compact Planar Inductive Angular Sensor with Small Latency and Low Power Consumption

Characterization of SOI pixel sensor using pinned depleted diode structure with AC-coupling on the diode

6.9 A 0.35V 0.367TOPS/W Image Sensor with 3-Layer Optical-Electronic Hybrid Convolutional Neural Network

Low-Power MEMS-Based Pierce Oscillator Using a 61-MHz Capacitive-Gap Disk Resonator

Novel Energy-efficient Hafnia-based Ferroelectric Processing-in-Sensor with In-Situ Motion Detection and Four-quarter Mutipilcation

A 0.025-mm<sup>2</sup> 0.8-V 78.5dB-SNDR VCO-Based Sensor Readout Circuit in a Hybrid PLL-ΔΣM Structure

3D-integrated pixel circuit for a low power and small pitch SOI sensor

Low-power, agile electro-optic frequency comb spectrometer for integrated sensors

A nanosecond pulsed CMOS LED for all-silicon time-of-flight ranging

Filterless and High-Speed InP Near-Infrared Photodetector With an Ultra-Small Full-Width at Half Maximum

A CCO-Based Pixel-Level Readout Circuit for QWIP Focal Plane Array Imaging System