Abstract:Due to the separation of perception and computing, the movement of data between perception devices and computing devices has become a bottleneck in intelligent systems. In that case, In-Sensor Computing (ISC) systems bring favorable opportunities for power-limited recognition devices. It integrates perception and computation, shortening the moving path of data, and therefore reducing energy consumption. However, the conventional schemes are still suffering from the issues of either low fill factor or low computing efficiency. Recently, a novel photodiode is developed using WSe <inf xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">2</inf> material, whose photoresponsivity can be controlled by the gate voltage. In this paper, an efficient ISC scheme is proposed for convolution operation to take full advantage of the above photodiode. In our scheme, the kernel weights can be stored in a continuously tunable photoresponsivity matrix. The proposed ISC scheme can realize flexible-sized kernel-readout with minimum one step for convolutional operations. A simulation is conducted on a 7*7 pixel array, with specifically filter size of 3*3, strides of 2, and padding of 0 (the realization of other array sizes and filter sizes will also be discussed). Meanwhile, the architecture is optimized to enable parallel convolution operation. The multiplication is achieved during the exposure period by preset the photoresponsivity matrix. The results show that the proposed ISC can achieve up to 20.6 TOPS/W energy efficiency with 9.71 pJ/pixel/frame power consumption and a maximum processing speed of 20 MHz, and the fill factor is 97%, outperforming the state-of-the-art.

A Centripetal Collection Image Sensor(ccis) Based on Back Gate Modulation Achieving 1T Submicron Pixel

A Reconfigurable Convolution-in-Pixel CMOS Image Sensor Architecture

A Near-array Convolution Computing Scheme Based on WSe<sub>2</sub> Photodiode

A Near-array Convolution Computing Scheme Based on WSe<inf>2</inf> Photodiode

A High-resolution Colloidal Quantum Dot Imager by Monolithic Integration

SOI CMOS Imager with Suppression of Cross-Talk

A 64Mpixel CMOS Image Sensor with $0.50 \mu\mathrm{m}$ Unit Pixels Separated by Front Deep-Trench Isolation

A High Full Well Capacity CMOS Image Sensor for Space Applications

Low Dark-Current Quantum-Dot Infrared Imager

A Low-Noise CTIA-based Pixel with CDS for SWIR Focal Plane Arrays

CMOS Image Sensor Data-Readout Method for Convolutional Operations with Processing Near Sensor Architecture.

Novel CMOS Image Sensor Pixel to Improve Charge Transfer Speed and Efficiency by Overlapping Gate and Temporary Storage Diffusing Node*

A Backside-Illuminated 3.5 mu m Pixel With 86% Demodulation Contrast at 1.0 V Voltage Swing for Indirect Time-of-Flight Image Sensors

Design Of A High Flexible Block-Based Computational Cmos Image Sensor

Characterization of SOI pixel sensor using pinned depleted diode structure with AC-coupling on the diode

A Three-Wafer-Stacked Hybrid 15-MPixel CIS + 1-MPixel EVS With 4.6-GEvent/s Readout, In-Pixel TDC, and On-Chip ISP and ESP Function

Simulations and Design of a Single-Photon CMOS Imaging Pixel Using Multiple Non-Destructive Signal Sampling

A Thin-Film Pinned-Photodiode Imager Pixel with Fully Monolithic Fabrication and beyond 1Me- Full Well Capacity

A High Dynamic Range CMOS Image Sensor with Dual Charge Transfer Phase

High Performance CMOS Image Sensor for Low Light Imaging

Two-dimensional Material Based "Field-Effect CCD"