Abstract:In AIoT era, intelligent vision perception systems are widely deployed in edges. As shown in Fig. 1, due to limited energy budget, terminal devices usually adopt hierarchical processing architecture. A coarse object detection algorithm runs in always-on mode, and gets ready to trigger subsequent complex algorithms for precise recognition or segmentation. In conventional digital vision processing frameworks, light-induced photocurrents must be transformed to voltage ${\mathrm {(I_{ph}-to-V)}}$, converted to digital signals (A-to-D), transferred on-board to processors and exchanged between memory and processing elements. Smart vision chips provide promising solutions for cutting down these power overheads, such as placing analog processing circuits near the pixel array [2], customizing the analog-to-digital converter (ADC) which is capable of convolution [3] or adding processing circuits deeply into pixels to perform in-sensor current-domain MAC operations [4]. However, the photocurrent conversion ${\mathrm {(I_{ph}-to-V)}}$ circuits are still reserved in those works; besides, they could only complete 1st-layer convolution for low-level features extraction, and are unable to process subsequent layers for end-to-end perception tasks, which limits the processing capability with small CNN model. Additionally, systems that implement whole CNN algorithms are also proposed by integrating CIS with an analog processor in one chip [5] or stacking a CIS chip with a digital processor chip [6]. But power overheads on data transmission and memory access are still unsolved because these designs separate sensing and computing, and adopt conventional Von Neumann architecture with much memory access.

A/D Converter Architectures for Energy-Efficient Vision Processor

A Reconfigurable Convolution-in-Pixel CMOS Image Sensor Architecture

A Review on Direct Digital Conversion Techniques for Biomedical Signal Acquisition

Survey on Energy-Efficient Deep Neural Networks for Computer Vision

Optical Convolution Based Computational Method for Low-Power Image Processing

A 4.57 Μw@120fps Vision System of Sensing with Computing for BNN-Based Perception Applications

Utilizing Direct Photocurrent Computation and 2D Kernel Scheduling to Improve In-Sensor-Processing Efficiency

Reconfiguring the Imaging Pipeline for Computer Vision

Design Techniques for Energy-Efficient Analog-to-Digital Converters

Processing Near Sensor Architecture in Mixed-Signal Domain with CMOS Image Sensor of Convolutional-Kernel-Readout Method

A review on direct digital conversion for biomedical signal acquisition ICs

Energy-Efficient & Real-Time Computer Vision with Intelligent Skipping via Reconfigurable CMOS Image Sensors

AICNN: Implementing Typical CNN Algorithms with Analog-to-Information Conversion Architecture

Power-Efficient Sampling

Efficient DNN Algorithm Design and Hardware Acceleration for Low-Level Vision

A 5.9μw Ultra-Low-Power Dual-Resolution CIS Chip of Sensing-with-Computing for Always-on Intelligent Visual Devices

Incremental Delta-Sigma ADCs: A Tutorial Review

Retinomorphic optoelectronic devices for intelligent machine vision.

An Analog-Memoryless Near Sensor Computing Architecture for Always-On Intelligent Perception Applications

A 1.8mW Perception Chip with Near-Sensor Processing Scheme for Low-Power AIoT Applications

All-analog photoelectronic chip for high-speed vision tasks