Abstract:In AIoT era, intelligent vision perception systems are widely deployed in edges. As shown in Fig. 1, due to limited energy budget, terminal devices usually adopt hierarchical processing architecture. A coarse object detection algorithm runs in always-on mode, and gets ready to trigger subsequent complex algorithms for precise recognition or segmentation. In conventional digital vision processing frameworks, light-induced photocurrents must be transformed to voltage ${\mathrm {(I_{ph}-to-V)}}$, converted to digital signals (A-to-D), transferred on-board to processors and exchanged between memory and processing elements. Smart vision chips provide promising solutions for cutting down these power overheads, such as placing analog processing circuits near the pixel array [2], customizing the analog-to-digital converter (ADC) which is capable of convolution [3] or adding processing circuits deeply into pixels to perform in-sensor current-domain MAC operations [4]. However, the photocurrent conversion ${\mathrm {(I_{ph}-to-V)}}$ circuits are still reserved in those works; besides, they could only complete 1st-layer convolution for low-level features extraction, and are unable to process subsequent layers for end-to-end perception tasks, which limits the processing capability with small CNN model. Additionally, systems that implement whole CNN algorithms are also proposed by integrating CIS with an analog processor in one chip [5] or stacking a CIS chip with a digital processor chip [6]. But power overheads on data transmission and memory access are still unsolved because these designs separate sensing and computing, and adopt conventional Von Neumann architecture with much memory access.

Bio-inspired smart vision sensor: toward a reconfigurable hardware modeling of the hierarchical processing in the brain

A Reconfigurable Convolution-in-Pixel CMOS Image Sensor Architecture

Bioinspired and Low-Power 2D Machine Vision with Adaptive Machine Learning and Forgetting

Bioinspired sensing-memory-computing integrated vision systems: biomimetic mechanisms, design principles, and applications

HARP: Hierarchical Attention Oriented Region-Based Processing for High-Performance Computation in Vision Sensor

A dynamically reconfigurable architecture for vision pre-processor

Hierarchies in Visual Pathway: Functions and Inspired Artificial Vision

A 4.57 Μw@120fps Vision System of Sensing with Computing for BNN-Based Perception Applications

Recent advances in in-sensor computational vision sensors: from mechanisms to applications

A Spiking Artificial Vision Architecture Based on Fully Emulating the Human Vision

A 1000 Fps Vision Chip Based on a Dynamically Reconfigurable Hybrid Architecture Comprising a PE Array Processor and Self-Organizing Map Neural Network.

A Biologically Inspired Neurocomputing Circuit for Image Representation

Hardware based spatio-temporal neural processing backend for imaging sensors: Towards a smart camera

Ultralow Power In-Sensor Neuronal Computing with Oscillatory Retinal Neurons for Frequency-Multiplexed, Parallel Machine Vision

A retina-inspired neurocomputing circuit for image representation

Ultra-low Power In-Sensor Neuronal Computing with Oscillatory Retinal Neurons for Frequency-Multiplexed, Parallel Machine Vision

A Visual Cortex-Inspired Imaging-Sensor Architecture and Its Application in Real-Time Processing

Design and Simulation of a Hierarchical Parallel Distributed Processing Model for Orientation Selection Based on Primary Visual Cortex

A Visual Brain Chip Based on Selective Attention for Robot Vision Application

A Three-Dimensional Neuromorphic Photosensor Array for Nonvolatile In-Sensor Computing

Retinomorphic optoelectronic devices for intelligent machine vision.