Abstract:This paper proposes a high-speed low-cost VLSI system capable of on-chip online learning for classifying address-event representation (AER) streams from dynamic vision sensor (DVS) retina chips. The proposed system executes a lightweight statistic algorithm based on simple binary features extracted from AER streams and a Random Ferns classifier to classify these features. The proposed system’s characteristics of multi-level pipelines and parallel processing circuits achieves a high throughput up to 1 spike event per clock cycle for AER data processing. Thanks to the nature of the lightweight algorithm, our hardware system is realized in a low-cost memory-centric paradigm. In addition, the system is capable of on-chip online learning to flexibly adapt to different in-situ application scenarios. The extra overheads for on-chip learning in terms of time and resource consumption are quite low, as the training procedure of the Random Ferns is quite simple, requiring few auxiliary learning circuits. An FPGA prototype of the proposed VLSI system was implemented with 9.5~96.7% memory consumption and <11% computational and logic resources on a Xilinx Zynq-7045 chip platform. It was running at a clock frequency of 100 MHz and achieved a peak processing throughput up to 100 Meps (Mega events per second), with an estimated power consumption of 690 mW leading to a high energy efficiency of 145 Meps/W or 145 event/μJ. We tested the prototype system on MNIST-DVS, Poker-DVS, and Posture-DVS datasets, and obtained classification accuracies of 77.9%, 99.4% and 99.3%, respectively. Compared to prior works, our VLSI system achieves higher processing speeds, higher computing efficiency, comparable accuracy, and lower resource costs.

A Massively Parallel Keypoint Detection and Description (MP-KDD) Algorithm for High-Speed Vision Chip

MSKD: multi-split KD-tree design on GPU

A high speed multi-level-parallel array processor for vision chips

DaDianNao: A Machine-Learning Supercomputer

Simd Massively Parallel Processing System For Real-Time Image Processing

A high-speed vision processor based on pixel-parallel PE array and its applications

Implementation of Parallel Acceleration for Real-time Extraction of Visual Features.

A 1000 Fps Vision Chip Based on a Dynamically Reconfigurable Hybrid Architecture Comprising a PE Array Processor and Self-Organizing Map Neural Network.

7.3 A 1000fps Vision Chip Based on a Dynamically Reconfigurable Hybrid Architecture Comprising a PE Array and Self-Organizing Map Neural Network

Real-time Motion Detection with High-speed Vision and Local Parallel Processing

Ultrahigh Framerate Vision Chip Featuring Central-Based Edge Detection Processed by All-Digital In-Imager Global-Parallel Processing Architecture

ASP-SIFT: Using Analog Signal Processing Architecture to Accelerate Keypoint Detection of SIFT Algorithm

Design and Performance of a 1 ms High-Speed Vision Chip with 3D-Stacked 140 GOPS Column-Parallel PEs †

Parallel Computing of A Digital Hologram and Particle Searching for Microdigital-Holographic Particle-Tracking Velocimetry

An FPGA Accelerator for High-Speed Moving Objects Detection and Tracking With a Spike Camera

A High Performance Parallel Computing Architecture For Robust Image Features

Intelligent vehicle visual pose estimation algorithm based on deep learning and parallel computing for dynamic scenes

A High-Speed Low-Cost VLSI System Capable of On-Chip Online Learning for Dynamic Vision Sensor Data Classification

Technology-Circuit-Algorithm Tri-Design for Processing-in-Pixel-in-Memory (P2M)

An Ultra-Fast and Low-Power Design of Analog Circuit Network for DoG Pyramid Construction of SIFT Algorithm

On-Board Detection and Matching of Feature Points