Abstract:Deep-learning is a cutting edge theory that is being applied to many fields. For vision applications the Convolutional Neural Networks (CNN) are demanding significant accuracy for classification tasks. Numerous hardware accelerators have populated during the last years to improve CPU or GPU based solutions. This technology is commonly prototyped and tested over FPGAs before being considered for ASIC fabrication for mass production. The use of commercial typical cameras (30fps) limits the capabilities of these systems for high speed applications. The use of dynamic vision sensors (DVS) that emulate the behavior of a biological retina is taking an incremental importance to improve this applications due to its nature, where the information is represented by a continuous stream of spikes and the frames to be processed by the CNN are constructed collecting a fixed number of these spikes (called events). The faster an object is, the more events are produced by DVS, so the higher is the equivalent frame rate. Therefore, these DVS utilization allows to compute a frame at the maximum speed a CNN accelerator can offer. In this paper we present a VHDL/HLS description of a pipelined design for FPGA able to collect events from an Address-Event-Representation (AER) DVS retina to obtain a normalized histogram to be used by a particular CNN accelerator, called NullHop. VHDL is used to describe the circuit, and HLS for computation blocks, which are used to perform the normalization of a frame needed for the CNN. Results outperform previous implementations of frames collection and normalization using ARM processors running at 800MHz on a Zynq7100 in both latency and power consumption. A measured 67% speedup factor is presented for a Roshambo CNN real-time experiment running at 160fps peak rate.

A 181 GOPS AKAZE Accelerator Employing Discrete-Time Cellular Neural Networks for Real-Time Feature Extraction

A 127 fps in full hd accelerator based on optimized AKAZE with efficiency and effectiveness for image feature extraction

High-performance Reconfigurable DNN Accelerator on a Bandwidth-limited Embedded System

A Real-Time 17-Scale Object Detection Accelerator with Adaptive 2000-Stage Classification in 65nm CMOS.

Implementation of Parallel Acceleration for Real-time Extraction of Visual Features.

A High Performance Parallel Computing Architecture For Robust Image Features

A 135-Frames/s 1080p 87.5-Mw Binary-Descriptor-Based Image Feature Extraction Accelerator

FPGA-Based Feature Extraction and Tracking Accelerator for Real-Time Visual SLAM

A High-Performance Pixel-Level Fully Pipelined Hardware Accelerator for Neural Networks

An Ultra-Fast and Low-Power Design of Analog Circuit Network for DoG Pyramid Construction of SIFT Algorithm

An FPGA Accelerator for High-Speed Moving Objects Detection and Tracking With a Spike Camera

A Binary-Feature-Based Object Recognition Accelerator with 22 M-Vector/s Throughput and 0.68 G-Vector/J Energy-Efficiency for Full-HD Resolution

Dynamic Vision Sensor integration on FPGA-based CNN accelerators for high-speed visual classification

A High-Performance Accelerator for Real-Time Super-Resolution on Edge FPGAs

A High Performance Multi-Bit-Width Booth Vector Systolic Accelerator for NAS Optimized Deep Learning Neural Networks

A 40nm 2TOPS/W Depth-Completion Neural Network Accelerator SoC With Efficient Depth Engine for Realtime LiDAR Systems

An energy-efficient dehazing neural network accelerator based on E AOD-Net

A Multi-Mode Visual Recognition Hardware Accelerator for AR/MR Glasses

A 182 mW 94.3 f/s in Full HD Pattern-Matching Based Image Recognition Accelerator for an Embedded Vision System in 0.13-$\mu{\rm m}$ CMOS Technology

An Efficient VLSI Architecture of Speeded-Up Robust Feature Extraction for High Resolution and High Frame Rate Video

A 1000 Fps Vision Chip Based on a Dynamically Reconfigurable Hybrid Architecture Comprising a PE Array Processor and Self-Organizing Map Neural Network.