Abstract:Abstract Ultra-high-speed object detection and tracking are crucial in fields such as fault detection and scientific observation. Existing solutions to this task have deficiencies in processing speeds. To deal with this difficulty, we propose a neural-inspired ultra-high-speed moving object filtering, detection, and tracking scheme, as well as a corresponding accelerator based on a high-speed spike camera. We parallelize the filtering module and divide the detection module to accelerate the algorithm and balance latency among modules for the benefit of the task-level pipeline. To be specific, a block-based parallel computation model is proposed to accelerate the filtering module, and the detection module is accelerated by a parallel connected component labeling algorithm modeling spike sparsity and spatial connectivity of moving objects with a searching tree. The hardware optimizations include processing the LIF layer with a group of multiplexers to reduce ADD operations and replacing expensive exponential operations with multiplications of preprocessed fixed-point values to increase processing speed and minimize resource consumption. We design an accelerator with the above techniques, achieving 19 times acceleration over the serial version after 25-way parallelization. A processing system for the accelerator is also implemented on the Xilinx ZCU-102 board to validate its functionality and performance. Our accelerator can process more than 20,000 spike images with 250 × 400 resolution per second with 1.618 W dynamic power consumption.

Accelerating Eulerian Video Magnification Using FPGA

Live Video Analytics with FPGA-based Smart Cameras

High speed video signal acquisition and processing system based on FPGA technique

Real-time video processing model for stereoscopic display system based on FPGA

A Real-Time Full HD 2D-to-3d Video Conversion System Based on FPGA

Full Hd Real-Time Depth Estimation Algorithm and Hardware Implementation

An FPGA-based HEVC post-processing CNN hardware accelerator

FPGA Implementation of Feature Detection Algorithm Based on High Level Synthesis

FPGA-Based Image Processing for Seamless Tiled Display System

FPGA implementation of full HD real-time depth estimation

FPGA-Based Feature Extraction and Tracking Accelerator for Real-Time Visual SLAM

High-performance architecture for real-time high-definition short-wave infrared streaming video processing and its field programmable gate array prototype

FPGA-Based Real-Time Super-Resolution System for Ultra High Definition Videos

An FPGA Accelerator for High-Speed Moving Objects Detection and Tracking With a Spike Camera

method for accelerating decoding of a camera video stream through a programmable GPU in a virtual-real fusion system

Design of a Video Processor Based on FPGA

Full High-Definition Real-Time Depth Estimation for Three-Dimensional Video System

Real Time Bayer Raw Video Projective Transformation System Using FPGA

Implementation of video scaling system using FPGA based on poly-phase interpolation algorithm

Real-Time Efficient FPGA Implementation of the Multi-Scale Lucas-Kanade and Horn-Schunck Optical Flow Algorithms for a 4K Video Stream

Accelerating local laplacian filters on FPGAs