Abstract:Abstract Ultra-high-speed object detection and tracking are crucial in fields such as fault detection and scientific observation. Existing solutions to this task have deficiencies in processing speeds. To deal with this difficulty, we propose a neural-inspired ultra-high-speed moving object filtering, detection, and tracking scheme, as well as a corresponding accelerator based on a high-speed spike camera. We parallelize the filtering module and divide the detection module to accelerate the algorithm and balance latency among modules for the benefit of the task-level pipeline. To be specific, a block-based parallel computation model is proposed to accelerate the filtering module, and the detection module is accelerated by a parallel connected component labeling algorithm modeling spike sparsity and spatial connectivity of moving objects with a searching tree. The hardware optimizations include processing the LIF layer with a group of multiplexers to reduce ADD operations and replacing expensive exponential operations with multiplications of preprocessed fixed-point values to increase processing speed and minimize resource consumption. We design an accelerator with the above techniques, achieving 19 times acceleration over the serial version after 25-way parallelization. A processing system for the accelerator is also implemented on the Xilinx ZCU-102 board to validate its functionality and performance. Our accelerator can process more than 20,000 spike images with 250 × 400 resolution per second with 1.618 W dynamic power consumption.

Real-time Motion Detection with High-speed Vision and Local Parallel Processing

High speed video signal acquisition and processing system based on FPGA technique

Real-time Motion Detection Algorithm for High Definition Video Surveillance System

Motion Object Tracking System Based on FPGA

A Novel FPGA-Based Moving Object Detection and Tracking Using Image Processing Technique

A wide-spectrum and high-speed CMOS system based on FPGA

A FPGA Based High-Speed Binocular Active Vision System for Tracking Circle-Shaped Target

FPGA-based real-time object tracking for mobile robot

A Fast and Energy Efficient FPGA-based System for Real-Time Object Tracking

FPGA Implementation of Feature Detection Algorithm Based on High Level Synthesis

Design of Large-Array CMOS Real-Time Imaging System Based on FPGA

Rapid Detection of Moving Target in the Competitive Networked Robots

Multi-channel high-speed CMOS image acquisition and pre-processing system

FPGA-based Acceleration System for Visual Tracking

An FPGA Accelerator for High-Speed Moving Objects Detection and Tracking With a Spike Camera

High-speed Real-Time Image Acquisition and Auto-Adapted Threshold Processing Based on FPGA

An FPGA-based real-time infrared target detection system with visual image positioning

High-Speed Video Transfer and Real-Time Infrared Spots Detection Based on FPGA

Design and Realization of Image Tracking System Based on High Resolution Camera

Study and Implementation of High-speed Real-time Image Processing Technique Based on SOPC

A Single-Chip 600-Fps Real-Time Action Recognition System Employing a Hardware Friendly Algorithm.