Abstract:Abstract Ultra-high-speed object detection and tracking are crucial in fields such as fault detection and scientific observation. Existing solutions to this task have deficiencies in processing speeds. To deal with this difficulty, we propose a neural-inspired ultra-high-speed moving object filtering, detection, and tracking scheme, as well as a corresponding accelerator based on a high-speed spike camera. We parallelize the filtering module and divide the detection module to accelerate the algorithm and balance latency among modules for the benefit of the task-level pipeline. To be specific, a block-based parallel computation model is proposed to accelerate the filtering module, and the detection module is accelerated by a parallel connected component labeling algorithm modeling spike sparsity and spatial connectivity of moving objects with a searching tree. The hardware optimizations include processing the LIF layer with a group of multiplexers to reduce ADD operations and replacing expensive exponential operations with multiplications of preprocessed fixed-point values to increase processing speed and minimize resource consumption. We design an accelerator with the above techniques, achieving 19 times acceleration over the serial version after 25-way parallelization. A processing system for the accelerator is also implemented on the Xilinx ZCU-102 board to validate its functionality and performance. Our accelerator can process more than 20,000 spike images with 250 × 400 resolution per second with 1.618 W dynamic power consumption.

A Hardware Accelerated Scale Invariant Feature Detector For Real-Time Visual Localization And Mapping

A Hardware Accelerator with Variable Pixel Representation & Skip Mode Prediction for Feature Point Detection Part of SIFT Algorithm.

Live Video Analytics with FPGA-based Smart Cameras

Real-time object tracking based on scale-invariant features employing bio-inspired hardware

Parallelization of Computing-Intensive Tasks of SIFT Algorithm on a Reconfigurable Architecture System

A Fast and Power-Efficient Hardware Architecture for Visual Feature Detection in Affine-SIFT.

GPU-based Parallel Optimization for Real-Time Scale-Invariant Feature Transform in Binocular Visual Registration.

Scale Invariant Feature Transform Algorithm Based on a Reconfigurable Architecture System

Implementation of Parallel Acceleration for Real-time Extraction of Visual Features.

FPGA-Based Feature Extraction and Tracking Accelerator for Real-Time Visual SLAM

ASP-SIFT: Using Analog Signal Processing Architecture to Accelerate Keypoint Detection of SIFT Algorithm

Full Hd Real-Time Depth Estimation Algorithm and Hardware Implementation

FPGA-based Acceleration System for Visual Tracking

CNN-based Feature-point Extraction for Real-time Visual SLAM on Embedded FPGA

FPGA implementation of full HD real-time depth estimation

FPGA Implementation of Feature Detection Algorithm Based on High Level Synthesis

An FPGA Accelerator for High-Speed Moving Objects Detection and Tracking With a Spike Camera

Hardware based Scale- and Rotation-Invariant Feature Extraction: A Retrospective Analysis and Future Directions

A 83fps 1080P Resolution 354 Mw Silicon Implementation for Computing the Improved Robust Feature in Affine Space

Hardware Solution of Real-Time Depth Estimation Based on Stereo Vision

An Ultra-Fast and Low-Power Design of Analog Circuit Network for DoG Pyramid Construction of SIFT Algorithm