Abstract:A convolutional neural network-based multiobject detection and tracking algorithm can be applied to vehicle detection and traffic flow statistics, thus enabling smart transportation. Aiming at the problems of the high computational complexity of multiobject detection and tracking algorithms, a large number of model parameters, and difficulty in achieving high throughput with a low power consumption in edge devices, we design and implement a low-power, low-latency, high-precision, and configurable vehicle detector based on a field programmable gate array (FPGA) with YOLOv3 (You-Only-Look-Once-version3), YOLOv3-tiny CNNs (Convolutional Neural Networks), and the Deepsort algorithm. First, we use a dynamic threshold structured pruning method based on a scaling factor to significantly compress the detection model size on the premise that the accuracy does not decrease. Second, a dynamic 16-bit fixed-point quantization algorithm is used to quantify the network parameters to reduce the memory occupation of the network model. Furthermore, we generate a reidentification (RE-ID) dataset from the UA-DETRAC dataset and train the appearance feature extraction network on the Deepsort algorithm to improve the vehicles' tracking performance. Finally, we implement hardware optimization techniques such as memory interlayer multiplexing, parameter rearrangement, ping-pong buffering, multichannel transfer, pipelining, Im2col+GEMM, and Winograd algorithms to improve resource utilization and computational efficiency. The experimental results demonstrate that the compressed YOLOv3 and YOLOv3-tiny network models decrease in size by 85.7% and 98.2%, respectively. The dual-module parallel acceleration meets the demand of the 6-way parallel video stream vehicle detection with the peak throughput at 168.72 fps.

System Integration and Optimization of AI Hardware Acceleration Architecture for Object Detection

Design and implementation of FPGA-based deep learning object detection system

FPGA-based Object Detection Acceleration Architecture Design

Hardware Acceleration for Object Detection using YOLOv5 Deep Learning Algorithm on Xilinx Zynq FPGA Platform

A High-Performance YOLOV5 Accelerator for Object Detection with Near Sensor Intelligence.

A dedicated hardware accelerator for real-time acceleration of YOLOv2

Reduced-Parameter YOLO-Like Object Detector Oriented to Resource-Constrained Platform

Edge Real-Time Object Detection and DPU-Based Hardware Implementation for Optical Remote Sensing Images

Object Detection Edge Performance Optimization on FPGA-Based Heterogeneous Multiprocessor Systems

An FPGA-Based YOLOv5 Accelerator for Real-Time Industrial Vision Applications

An Efficient Real-Time Object Detection Framework on Resource-Constricted Hardware Devices via Software and Hardware Co-design

Resource- and Power-Efficient High-Performance Object Detection Inference Acceleration Using FPGA

FPGA-Based Hardware Accelerator Design and Implementation of Oil Palm Detection

WGeod: A General and Efficient FPGA Accelerator for Object Detection

Design and Implementation of YOLOv3-Tiny Accelerator Based on PYNQ-Z2 Heterogeneous Platform

Design of embedded real-time human detection system based on Zynq platform

FPGA-Based Vehicle Detection and Tracking Accelerator

Hardware Architecture for Fast General Object Detection using Aggregated Channel Features

Hardware Acceleration and Implementation of YOLOX-s for On-Orbit FPGA

FOLD: Low-Level Image Enhancement for Low-Light Object Detection Based on FPGA MPSoC

Hardware–Software Partitioning for Real-Time Object Detection Using Dynamic Parameter Optimization