Abstract:A convolutional neural network-based multiobject detection and tracking algorithm can be applied to vehicle detection and traffic flow statistics, thus enabling smart transportation. Aiming at the problems of the high computational complexity of multiobject detection and tracking algorithms, a large number of model parameters, and difficulty in achieving high throughput with a low power consumption in edge devices, we design and implement a low-power, low-latency, high-precision, and configurable vehicle detector based on a field programmable gate array (FPGA) with YOLOv3 (You-Only-Look-Once-version3), YOLOv3-tiny CNNs (Convolutional Neural Networks), and the Deepsort algorithm. First, we use a dynamic threshold structured pruning method based on a scaling factor to significantly compress the detection model size on the premise that the accuracy does not decrease. Second, a dynamic 16-bit fixed-point quantization algorithm is used to quantify the network parameters to reduce the memory occupation of the network model. Furthermore, we generate a reidentification (RE-ID) dataset from the UA-DETRAC dataset and train the appearance feature extraction network on the Deepsort algorithm to improve the vehicles' tracking performance. Finally, we implement hardware optimization techniques such as memory interlayer multiplexing, parameter rearrangement, ping-pong buffering, multichannel transfer, pipelining, Im2col+GEMM, and Winograd algorithms to improve resource utilization and computational efficiency. The experimental results demonstrate that the compressed YOLOv3 and YOLOv3-tiny network models decrease in size by 85.7% and 98.2%, respectively. The dual-module parallel acceleration meets the demand of the 6-way parallel video stream vehicle detection with the peak throughput at 168.72 fps.

4 Applications of Reconfigurable Computing

Asynchronous reconfigurable computing array design

Embedded and Real-Time Vehicle Detection System for Challenging On-Road Scenes

A Reconfigurable Architecture For Implementation Of Network Traffic Control Function

Adaptive Human Detection Approach Using FPGA-based Parallel Architecture in Reconfigurable Hardware.

Video Stream Processing on a High Performance Reconfigurable Architecture

Moving Target Detection Based on Reconfigurable Video Processing Technology

Integrate Online Model Checking Into Distributed Reconfigurable System On Chip With Adaptable Os Services

A High Speed Reconfigurable Face Detection Architecture

Reconfigurable Cyber-Physical System for Critical Infrastructure Protection in Smart Cities via Smart Video-Surveillance

Reconfigurable processor for deep learning in autonomous vehicles

Live Demonstration: An Integrated Computing and Communication Platform for Vehicle-Infrastructure Cooperative Autonomous Driving

Design of embedded real-time human detection system based on Zynq platform

FPGA-Based Vehicle Detection and Tracking Accelerator

Implementation of Robotic Navigation Algorithms Using Partial Reconfiguration on Zynq SoC

Remote Embedded Simulation System For Sw/Hw Co-Design Based On Dynamic Partial Reconfiguration

Acceleration of Pedestrian Detection Algorithm on Novel C2RTL HW/SW Co-design Platform

A Reconfigurable Architecture for Real-time Event-based Multi-Object Tracking

Real-time hardware–software embedded vision system for ITS smart camera implemented in Zynq SoC

Design of Reconfigurable Image Acquisition and Processing System Based on SOPC *

An FPGA-based Low Latency Sensing and Communication Platform for Collaborative Autonomous Driving