Abstract:In recent years, number of edge computing devices and artificial intelligence applications on them have advanced excessively. In edge computing, decision making processes and computations are moved from servers to edge devices. Hence, cheap and low power devices are required. FPGAs are very low power, inclined to do parallel operations and deeply suitable devices for running Convolutional Neural Networks (CNN) which are the fundamental unit of an artificial intelligence application. Face detection on surveillance systems is the most expected application on the security market. In this work, TinyYolov3 architecture is redesigned and deployed for face detection. It is a CNN based object detection method and developed for embedded systems. PYNQ-Z2 is selected as a target board which has low-end Xilinx Zynq 7020 System-on-Chip (SoC) on it. Redesigned TinyYolov3 model is defined in numerous bit width precisions with Brevitas library which brings fundamental CNN layers and activations in integer quantized form. Then, the model is trained in a quantized structure with WiderFace dataset. In order to decrease latency and power consumption, onchip memory of the FPGA is configured as a storage of whole network parameters and the last activation function is modified as rescaled HardTanh instead of Sigmoid. Also, high degree of parallelism is applied to logical resources of the FPGA. The model is converted to an HLS based application with using FINN framework and FINN-HLS library which includes the layer definitions in C++. Later, the model is synthesized and deployed. CPU of the SoC is employed with multithreading mechanism and responsible for preprocessing, postprocessing and TCP/IP streaming operations. Consequently, 2.4 Watt total board power consumption, 18 Frames-Per-Second (FPS) throughput and 0.757 mAP accuracy rate on Easy category of the WiderFace are achieved with 4 bits precision model.

Design and Implementation of YOLOv3-Tiny Accelerator Based on PYNQ-Z2 Heterogeneous Platform

A Convolutional Neural Network Accelerator Architecture with Fine-Granular Mixed Precision Configurability.

A CNN Hardware Accelerator Designed for YOLO Algorithm Based on RISC-V SoC

A dedicated hardware accelerator for real-time acceleration of YOLOv2

An FPGA-Based YOLOv5 Accelerator for Real-Time Industrial Vision Applications

An FPGA-Based Reconfigurable CNN Accelerator for YOLO

Power Efficient Tiny Yolo CNN Using Reduced Hardware Resources Based on Booth Multiplier and WALLACE Tree Adders

LPYOLO: Low Precision YOLO for Face Detection on FPGA

An Efficient CNN Accelerator Using Inter-Frame Data Reuse of Videos on FPGAs

FPGA-based Object Detection Acceleration Architecture Design

A Scalable OpenCL-Based FPGA Accelerator for YOLOv2

FPGA Hardware Acceleration Design for Deep Learning

A Low-Latency FPGA Implementation for Real-Time Object Detection

Hardware Implementation and Optimization of Tiny-YOLO Network.

A High-Performance YOLOV5 Accelerator for Object Detection with Near Sensor Intelligence.

Reduced-Parameter YOLO-Like Object Detector Oriented to Resource-Constrained Platform

Design and implementation of FPGA-based deep learning object detection system

System Integration and Optimization of AI Hardware Acceleration Architecture for Object Detection

Hardware Acceleration for Object Detection using YOLOv5 Deep Learning Algorithm on Xilinx Zynq FPGA Platform

Hardware Acceleration and Implementation of YOLOX-s for On-Orbit FPGA

High Power-Efficient and Performance-Density FPGA Accelerator for CNN-Based Object Detection