Abstract:Face detection and alignment are two fundamental tasks for facial applications and the corresponding accelerators have been designed to enable energy-efficient acceleration. However, these dedicated accelerators are always designed separately, thereby ignoring the inherent correlation between face detection and alignment and causing additional communication and area overhead. Based on this motivation, a multi-task cascaded convolutional networks (MTCNN) algorithm-based accelerator is presented in this work to support both face detection and alignment for multiple faces. First, multiply-accumulate (MAC) operations and memory access of the magnification process in the resize module are reduced by 22.8% and 24.8% on average, respectively, when compared with those of similar methods. Second, clustering non-maximum suppression (C-NMS) is proposed to significantly reduce the intersection over union computation and eliminate the hardware-inference sorting process in NMS, yielding a 16.0% speedup in the overall process. Third, an efficient pipeline architecture is proposed to implement a complexity-and memory-intensive proposal network of MTCNN in a more computationally efficient manner, with 38.3% less memory capacity than a similar solution. Meanwhile, only approximately half of the multipliers are needed to achieve the same throughput with high pipeline utilization. Fourth, considering the variable number of faces in each input, a batch schedule mechanism is proposed to improve the fully-connected layer hardware utilization by 16.7% on average in the batch process. Based on a simulation with the TSMC 28 nm CMOS process, this accelerator consumes only 10.9ms at 400 MHz to simultaneously process 5 faces. The power efficiency reaches 4.80 TOPS/W, which is 227.4x higher than that of the state-of- the-art solution.

A Fast and Power-Efficient Hardware Architecture for Non-Maximum Suppression

A Sort-Less FPGA-Based Non-Maximum Suppression Accelerator using Multi-Thread Computing and Binary Max Engine for Object Detection

O3NMS: an Out-Of-Order-Based Low-Latency Accelerator for Non-Maximum Suppression

A low cost architecture for high performance face detection

Inverted Non-maximum Suppression for more Accurate and Neater Face Detection

An AdaBoost-Based Face Detection System Using Parallel Configurable Architecture with Optimized Computation

The Design of Objects Bounding Boxes Non-Maximum Suppression and Visualization Module Based on FPGA

Adaptive Human Detection Approach Using FPGA-based Parallel Architecture in Reconfigurable Hardware.

A Fast and Power-Efficient Hardware Architecture for Visual Feature Detection in Affine-SIFT.

Fast AdaBoost-Based Face Detection System on a Dynamically Coarse Grain Reconfigurable Architecture.

Multiframe-integrated, In-Sensor Computing Using Persistent Photoconductivity

Efficient Deployment of Single Shot Multibox Detector Network on FPGAs

Optimized Acceleration of Single Shot Detection for Edge Computing Based-on FPGA

A Multi-Task Hardwired Accelerator for Face Detection and Alignment

Real-time Hardware Face Detection Based on Adaboost Algorithm

D-NMS: A Dynamic NMS Network for General Object Detection.

Accelerating Non-Maximum Suppression: A Graph Theory Perspective

Hardware Architecture for Fast General Object Detection using Aggregated Channel Features

A 1.17 TOPS/W, 150fps Accelerator for Multi-Face Detection and Alignment

ASAP-NMS: Accelerating Non-Maximum Suppression Using Spatially Aware Priors

Efficient Hardware Post Processing of Anchor-Based Object Detection on FPGA