Abstract:The mnemonic descent method (MDM) algorithm is the first end-to-end recurrent convolutional system for high-accuracy face alignment. However, the heavy computational complexity and high memory access demands make it difficult to satisfy the requirements of real-time applications. To address this problem, an improved MDM (I-MDM) algorithm is proposed for efficient hardware implementation based on several hardware-oriented optimizations. First, a patch merging mechanism is introduced to dynamically cluster and eliminate redundant landmarks, which significantly reduces computational complexity with minimal accuracy loss. Second, a dedicated convolutional layer is inserted to halve the number of computations and memory access of the subsequent fully connected layer, yielding a 4.42% decrease in the failure rate. Third, a lightweight preprocessing method named dual regressors is proposed to reinitialize face images, which can greatly improve the overall accuracy. Moreover, compared with a similar method, the DR method can reduce computations and memory storage by nearly 99.9%. Overall and compared with the MDM algorithm, I-MDM not only reduces the number of computations by 23.5% but also decreases the failure rate by 17.9% on the 300 W test set. Based on the proposed I-MDM algorithm, an I-MDM-based hardwired accelerator is presented using the TSMC 65 nm CMOS process. First, compared with similar solutions, the gradient calculation operation is rearranged and loaded pixels are reused in the HoG feature extraction to eliminate all division operations and 25% off-chip memory access. Second, patch-independent central activations are used to enable patch-level pipelined operations, yielding a 2× acceleration in the overall process. This accelerator achieves 460 GOPS/W energy efficiency at 330 MHz, which is 38× higher than the most recent face alignment accelerator with the same process.

A 700fps Optimized Coarse-to-fine Shape Searching Based Hardware Accelerator for Face Alignment

A Face Alignment Accelerator Based on Optimized Coarse-to-Fine Shape Searching.

A 1.17 TOPS/W, 150fps Accelerator for Multi-Face Detection and Alignment

FPGA-Based Feature Extraction and Tracking Accelerator for Real-Time Visual SLAM

A 460 GOPS/W Improved Mnemonic Descent Method-Based Hardwired Accelerator for Face Alignment.

An Efficient VLSI Architecture of Speeded-Up Robust Feature Extraction for High Resolution and High Frame Rate Video

High-speed Reconstruction for Ultra-Low Resolution Faces

ASFD: Automatic and Scalable Face Detector

FPGA Implementation of Feature Detection Algorithm Based on High Level Synthesis

A Multi-Task Hardwired Accelerator for Face Detection and Alignment

A 127 fps in full hd accelerator based on optimized AKAZE with efficiency and effectiveness for image feature extraction

Optimization of Speeded-Up Robust Feature Algorithm for Hardware Implementation

A 325 FPS Corner-Detection Accelerator with Hardware-Oriented Optimization.

FPGA Accelerated DAN Algorithm with Weight Decomposition for Face Alignment

Implementation of High Performance Hardware Architecture of Face Recognition Algorithm Based on Local Binary Pattern on Fpga

Efficient Hardware Accelerator Design of Non-Linear Optimization Correlative Scan Matching Algorithm in 2D LiDAR SLAM for Mobile Robots

FPGA-based Efficient Implementation of SURF Algorithm

FPGA-accelerated Automatic Alignment for Three-dimensional Tomography

A Fast and Power-Efficient Hardware Architecture for Visual Feature Detection in Affine-SIFT.

SFTT: A 325 FPS Computational and Hardware Efficient Corner-Detection Accelerator Design for SLAM Applications

HDSuper: High-Quality and High Computational Utilization Edge Super-Resolution Accelerator With Hardware-Algorithm Co-Design Techniques