Abstract:Three-dimensional (3-D) face recognition (FR) can improve the usability and user-friendliness of human–machine interaction. In general, 3-D FR can be divided into high-quality and low-quality 3-D FR according to different interaction scenarios. The low-quality data can be easily obtained, so its application prospect is more extensive. However, the challenge is how to balance the trade-offs between data accuracy and real-time performance. To solve this problem, we propose a lightweight multiscale fusion network (LMFNet) with a hierarchical structure based on single-mode data for low-quality 3-D FR. First, we design a backbone network with only five feature extraction blocks to reduce computational complexity and improve the inference speed. Second, we devise a mid-low adjacent layer with a multiscale feature fusion (ML-MSFF) module to extract the facial texture and contour information, and a mid-high adjacent layer with a multiscale feature fusion (MH-MSFF) module to obtain the discriminative information in high-level features. Then, a hierarchical multiscale feature fusion (HMSFF) module is formed by combining these two modules mentioned above to acquire the local information of different scales. Finally, we enhance the expression of features by integrating HMSFF with a global convolutional neural network for improving recognition accuracy. Experiments on Lock3DFace, KinectFaceDB, and IIIT-D datasets demonstrate that our proposed LMFNet can achieve superior performance on low-quality datasets. Furthermore, experiments on the cross-quality database based on Bosphorus and the different intensity noise low-quality datasets based on UMB-DB and Bosphorus show that our network is robust and has a high generalization ability. It satisfies the real-time requirement, which lays a foundation for a smooth and user-friendly interactive experience.

Refining Single Low-Quality Facial Depth Map by Lightweight and Efficient Deep Model

A synthesis method for personalized 3D face reconstruction

High-fidelity 3D Face Reconstruction with Multi-Scale Details

Led3D: A Lightweight and Efficient Deep Approach to Recognizing Low-Quality 3D Faces.

Adaptive Representation Learning and Sample Weighting for Low-Quality 3D Face Recognition

Depth Map Denoising Network and Lightweight Fusion Network for Enhanced 3D Face Recognition

MFFNet: Single facial depth map refinement using multi-level feature fusion

Beyond 3DMM Space: Towards Fine-Grained 3D Face Reconstruction

Robust 3d Face Reconstruction From Single Noisy Depth Image Through Semantic Consistency

3D Face Reconstruction and Semantic Annotation from Single Depth Image

A Lightweight Monocular 3D Face Reconstruction Method Based on Improved 3D Morphing Models.

LMFNet: A Lightweight Multiscale Fusion Network with Hierarchical Structure for Low-Quality 3-D Face Recognition

A Two-Stage Framework for 3D FaceReconstruction from RGBD Images

TED-Face: Texture-Enhanced Deep Face Reconstruction in the Wild

Robust and Detailed Reconstuction of Human Face from Single Image

High-Resolution Depth Refinement by Photometric and Multi-shading Constraints.

Dense 3D Facial Reconstruction from a Single Depth Image in Unconstrained Environment

Face Denoising and 3D Reconstruction from A Single Depth Image

Edge-guided Single Facial Depth Map Super-Resolution Using CNN.

Coarse-to-fine Face Depth Super-Resolution with Attentive Feature Selection.