Abstract:Three-dimensional (3-D) face recognition (FR) can improve the usability and user-friendliness of human–machine interaction. In general, 3-D FR can be divided into high-quality and low-quality 3-D FR according to different interaction scenarios. The low-quality data can be easily obtained, so its application prospect is more extensive. However, the challenge is how to balance the trade-offs between data accuracy and real-time performance. To solve this problem, we propose a lightweight multiscale fusion network (LMFNet) with a hierarchical structure based on single-mode data for low-quality 3-D FR. First, we design a backbone network with only five feature extraction blocks to reduce computational complexity and improve the inference speed. Second, we devise a mid-low adjacent layer with a multiscale feature fusion (ML-MSFF) module to extract the facial texture and contour information, and a mid-high adjacent layer with a multiscale feature fusion (MH-MSFF) module to obtain the discriminative information in high-level features. Then, a hierarchical multiscale feature fusion (HMSFF) module is formed by combining these two modules mentioned above to acquire the local information of different scales. Finally, we enhance the expression of features by integrating HMSFF with a global convolutional neural network for improving recognition accuracy. Experiments on Lock3DFace, KinectFaceDB, and IIIT-D datasets demonstrate that our proposed LMFNet can achieve superior performance on low-quality datasets. Furthermore, experiments on the cross-quality database based on Bosphorus and the different intensity noise low-quality datasets based on UMB-DB and Bosphorus show that our network is robust and has a high generalization ability. It satisfies the real-time requirement, which lays a foundation for a smooth and user-friendly interactive experience.

LMGSNet: A Lightweight Multi-scale Group Shift Fusion Network for Low-quality 3D Face Recognition

LMFNet: A Lightweight Multiscale Fusion Network with Hierarchical Structure for Low-Quality 3-D Face Recognition

Local and Global Feature Attention Fusion Network for Face Recognition

DSNet: Dual-stream Multi-Scale Fusion Network for Low-Quality 3D Face Recognition

Learning Flexibly Distributional Representation for Low-quality 3D Face Recognition.

Led3D: A Lightweight and Efficient Deep Approach to Recognizing Low-Quality 3D Faces.

Depth Map Denoising Network and Lightweight Fusion Network for Enhanced 3D Face Recognition

Enhanced Multi-Scale Feature Adaptive Fusion Sparse Convolutional Network for Large-Scale Scenes Semantic Segmentation

Self-adjusting multilayer nonlinear coupled mapping for low-resolution face recognition

Efficient Lightweight Attention Network for Face Recognition

A Lightweight Attention-based Deep Network via Multi-Scale Feature Fusion for Multi-View Facial Expression Recognition

Classifier Shared Deep Network with Multi-Hierarchy Loss for Low Resolution Face Recognition

Multi-scale Attention Guided Network for End-to-end Face Alignment and Recognition

FSFNet: Foreground Score-Aware Fusion for 3-D Object Detector under Unfavorable Conditions

Using Attention Lsgb Network for Facial Expression Recognition

Multi-scale Patch Based Representation Feature Learning for Low-Resolution Face Recognition

Attention-based Hierarchical Pyramid Feature Fusion Structure for Efficient Face Recognition.

Enhancing facial recognition accuracy through multi-scale feature fusion and spatial attention mechanisms

Multi-modal Face Anti-spoofing Using Multi-fusion Network and Global Depth-wise Convolution

Multi-modal Multi-layer Fusion Network with Average Binary Center Loss for Face Anti-spoofing