Abstract:Although face recognition has achieved great success due to deep learning, many factors may affect the quality of faces in the wild, such as pose changes, age variations, and light changes, which can seriously affect the performance of face recognition. In this work, an effective approach called Efficient Lightweight Attention Networks (ELANet) is proposed to address the challenge brought by the impacts of poses and ages on face recognition performance. First, similar local patches are particularly important when the geometry and appearance of a face change drastically. To alleviate this challenge, spatial attention is used to capture important locally similar patches and channel attention is employed to focus on features with different levels of importance. Furthermore, Efficient Fusion Attention (EFA) module is designed to achieve better performance, which can alleviate the computational effort required by fusing spatial and channel attention. Second, multi-scale features learning is necessary because pose or large expression changes can cause similar recognition regions to appear at different scales. For this purpose, pyramid multi-scale module is presented, which constructs a series of features at different scales via pooling operations. Third, to unite low-level local detail information with high-level semantic information, the features of different layers are fused by Adaptively Spatial Feature Fusion (ASFF) instead of simply utilizing addition or concatenation. Compared to recent lightweight networks, the ELANet improved performance by 1.83% and 2.17% on the CPLFW and VGG2_FP datasets, respectively, and by 0.92% on the CALFW dataset. The ELANet addresses the challenge regarding the impacts of poses and ages on face recognition performance with few parameters and computational effort and is suitable for embedded and mobile devices.

Attention Mesh: High-fidelity Face Mesh Prediction in Real-time

Real-Time Facial Landmark Detection by Attention-driven Lightweight Network

Real-Time Audio-Guided Multi-Face Reenactment

APB2FaceV2: Real-Time Audio-Guided Multi-Face Reenactment

Real-time Facial Surface Geometry from Monocular Video on Mobile GPUs

Knowing When to Quit: Selective Cascaded Regression with Patch Attention for Real-Time Face Alignment

Persona: Real-Time Neural 3D Face Reconstruction for Visual Effects on Mobile Devices

AnyFace++: Deep Multi-Task, Multi-Domain Learning for Efficient Face AI

3D face reconstruction with dense landmarks

FaceScape: a Large-scale High Quality 3D Face Dataset and Detailed Riggable 3D Face Prediction

Neural Point-based Volumetric Avatar: Surface-guided Neural Points for Efficient and Photorealistic Volumetric Head Avatar

Efficient Meshy Neural Fields for Animatable Human Avatars

Flow-Attention-based Spatio-Temporal Aggregation Network for 3D Mask Detection

Efficient 3D Implicit Head Avatar with Mesh-anchored Hash Table Blendshapes

Beauty3DFaceNet: Deep Geometry and Texture Fusion for 3D Facial Attractiveness Prediction.

MobilePortrait: Real-Time One-Shot Neural Head Avatars on Mobile Devices

Real-Time Semantic Segmentation With Fast Attention

VGGHeads: 3D Multi Head Alignment with a Large-Scale Synthetic Dataset

Efficient Lightweight Attention Network for Face Recognition

3D Hand Mesh Recovery from Monocular RGB in Camera Space

Real-time Pupil Tracking from Monocular Video for Digital Puppetry