Abstract:Although face recognition has achieved great success due to deep learning, many factors may affect the quality of faces in the wild, such as pose changes, age variations, and light changes, which can seriously affect the performance of face recognition. In this work, an effective approach called Efficient Lightweight Attention Networks (ELANet) is proposed to address the challenge brought by the impacts of poses and ages on face recognition performance. First, similar local patches are particularly important when the geometry and appearance of a face change drastically. To alleviate this challenge, spatial attention is used to capture important locally similar patches and channel attention is employed to focus on features with different levels of importance. Furthermore, Efficient Fusion Attention (EFA) module is designed to achieve better performance, which can alleviate the computational effort required by fusing spatial and channel attention. Second, multi-scale features learning is necessary because pose or large expression changes can cause similar recognition regions to appear at different scales. For this purpose, pyramid multi-scale module is presented, which constructs a series of features at different scales via pooling operations. Third, to unite low-level local detail information with high-level semantic information, the features of different layers are fused by Adaptively Spatial Feature Fusion (ASFF) instead of simply utilizing addition or concatenation. Compared to recent lightweight networks, the ELANet improved performance by 1.83% and 2.17% on the CPLFW and VGG2_FP datasets, respectively, and by 0.92% on the CALFW dataset. The ELANet addresses the challenge regarding the impacts of poses and ages on face recognition performance with few parameters and computational effort and is suitable for embedded and mobile devices.

EAN: an Efficient Attention Module Guided by Normalization for Deep Neural Networks

Efficient Attention Network: Accelerate Attention by Searching Where to Plug

NAM: Normalization-based Attention Module

ELA: Efficient Local Attention for Deep Convolutional Neural Networks

EAANet: Efficient Attention Augmented Convolutional Networks

ECA-Net: Efficient Channel Attention for Deep Convolutional Neural Networks

A generic shift-norm-activation approach for deep learning

Exemplar Normalization for Learning Deep Representation

ACNe: Attentive Context Normalization for Robust Permutation-Equivariant Learning

ADNet: Leveraging Error-Bias Towards Normal Direction in Face Alignment

A Generalized Attention Mechanism to Enhance the Accuracy Performance of Neural Networks

Attention Guided Global Enhancement and Local Refinement Network for Semantic Segmentation

Normal Learning in Videos with Attention Prototype Network

Efficient Lightweight Attention Network for Face Recognition

Normalization Techniques in Training DNNs: Methodology, Analysis and Application

CHAIN: Enhancing Generalization in Data-Efficient GANs via lipsCHitz continuity constrAIned Normalization

EMBANet: A Flexible Efffcient Multi-branch Attention Network

DIANet: Dense-and-Implicit Attention Network

A novel attention-enhanced network for image super-resolution

Habituation Normalization: A Novel Way to Improve Network Training on Resource-Constrained Devices