Dual feature disentanglement for face anti-spoofing

Yimei Ma,Jianjun Qian,Jun Li,Jian Yang
DOI: https://doi.org/10.1016/j.patcog.2024.110656
IF: 8
2024-06-07
Pattern Recognition
Abstract:Domain generalization for Face Anti-Spoofing (FAS) is increasingly crucial with face attacks across unseen domains. Some existing face anti-spoofing methods aim to disentangle spoof feature for both seen and unseen scenarios. However, it is still a challenging problem to capture spoof feature from facial image, because of spoof pattern are often mixed with various facial attributes such as identity, expression, age and gender. To solve the above problem, we propose a Dual Feature Disentanglement Network (DFDN), which leverages feature projection scheme based on domain-invariant feature in conjunction with rearranging the facial structure to learn spoof feature jointly. Specifically, DFDN introduces the local mask module and domain discriminator to enhance the domain-invariant feature. Based on this, we employ the geometry projection relations to achieve the refined spoof pattern via the feature projection. Meanwhile, we disrupt facial structure to weaken face attributes feature learning and guide CNNs to learn spoof feature. Subsequently, consistent regularization is developed to reduce the gap between the above two kinds of spoof pattern by introducing optimal transport and cosine similarity. Extensive experiments and visualizations demonstrate the advantages of our DFDN over the state-of-the-art methods.
computer science, artificial intelligence,engineering, electrical & electronic
What problem does this paper attempt to address?