Fine Alignment, Flexible Fusion: A Novel Framework of Multi-Model Score Fusion in Face Identification

Lanchi Xie,Zhihui Li,Shengjin Wang,Xinyu Hou,Ning Zhang
DOI: https://doi.org/10.1016/j.forsciint.2023.111888
IF: 2.676
2024-01-01
Forensic Science International
Abstract:Multi-model score fusion was considered a bottleneck problem in forensic face identification. While the score distribution of different face models varies greatly, the existing score processing methods cannot achieve ac-curate alignment. This paper proposed a score fusion framework named fine alignment and flexible fusion framework (FAFF). In FAFF, we took score-based likelihood ratios as the reference values to align the similarity scores generated by different face models. First, we set up a unified calibration test workflow based on the forensic likelihood ratio test. Then, 3 LLR anchor-based methods (LLRBA1, LLRBA2, and LLRBA3) and LLR curve-based methods (LLRBC) were proposed. Finally, we conducted fusion experiments on four face models (VGGface, Facenet, Arcface, and SFace). The experimental results show that on the CelebA dataset, compared with the existing MOEBA and PAN methods, LLRBC increased the TPR@ 10-7 FPR by 175.4 % and 162.9 %, and LLRBA increased by 55.6 % and 48.5 %.
What problem does this paper attempt to address?