Abstract:In recent years, speaker verification systems have been used in many production scenarios. Unfortunately, they are still very vulnerable to different kinds of spoofing attacks, such as speech synthesis attacks, replay attacks, etc. Researchers have proposed many methods to defend against these attacks, but in the existing methods, researchers just focus on speech features. In recent studies, researchers have found that speech contains a large amount of face information. In fact, we can determine the speaker’s gender, age, mouth shape, and other information by voice. These information can help us distinguish spoofing attacks. Inspired by this phenomenon, we propose a generalized framework named GACMNet. To cope with different attack scenarios, we instantiated two different models. Our framework is mainly divided into data pre-processing phase, feature extraction phase, feature fusion phase, and classification phase. Specifically, our framework consists of two branches. On the one hand, we extract face features in speech by a convolutional neural network. On the other hand, we use a densely connected network to extract speech features. For the more, we designed a global attention-based information fusion mechanism to distinguish the importance of each part of the features. Our solution was proven to be effective in two large scenarios. Compared to the existing methods, our model improves the tandem decision cost function (t-DCF) and equal error rate (EER) scores by 9% and 11% in the logical access scenario, respectively, our model improves the EER score by 10% in the physical access scenario.

Attentional Multi-Feature Fusion for Spoofing-Aware Speaker Verification

Tackling Spoofing-Aware Speaker Verification with Multi-Model Fusion.

Spoofing-Aware Speaker Verification by Multi-Level Fusion

Siamese Network with Wav2vec Feature for Spoofing Speech Detection

Anti-Spoofing Speaker Verification System with Multi-Feature Integration and Multi-Task Learning

Attention-Based Convolutional Neural Network for ASV Spoofing Detection.

Characterizing the Fusion Strategies for Spoofing-Aware Speaker Verification

A Probabilistic Fusion Framework for Spoofing Aware Speaker Verification

Spoofing-Aware Attention Based ASV Back-end with Multiple Enrollment Utterances and a Sampling Strategy for the SASV Challenge 2022

Physiological-Physical Feature Fusion for Automatic Voice Spoofing Detection

Spoofing-Aware Speaker Verification Robust Against Domain and Channel Mismatches

Enhancing Synthesized Speech Detection with Dual Attention Using Features Fusion

Voice Presentation Attack Detection Using Convolutional Neural Networks

Multi-task Learning Based Spoofing-Robust Automatic Speaker Verification System

Simultaneous Utilization of Spectral Magnitude and Phase Information to Extract Supervectors for Speaker Verification Anti-Spoofing

Two Methods for Spoofing-Aware Speaker Verification: Multi-Layer Perceptron Score Fusion Model and Integrated Embedding Projector

Multi-task learning of deep neural networks for joint automatic speaker verification and spoofing detection

Generalizing Speaker Verification for Spoof Awareness in the Embedding Space

Spoofing-Robust Speaker Verification Using Parallel Embedding Fusion: BTU Speech Group's Approach for ASVspoof5 Challenge

Cross-modal Information Fusion for Voice Spoofing Detection.