Abstract:Voice spoofing attempts to break into a specific automatic speaker verification (ASV) system by forging the user's voice and can be used through methods such as text-to-speech (TTS), voice conversion (VC), and replay attacks. Recently, deep learning-based voice spoofing countermeasures have been developed. However, the problem with replay is that it is difficult to construct a large number of datasets because it requires a physical recording process. To overcome these problems, this study proposes a pre-training framework based on multi-order acoustic simulation for replay voice spoofing detection. Multi-order acoustic simulation utilizes existing clean signal and room impulse response (RIR) datasets to generate audios, which simulate the various acoustic configurations of the original and replayed audios. The acoustic configuration refers to factors such as the microphone type, reverberation, time delay, and noise that may occur between a speaker and microphone during the recording process. We assume that a deep learning model trained on an audio that simulates the various acoustic configurations of the original and replayed audios can classify the acoustic configurations of the original and replay audios well. To validate this, we performed pre-training to classify the audio generated by the multi-order acoustic simulation into three classes: clean signal, audio simulating the acoustic configuration of the original audio, and audio simulating the acoustic configuration of the replay audio. We also set the weights of the pre-training model to the initial weights of the replay voice spoofing detection model using the existing replay voice spoofing dataset and then performed fine-tuning. To validate the effectiveness of the proposed method, we evaluated the performance of the conventional method without pre-training and proposed method using an objective metric, i.e., the accuracy and F1-score. As a result, the conventional method achieved an accuracy of 92.94%, F1-score of 86.92% and the proposed method achieved an accuracy of 98.16%, F1-score of 95.08%.

Adversarial Post-Processing of Voice Conversion Against Spoofing Detection

Adversarial Voice Conversion Against Neural Spoofing Detectors.

Robustness of Speech Spoofing Detectors Against Adversarial Post-Processing of Voice Conversion

Fast and Lightweight Voice Replay Attack Detection Via Time-frequency Spectrum Difference

End-to-end Spoofing Speech Detection and Knowledge Distillation under Noisy Conditions

Voice Presentation Attack Detection Using Convolutional Neural Networks

Toward Improving Synthetic Audio Spoofing Detection Robustness via Meta-Learning and Disentangled Training With Adversarial Examples

One-class Learning Towards Synthetic Voice Spoofing Detection

Voice Spoofing Countermeasure for Voice Replay Attacks Using Deep Learning

Voice spoofing detection with raw waveform based on Dual Path Res2net

Audio Anti-spoofing Using a Simple Attention Module and Joint Optimization Based on Additive Angular Margin Loss and Meta-learning

Black-box Attacks on Automatic Speaker Verification using Feedback-controlled Voice Conversion

ConvNeXt Based Neural Network for Audio Anti-Spoofing

A Pre-Training Framework Based on Multi-Order Acoustic Simulation for Replay Voice Spoofing Detection

DEFENDING YOUR VOICE: ADVERSARIAL ATTACK ON VOICE CONVERSION

Identifying Source Speakers for Voice Conversion based Spoofing Attacks on Speaker Verification Systems

Recognition-Synthesis Based Non-Parallel Voice Conversion with Adversarial Learning

Synthetic Voice Detection and Audio Splicing Detection using SE-Res2Net-Conformer Architecture

Experimental Study: Enhancing Voice Spoofing Detection Models with wav2vec 2.0

Recognizing Voice Spoofing Attacks Via Acoustic Nonlinearity Dissection for Mobile Devices