Abstract:Voice spoofing attempts to break into a specific automatic speaker verification (ASV) system by forging the user's voice and can be used through methods such as text-to-speech (TTS), voice conversion (VC), and replay attacks. Recently, deep learning-based voice spoofing countermeasures have been developed. However, the problem with replay is that it is difficult to construct a large number of datasets because it requires a physical recording process. To overcome these problems, this study proposes a pre-training framework based on multi-order acoustic simulation for replay voice spoofing detection. Multi-order acoustic simulation utilizes existing clean signal and room impulse response (RIR) datasets to generate audios, which simulate the various acoustic configurations of the original and replayed audios. The acoustic configuration refers to factors such as the microphone type, reverberation, time delay, and noise that may occur between a speaker and microphone during the recording process. We assume that a deep learning model trained on an audio that simulates the various acoustic configurations of the original and replayed audios can classify the acoustic configurations of the original and replay audios well. To validate this, we performed pre-training to classify the audio generated by the multi-order acoustic simulation into three classes: clean signal, audio simulating the acoustic configuration of the original audio, and audio simulating the acoustic configuration of the replay audio. We also set the weights of the pre-training model to the initial weights of the replay voice spoofing detection model using the existing replay voice spoofing dataset and then performed fine-tuning. To validate the effectiveness of the proposed method, we evaluated the performance of the conventional method without pre-training and proposed method using an objective metric, i.e., the accuracy and F1-score. As a result, the conventional method achieved an accuracy of 92.94%, F1-score of 86.92% and the proposed method achieved an accuracy of 98.16%, F1-score of 95.08%.

Lightweight Voice Spoofing Detection Using Improved One-Class Learning and Knowledge Distillation

End-to-end Spoofing Speech Detection and Knowledge Distillation under Noisy Conditions

Fast and Lightweight Voice Replay Attack Detection Via Time-frequency Spectrum Difference

Enhancing Out-of-Domain Detection for Speech Spoofing Countermeasure Via Supervised Contrastive Learning

One-class Learning Towards Synthetic Voice Spoofing Detection

Siamese Network with Wav2vec Feature for Spoofing Speech Detection

One-Class Knowledge Distillation for Spoofing Speech Detection

Toward Improving Synthetic Audio Spoofing Detection Robustness via Meta-Learning and Disentangled Training With Adversarial Examples

Voice Spoofing Countermeasure for Voice Replay Attacks Using Deep Learning

One-Class Neural Network With Directed Statistics Pooling for Spoofing Speech Detection

Voice spoofing detection with raw waveform based on Dual Path Res2net

Continual Learning for Fake Audio Detection

Voice Presentation Attack Detection Using Convolutional Neural Networks

SAMO: Speaker Attractor Multi-Center One-Class Learning for Voice Anti-Spoofing

Experimental Study: Enhancing Voice Spoofing Detection Models with wav2vec 2.0

A Pre-Training Framework Based on Multi-Order Acoustic Simulation for Replay Voice Spoofing Detection

Audio Anti-spoofing Using a Simple Attention Module and Joint Optimization Based on Additive Angular Margin Loss and Meta-learning

A Light CNN with Split Batch Normalization for Spoofed Speech Detection Using Data Augmentation

A Preliminary Case Study on Long-Form In-the-Wild Audio Spoofing Detection

Securing Voice Biometrics: One-Shot Learning Approach for Audio Deepfake Detection