Abstract:Voice spoofing attempts to break into a specific automatic speaker verification (ASV) system by forging the user's voice and can be used through methods such as text-to-speech (TTS), voice conversion (VC), and replay attacks. Recently, deep learning-based voice spoofing countermeasures have been developed. However, the problem with replay is that it is difficult to construct a large number of datasets because it requires a physical recording process. To overcome these problems, this study proposes a pre-training framework based on multi-order acoustic simulation for replay voice spoofing detection. Multi-order acoustic simulation utilizes existing clean signal and room impulse response (RIR) datasets to generate audios, which simulate the various acoustic configurations of the original and replayed audios. The acoustic configuration refers to factors such as the microphone type, reverberation, time delay, and noise that may occur between a speaker and microphone during the recording process. We assume that a deep learning model trained on an audio that simulates the various acoustic configurations of the original and replayed audios can classify the acoustic configurations of the original and replay audios well. To validate this, we performed pre-training to classify the audio generated by the multi-order acoustic simulation into three classes: clean signal, audio simulating the acoustic configuration of the original audio, and audio simulating the acoustic configuration of the replay audio. We also set the weights of the pre-training model to the initial weights of the replay voice spoofing detection model using the existing replay voice spoofing dataset and then performed fine-tuning. To validate the effectiveness of the proposed method, we evaluated the performance of the conventional method without pre-training and proposed method using an objective metric, i.e., the accuracy and F1-score. As a result, the conventional method achieved an accuracy of 92.94%, F1-score of 86.92% and the proposed method achieved an accuracy of 98.16%, F1-score of 95.08%.

Partially Fake Audio Detection Based on MOSNet with Pretraining Models

End-to-end Spoofing Speech Detection and Knowledge Distillation under Noisy Conditions

Ghost-in-Wave: How Speaker-Irrelative Features Interfere DeepFake Voice Detectors

Fake Audio Detection Based On Unsupervised Pretraining Models

Fully Automated End-to-End Fake Audio Detection.

Mixture of Experts Fusion for Fake Audio Detection Using Frozen wav2vec 2.0

AI-Synthesized Voice Detection Using Neural Vocoder Artifacts

Voice spoofing detection with raw waveform based on Dual Path Res2net

MOS-FAD: Improving Fake Audio Detection Via Automatic Mean Opinion Score Prediction

Utilizing Self-supervised Representations for MOS Prediction

Neural MOS Prediction for Synthesized Speech Using Multi-Task Learning With Spoofing Detection and Spoofing Type Classification

Partially Fake Audio Detection by Self-attention-based Fake Span Discovery

A Pre-Training Framework Based on Multi-Order Acoustic Simulation for Replay Voice Spoofing Detection

Voice Deepfake Detection Using the Self-Supervised Pre-Training Model HuBERT

Adversarial Post-Processing of Voice Conversion Against Spoofing Detection

Detecting Synthetic Speech Manipulation in Real Audio Recordings

An Initial Investigation for Detecting Partially Spoofed Audio

MelCochleaGram-DeepCNN: Sequentially Fused Spectrogram and the DeepCNN Classifiers-based Audio Spoof Detection System

Self-Attention and Hybrid Features for Replay and Deep-Fake Audio Detection

Multi-perspective Information Fusion Res2Net with RandomSpecmix for Fake Speech Detection

Speaker Recognition-Assisted Robust Audio Deepfake Detection