Abstract:Voice spoofing attempts to break into a specific automatic speaker verification (ASV) system by forging the user's voice and can be used through methods such as text-to-speech (TTS), voice conversion (VC), and replay attacks. Recently, deep learning-based voice spoofing countermeasures have been developed. However, the problem with replay is that it is difficult to construct a large number of datasets because it requires a physical recording process. To overcome these problems, this study proposes a pre-training framework based on multi-order acoustic simulation for replay voice spoofing detection. Multi-order acoustic simulation utilizes existing clean signal and room impulse response (RIR) datasets to generate audios, which simulate the various acoustic configurations of the original and replayed audios. The acoustic configuration refers to factors such as the microphone type, reverberation, time delay, and noise that may occur between a speaker and microphone during the recording process. We assume that a deep learning model trained on an audio that simulates the various acoustic configurations of the original and replayed audios can classify the acoustic configurations of the original and replay audios well. To validate this, we performed pre-training to classify the audio generated by the multi-order acoustic simulation into three classes: clean signal, audio simulating the acoustic configuration of the original audio, and audio simulating the acoustic configuration of the replay audio. We also set the weights of the pre-training model to the initial weights of the replay voice spoofing detection model using the existing replay voice spoofing dataset and then performed fine-tuning. To validate the effectiveness of the proposed method, we evaluated the performance of the conventional method without pre-training and proposed method using an objective metric, i.e., the accuracy and F1-score. As a result, the conventional method achieved an accuracy of 92.94%, F1-score of 86.92% and the proposed method achieved an accuracy of 98.16%, F1-score of 95.08%.

Fast and Lightweight Voice Replay Attack Detection Via Time-frequency Spectrum Difference

Anti-Replay: A Fast and Lightweight Voice Replay Attack Detection System.

Voice Spoofing Countermeasure for Voice Replay Attacks Using Deep Learning

Audio compression-assisted feature extraction for voice replay attack detection

An Experimental Study on Replay Attack Detection Using Spoofing Clues from both Voiced and Non-Voiced Segments

Voice Presentation Attack Detection Using Convolutional Neural Networks

Replay attack detection using variable-frequency resolution phase and magnitude features

Replay spoof detection for speaker verification system using magnitude-phase-instantaneous frequency and energy features

Deep feature synthesis approach using selective graph attention for replay attack voice spoofing detection

Self-Attention and Hybrid Features for Replay and Deep-Fake Audio Detection

Countermeasures for Automatic Speaker Verification Replay Spoofing Attack : on Data Augmentation, Feature Representation, Classification and Fusion.

Replay-attack detection using features with adaptive spectro-temporal resolution

Voice spoofing detection with raw waveform based on Dual Path Res2net

A Pre-Training Framework Based on Multi-Order Acoustic Simulation for Replay Voice Spoofing Detection

Replay Attacks Detection Using Phase and Magnitude Features with Various Frequency Resolutions

Improving Replay Detection System with Channel Consistency DenseNeXt for the ASVspoof 2019 Challenge.

When the Differences in Frequency Domain are Compensated: Understanding and Defeating Modulated Replay Attacks on Automatic Speech Recognition

Replay attack detection based on distortion by loudspeaker for voice authentication

One-class Learning Towards Synthetic Voice Spoofing Detection

Replay Attack Detection Using Magnitude And Phase Information With Attention-Based Adaptive Filters

A Defense Method Based on a Novel Replay Attack