Abstract:AI-synthesized speech, also known as deepfake speech, has recently raised significant concerns due to the rapid advancement of speech synthesis and speech conversion techniques. Previous works often rely on distinguishing synthesizer artifacts to identify deepfake speech. However, excessive reliance on these specific synthesizer artifacts may result in unsatisfactory performance when addressing speech signals created by unseen synthesizers. In this paper, we propose a robust deepfake speech detection method that employs feature decomposition to learn synthesizer-independent content features as complementary for detection. Specifically, we propose a dual-stream feature decomposition learning strategy that decomposes the learned speech representation using a synthesizer stream and a content stream. The synthesizer stream specializes in learning synthesizer features through supervised training with synthesizer labels. Meanwhile, the content stream focuses on learning synthesizer-independent content features, enabled by a pseudo-labeling-based supervised learning method. This method randomly transforms speech to generate speed and compression labels for training. Additionally, we employ an adversarial learning technique to reduce the synthesizer-related components in the content stream. The final classification is determined by concatenating the synthesizer and content features. To enhance the model's robustness to different synthesizer characteristics, we further propose a synthesizer feature augmentation strategy that randomly blends the characteristic styles within real and fake audio features and randomly shuffles the synthesizer features with the content features. This strategy effectively enhances the feature diversity and simulates more feature combinations.

Ghost-in-Wave: How Speaker-Irrelative Features Interfere DeepFake Voice Detectors

Speaker Recognition-Assisted Robust Audio Deepfake Detection

DeepSonar: Towards Effective and Robust Detection of AI-Synthesized Fake Voices

Transferring Audio Deepfake Detection Capability Across Languages

Audio Deepfake Detection Based on a Combination of F0 Information and Real Plus Imaginary Spectrogram Features

Does Audio Deepfake Detection Generalize?

Self-Attention and Hybrid Features for Replay and Deep-Fake Audio Detection

Warning: Humans Cannot Reliably Detect Speech Deepfakes

Robust Audio Anti-Spoofing System Based on Low-Frequency Sub-Band Information

Deepfake audio detection by speaker verification

Robust AI-Synthesized Speech Detection Using Feature Decomposition Learning and Synthesizer Feature Augmentation

Room Impulse Responses help attackers to evade Deep Fake Detection

A Comparative Study on Physical and Perceptual Features for Deepfake Audio Detection

Utilizing Speaker Profiles for Impersonation Audio Detection

Learn from Real: Reality Defender's Submission to ASVspoof5 Challenge

A blended framework for audio spoof detection with sequential models and bags of auditory bites

Can DeepFake Speech be Reliably Detected?

Acoustic features analysis for explainable machine learning-based audio spoofing detection

Combining Automatic Speaker Verification and Prosody Analysis for Synthetic Speech Detection

Multi-perspective Information Fusion Res2Net with RandomSpecmix for Fake Speech Detection

AI-Synthesized Voice Detection Using Neural Vocoder Artifacts