Abstract:A deepfake is content or material that is synthetically generated or manipulated using artificial intelligence (AI) methods, to be passed off as real and can include audio, video, image, and text synthesis. The key difference between manual editing and deepfakes is that deepfakes are AI generated or AI manipulated and closely resemble authentic artifacts. In some cases, deepfakes can be fabricated using AI-generated content in its entirety. Deepfakes have started to have a major impact on society with more generation mechanisms emerging everyday. This article makes a contribution in understanding the landscape of deepfakes, and their detection and generation methods. We evaluate various categories of deepfakes especially in audio. The purpose of this survey is to provide readers with a deeper understanding of (1) different deepfake categories; (2) how they could be created and detected; (3) more specifically, how audio deepfakes are created and detected in more detail, which is the main focus of this paper. We found that generative adversarial networks (GANs), convolutional neural networks (CNNs), and deep neural networks (DNNs) are common ways of creating and detecting deepfakes. In our evaluation of over 150 methods, we found that the majority of the focus is on video deepfakes, and, in particular, the generation of video deepfakes. We found that for text deepfakes, there are more generation methods but very few robust methods for detection, including fake news detection, which has become a controversial area of research because of the potential heavy overlaps with human generation of fake content. Our study reveals a clear need to research audio deepfakes and particularly detection of audio deepfakes. This survey has been conducted with a different perspective, compared to existing survey papers that mostly focus on just video and image deepfakes. This survey mainly focuses on audio deepfakes that are overlooked in most of the existing surveys. This article's most important contribution is to critically analyze and provide a unique source of audio deepfake research, mostly ranging from 2016 to 2021. To the best of our knowledge, this is the first survey focusing on audio deepfakes generation and detection in English.

Review of audio deepfake detection techniques: Issues and prospects

Audio deepfakes: A survey

Video and Audio Deepfake Datasets and Open Issues in Deepfake Technology: Being Ahead of the Curve

Audio Deepfake Detection: A Survey

A Review of Modern Audio Deepfake Detection Methods: Challenges and Future Directions

Understanding Audiovisual Deepfake Detection: Techniques, Challenges, Human Factors and Perceptual Insights

Emergence of deepfakes and video tampering detection approaches: A survey

DEEPFAKE DILEMMA: A REVIEW STUDY ON VIDEO SYNTHESIS TECHNOLOGY

Audio Anti-Spoofing Detection: A Survey

DeepFake Detection: Current Challenges and Next Steps

A Systematic Review on Deep Fake Image Generation, Detection Techniques, Ethical Implications, and Overcoming Challenges

A Survey of Deepfake Detection Methods: Innovations, Accuracy, and Future Directions

Deepfakes generation and detection: state-of-the-art, open challenges, countermeasures, and way forward

Face manipulated deepfake generation and recognition approaches: a survey

A Multimodal Framework for Deepfake Detection

Efficient Deepfake Audio Detection Using Spectro-Temporal Analysis and Deep Learning

Leveraging Deep Learning Approaches for Deepfake Detection: A Review

Comparative Analysis of Deep-Fake Algorithms

A Comprehensive Survey on Deepfake Methods: Generation, Detection, and Applications

From Audio Deepfake Detection to AI-Generated Music Detection -- A Pathway and Overview

A review of deep learning‐based approaches for deepfake content detection