Abstract:The revolutionary breakthroughs in Machine Learning (ML) and Artificial Intelligence (AI) are extensively being harnessed across a diverse range of domains, e.g., forensic science, healthcare, virtual assistants, cybersecurity, and robotics. On the flip side, they can also be exploited for negative purposes, like producing authentic-looking fake news that propagates misinformation and diminishes public trust. Deepfakes pertain to audio or visual multimedia contents that have been artificially synthesized or digitally modified through the application of deep neural networks. Deepfakes can be employed for benign purposes (e.g., refinement of face pictures for optimal magazine cover quality) or malicious intentions (e.g., superimposing faces onto explicit image/video to harm individuals producing fake audio recordings of public figures making inflammatory statements to damage their reputation). With mobile devices and user-friendly audio and visual editing tools at hand, even non-experts can effortlessly craft intricate deepfakes and digitally altered audio and facial features. This presents challenges to contemporary computer forensic tools and human examiners, including common individuals and digital forensic investigators. There is a perpetual battle between attackers armed with deepfake generators and defenders utilizing deepfake detectors. This paper first comprehensively reviews existing image, video, and audio deepfake databases with the aim of propelling next-generation deepfake detectors for enhanced accuracy, generalization, robustness, and explainability. Then, the paper delves deeply into open challenges and potential avenues for research in the audio and video deepfake generation and mitigation field. The aspiration for this article is to complement prior studies and assist newcomers, researchers, engineers, and practitioners in gaining a deeper understanding and in the development of innovative deepfake technologies.

Discussion Paper: The Threat of Real Time Deepfakes

Video and Audio Deepfake Datasets and Open Issues in Deepfake Technology: Being Ahead of the Curve

A Multidisciplinary Threats to Emerging Cybersecurity, Legal and Ethical Threats Posed by Deepfake Technology

Deepfakes: current and future trends

Deepfakes as a threat to a speaker and facial recognition: An overview of tools and attack vectors

The Emerging Threats of Deepfake Attacks and Countermeasures

Exploding AI-Generated Deepfakes and Misinformation: A Threat to Global Concern in the 21st Century

On the Horizon: Interactive and Compositional Deepfakes

The Tug-of-War Between Deepfake Generation and Detection

Deepfakes generation and detection: state-of-the-art, open challenges, countermeasures, and way forward

Deep Fakes: A Looming Challenge for Privacy, Democracy, and National Security

Adversarial Threats to DeepFake Detection: A Practical Perspective

DEEPFAKE DYSTOPIA: NAVIGATING THE LANDSCAPE OF THREATS AND SAFEGUARDS IN MULTIMEDIA CONTENT

Deepfake Attacks: Generation, Detection, Datasets, Challenges, and Research Directions

Threat of Deepfake Enabled Attack

Deepfakes, Misinformation, and Disinformation in the Era of Frontier AI, Generative AI, and Large AI Models

DeepFakes: a New Threat to Face Recognition? Assessment and Detection

An Analysis of Recent Advances in Deepfake Image Detection in an Evolving Threat Landscape

From deepfake to deep useful: risks and opportunities through a systematic literature review

Can deepfakes be created by novice users?

DEEPFAKE DILEMMA: A REVIEW STUDY ON VIDEO SYNTHESIS TECHNOLOGY