Abstract:The recent proliferation of fake portrait videos poses direct threats on society, law, and privacy [1]. Believing the fake video of a politician, distributing fake pornographic content of celebrities, fabricating impersonated fake videos as evidence in courts are just a few real world consequences of deep fakes. We present a novel approach to detect synthetic content in portrait videos, as a preventive solution for the emerging threat of deep fakes. In other words, we introduce a deep fake detector. We observe that detectors blindly utilizing deep learning are not effective in catching fake content, as generative models produce formidably realistic results. Our key assertion follows that biological signals hidden in portrait videos can be used as an implicit descriptor of authenticity, because they are neither spatially nor temporally preserved in fake content. To prove and exploit this assertion, we first engage several signal transformations for the pairwise separation problem, achieving 99.39% accuracy. Second, we utilize those findings to formulate a generalized classifier for fake content, by analyzing proposed signal transformations and corresponding feature sets. Third, we generate novel signal maps and employ a CNN to improve our traditional classifier for detecting synthetic content. Lastly, we release an "in the wild" dataset of fake portrait videos that we collected as a part of our evaluation process. We evaluate FakeCatcher on several datasets, resulting with 96%, 94.65%, 91.50%, and 91.07% accuracies, on Face Forensics [2], Face Forensics++ [3], CelebDF [4], and on our new Deep Fakes Dataset respectively. In addition, our approach produces a significantly superior detection rate against baselines, and does not depend on the source, generator, or properties of the fake content. We also analyze signals from various facial regions, under image distortions, with varying segment durations, from different generators, against unseen datasets, and under several dimensionality reduction techniques.

Detection of fake-video uploaders on social media using Naive Bayesian model with social cues

A CNN-based misleading video detection model

FakeSV: A Multimodal Benchmark with Rich Social Context for Fake News Detection on Short Video Platforms

FakingRecipe: Detecting Fake News on Short Video Platforms from the Perspective of Creative Process

Misinformation Detection in Social Media Video Posts

Fake News Detection in Large-Scale Social Network with Generalized Bayesian Classification

VMID: A Multimodal Fusion LLM Framework for Detecting and Identifying Misinformation of Short Videos

Fake and propaganda images detection using automated adaptive gaining sharing knowledge algorithm with DenseNet121

Health-Related Spammer Detection on Chinese Social Media.

FakeCatcher: Detection of Synthetic Portrait Videos using Biological Signals

Deep Learning Approach to Detect Fake Video on Raspberry PI

A Systematic Review of Machine Learning Approaches for Detecting Deceptive Activities on Social Media: Methods, Challenges, and Biases

CSI: A Hybrid Deep Model for Fake News Detection

An Optimized Hybrid Deep Learning Model to Detect COVID-19 Misleading Information

A Joint Fake News Detection Model based on Multi-Features

Fake or not? Automated detection of COVID-19 misinformation and disinformation in social networks and digital media

An Effective Fake News Detection on Social Media and Online News Portal by Using Machine Learning

False Information Detection on Social Media via a Hybrid Deep Model

Video Detection Method Based on Temporal and Spatial Foundations for Accurate Verification of Authenticity

Collaborative Mixture-of-Experts Model for Multi-Domain Fake News Detection

Distinguish Any Fake Videos: Unleashing the Power of Large-scale Data and Motion Features