The Effect of External Ventricular Drain Use in Intracerebral Hemorrhage.

B. Lovasik,D. McCracken,Courtney E. McCracken,Margaret E. McDougal,Jason M Frerich,Owen B. Samuels,G. Pradilla

DOI: https://doi.org/10.1016/j.wneu.2016.07.022

IF: 2.21

2016-10-01

World Neurosurgery

Abstract:

What problem does this paper attempt to address?

Fighting Deepfake by Exposing the Convolutional Traces on Images

Luca Guarnera,Oliver Giudice,Sebastiano Battiato

DOI: https://doi.org/10.48550/arXiv.2008.04095

2020-08-07

Computer Vision and Pattern Recognition

Abstract:Advances in Artificial Intelligence and Image Processing are changing the way people interacts with digital images and video. Widespread mobile apps like FACEAPP make use of the most advanced Generative Adversarial Networks (GAN) to produce extreme transformations on human face photos such gender swap, aging, etc. The results are utterly realistic and extremely easy to be exploited even for non-experienced users. This kind of media object took the name of Deepfake and raised a new challenge in the multimedia forensics field: the Deepfake detection challenge. Indeed, discriminating a Deepfake from a real image could be a difficult task even for human eyes but recent works are trying to apply the same technology used for generating images for discriminating them with preliminary good results but with many limitations: employed Convolutional Neural Networks are not so robust, demonstrate to be specific to the context and tend to extract semantics from images. In this paper, a new approach aimed to extract a Deepfake fingerprint from images is proposed. The method is based on the Expectation-Maximization algorithm trained to detect and extract a fingerprint that represents the Convolutional Traces (CT) left by GANs during image generation. The CT demonstrates to have high discriminative power achieving better results than state-of-the-art in the Deepfake detection task also proving to be robust to different attacks. Achieving an overall classification accuracy of over 98%, considering Deepfakes from 10 different GAN architectures not only involved in images of faces, the CT demonstrates to be reliable and without any dependence on image semantic. Finally, tests carried out on Deepfakes generated by FACEAPP achieving 93% of accuracy in the fake detection task, demonstrated the effectiveness of the proposed technique on a real-case scenario.
Unmasking DeepFakes with simple Features

Ricard Durall,Margret Keuper,Franz-Josef Pfreundt,Janis Keuper

DOI: https://doi.org/10.48550/arXiv.1911.00686

IF: 5.414

2019-11-02

Machine Learning

Abstract:Deep generative models have recently achieved impressive results for many real-world applications, successfully generating high-resolution and diverse samples from complex datasets. Due to this improvement, fake digital contents have proliferated growing concern and spreading distrust in image content, leading to an urgent need for automated ways to detect these AI-generated fake images. Despite the fact that many face editing algorithms seem to produce realistic human faces, upon closer examination, they do exhibit artifacts in certain domains which are often hidden to the naked eye. In this work, we present a simple way to detect such fake face images - so-called DeepFakes. Our method is based on a classical frequency domain analysis followed by basic classifier. Compared to previous systems, which need to be fed with large amounts of labeled data, our approach showed very good results using only a few annotated training samples and even achieved good accuracies in fully unsupervised scenarios. For the evaluation on high resolution face images, we combined several public datasets of real and fake faces into a new benchmark: Faces-HQ. Given such high-resolution images, our approach reaches a perfect classification accuracy of 100% when it is trained on as little as 20 annotated samples. In a second experiment, in the evaluation of the medium-resolution images of the CelebA dataset, our method achieves 100% accuracy supervised and 96% in an unsupervised setting. Finally, evaluating a low-resolution video sequences of the FaceForensics++ dataset, our method achieves 91% accuracy detecting manipulated videos. Source Code: https://github.com/cc-hpc-itwm/DeepFakeDetection
Deepfake Media Forensics: State of the Art and Challenges Ahead

Irene Amerini,Mauro Barni,Sebastiano Battiato,Paolo Bestagini,Giulia Boato,Tania Sari Bonaventura,Vittoria Bruni,Roberto Caldelli,Francesco De Natale,Rocco De Nicola,Luca Guarnera,Sara Mandelli,Gian Luca Marcialis,Marco Micheletto,Andrea Montibeller,Giulia Orru',Alessandro Ortis,Pericle Perazzo,Giovanni Puglisi,Davide Salvi,Stefano Tubaro,Claudia Melis Tonti,Massimo Villari,Domenico Vitulano

2024-08-13

Abstract:AI-generated synthetic media, also called Deepfakes, have significantly influenced so many domains, from entertainment to cybersecurity. Generative Adversarial Networks (GANs) and Diffusion Models (DMs) are the main frameworks used to create Deepfakes, producing highly realistic yet fabricated content. While these technologies open up new creative possibilities, they also bring substantial ethical and security risks due to their potential misuse. The rise of such advanced media has led to the development of a cognitive bias known as Impostor Bias, where individuals doubt the authenticity of multimedia due to the awareness of AI's capabilities. As a result, Deepfake detection has become a vital area of research, focusing on identifying subtle inconsistencies and artifacts with machine learning techniques, especially Convolutional Neural Networks (CNNs). Research in forensic Deepfake technology encompasses five main areas: detection, attribution and recognition, passive authentication, detection in realistic scenarios, and active authentication. This paper reviews the primary algorithms that address these challenges, examining their advantages, limitations, and future prospects.

Computer Vision and Pattern Recognition
DeepFake Detection by Analyzing Convolutional Traces

Luca Guarnera,Oliver Giudice,Sebastiano Battiato

DOI: https://doi.org/10.48550/arXiv.2004.10448

2020-04-22

Abstract:The Deepfake phenomenon has become very popular nowadays thanks to the possibility to create incredibly realistic images using deep learning tools, based mainly on ad-hoc Generative Adversarial Networks (GAN). In this work we focus on the analysis of Deepfakes of human faces with the objective of creating a new detection method able to detect a forensics trace hidden in images: a sort of fingerprint left in the image generation process. The proposed technique, by means of an Expectation Maximization (EM) algorithm, extracts a set of local features specifically addressed to model the underlying convolutional generative process. Ad-hoc validation has been employed through experimental tests with naive classifiers on five different architectures (GDWCT, STARGAN, ATTGAN, STYLEGAN, STYLEGAN2) against the CELEBA dataset as ground-truth for non-fakes. Results demonstrated the effectiveness of the technique in distinguishing the different architectures and the corresponding generation process.

Computer Vision and Pattern Recognition
Deepfake video detection: challenges and opportunities

Achhardeep Kaur,Azadeh Noori Hoshyar,Vidya Saikrishna,Selena Firmin,Feng Xia

DOI: https://doi.org/10.1007/s10462-024-10810-6

IF: 9.588

2024-05-30

Artificial Intelligence Review

Abstract:Deepfake videos are a growing social issue. These videos are manipulated by artificial intelligence (AI) techniques (especially deep learning), an emerging societal issue. Malicious individuals misuse deepfake technologies to spread false information, such as fake images, videos, and audio. The development of convincing fake content threatens politics, security, and privacy. The majority of deepfake video detection methods are data-driven. This survey paper aims to thoroughly analyse deepfake video generation and detection. The paper's main contribution is the classification of the many challenges encountered while detecting deepfake videos. The paper discusses data challenges such as unbalanced datasets and inadequate labelled training data. Training challenges include the need for many computational resources. It also addresses reliability challenges, including overconfidence in detection methods and emerging manipulation approaches. The research emphasises the dominance of deep learning-based methods in detecting deepfakes despite their computational efficiency and generalisation limitations. However, it also acknowledges the drawbacks of these approaches, such as their limited computing efficiency and generalisation. The research also critically evaluates deepfake datasets, emphasising the necessity for good-quality datasets to improve detection methods. The study also indicates major research gaps, guiding future deepfake detection research. This entails developing robust models for real-time detection.

computer science, artificial intelligence
Combating deepfakes: a comprehensive multilayer deepfake video detection framework

Rathoure, Nikhil,Bharot, Nitesh,Verma, Priyanka

DOI: https://doi.org/10.1007/s11042-024-20012-5

IF: 2.577

2024-08-22

Multimedia Tools and Applications

Abstract:Deepfakes represent a class of synthetic media crafted with the aid of advanced deep learning techniques that exhibit an unparalleled degree of authenticity. The rapid advancement in Artificial Intelligence (AI) has contributed to an increase in the prevalence of deepfakes on the internet, consequently amplifying the spread of misinformation among the public. Consequently, the detection of deepfakes has become a pressing concern. In this context, we put forth a comprehensive framework for deepfake video detection, which is built upon three distinct layers. The first layer, termed as the RGB features extraction layer, is designed to identify potential signs of forgery within the spatial domain of analogous video frames. The second layer, known as the GAN features extraction layer, focuses on the extraction of forgery fingerprints in the high-frequency region. This layer is specifically engineered to detect the fingerprints left by the Generative Adversarial Network (GAN) process in fake videos and the traces of the imaging process in genuine videos. The third and final layer, referred to as the facial region intra-frame inconsistency feature extraction layer, is dedicated to uncovering the anomalies associated with the manipulation process. This is achieved by extracting features from both the inner and outer regions of the manipulated portion of a frame. The extensive experimental evaluations have underscored the superior performance of proposed approach in comparison to existing state-of-the-art methods.

computer science, information systems, theory & methods,engineering, electrical & electronic, software engineering
Deep learning model for deep fake face recognition and detection

Suganthi St,Mohamed Uvaze Ahamed Ayoobkhan,Krishna Kumar V,Nebojsa Bacanin,Venkatachalam K,Hubálovský Štěpán,Trojovský Pavel,Suganthi ST

DOI: https://doi.org/10.7717/peerj-cs.881

2022-02-22

PeerJ Computer Science

Abstract:Deep Learning is an effective technique and used in various fields of natural language processing, computer vision, image processing and machine vision. Deep fakes uses deep learning technique to synthesis and manipulate image of a person in which human beings cannot distinguish the fake one. By using generative adversarial neural networks (GAN) deep fakes are generated which may threaten the public. Detecting deep fake image content plays a vital role. Many research works have been done in detection of deep fakes in image manipulation. The main issues in the existing techniques are inaccurate, consumption time is high. In this work we implement detecting of deep fake face image analysis using deep learning technique of fisherface using Local Binary Pattern Histogram (FF-LBPH). Fisherface algorithm is used to recognize the face by reduction of the dimension in the face space using LBPH. Then apply DBN with RBM for deep fake detection classifier. The public data sets used in this work are FFHQ, 100K-Faces DFFD, CASIA-WebFace.

computer science, information systems, artificial intelligence, theory & methods
Deep Fake Detection: Survey of Facial Manipulation Detection Solutions

Samay Pashine,Sagar Mandiya,Praveen Gupta,Rashid Sheikh

DOI: https://doi.org/10.48550/arXiv.2106.12605

2021-06-23

Computer Vision and Pattern Recognition

Abstract:Deep Learning as a field has been successfully used to solve a plethora of complex problems, the likes of which we could not have imagined a few decades back. But as many benefits as it brings, there are still ways in which it can be used to bring harm to our society. Deep fakes have been proven to be one such problem, and now more than ever, when any individual can create a fake image or video simply using an application on the smartphone, there need to be some countermeasures, with which we can detect if the image or video is a fake or real and dispose of the problem threatening the trustworthiness of online information. Although the Deep fakes created by neural networks, may seem to be as real as a real image or video, it still leaves behind spatial and temporal traces or signatures after moderation, these signatures while being invisible to a human eye can be detected with the help of a neural network trained to specialize in Deep fake detection. In this paper, we analyze several such states of the art neural networks (MesoNet, ResNet-50, VGG-19, and Xception Net) and compare them against each other, to find an optimal solution for various scenarios like real-time deep fake detection to be deployed in online social media platforms where the classification should be made as fast as possible or for a small news agency where the classification need not be in real-time but requires utmost accuracy.
Mastering Deepfake Detection: A Cutting-Edge Approach to Distinguish GAN and Diffusion-Model Images

Luca Guarnera,Oliver Giudice,Sebastiano Battiato

DOI: https://doi.org/10.1145/3652027

2024-03-09

Abstract:Detecting and recognizing deepfakes is a pressing issue in the digital age. In this study, we first collected a dataset of pristine images and fake ones properly generated by nine different Generative Adversarial Network (GAN) architectures and four Diffusion Models (DM). The dataset contained a total of 83,000 images, with equal distribution between the real and deepfake data. Then, to address different deepfake detection and recognition tasks, we proposed a hierarchical multi-level approach. At the first level, we classified real images from AI-generated ones. At the second level, we distinguished between images generated by GANs and DMs. At the third level (composed of two additional sub-levels), we recognized the specific GAN and DM architectures used to generate the synthetic data. Experimental results demonstrated that our approach achieved more than 97% classification accuracy, outperforming existing state-of-the-art methods. The models obtained in the different levels turn out to be robust to various attacks such as JPEG compression (with different quality factor values) and resize (and others), demonstrating that the framework can be used and applied in real-world contexts (such as the analysis of multimedia data shared in the various social platforms) for support even in forensic investigations in order to counter the illicit use of these powerful and modern generative models. We are able to identify the specific GAN and DM architecture used to generate the image, which is critical in tracking down the source of the deepfake. Our hierarchical multi-level approach to deepfake detection and recognition shows promising results in identifying deepfakes allowing focus on underlying task by improving (about \(2\% \) on the average) standard multiclass flat detection systems. The proposed method has the potential to enhance the performance of deepfake detection systems, aid in the fight against the spread of fake images, and safeguard the authenticity of digital media.

computer science, information systems, theory & methods, software engineering
DeepFakes: a New Threat to Face Recognition? Assessment and Detection

Pavel Korshunov,Sebastien Marcel

DOI: https://doi.org/10.48550/arXiv.1812.08685

2018-12-21

Abstract:It is becoming increasingly easy to automatically replace a face of one person in a video with the face of another person by using a pre-trained generative adversarial network (GAN). Recent public scandals, e.g., the faces of celebrities being swapped onto pornographic videos, call for automated ways to detect these Deepfake videos. To help developing such methods, in this paper, we present the first publicly available set of Deepfake videos generated from videos of VidTIMIT database. We used open source software based on GANs to create the Deepfakes, and we emphasize that training and blending parameters can significantly impact the quality of the resulted videos. To demonstrate this impact, we generated videos with low and high visual quality (320 videos each) using differently tuned parameter sets. We showed that the state of the art face recognition systems based on VGG and Facenet neural networks are vulnerable to Deepfake videos, with 85.62% and 95.00% false acceptance rates respectively, which means methods for detecting Deepfake videos are necessary. By considering several baseline approaches, we found that audio-visual approach based on lip-sync inconsistency detection was not able to distinguish Deepfake videos. The best performing method, which is based on visual quality metrics and is often used in presentation attack detection domain, resulted in 8.97% equal error rate on high quality Deepfakes. Our experiments demonstrate that GAN-generated Deepfake videos are challenging for both face recognition systems and existing detection methods, and the further development of face swapping technology will make it even more so.

Computer Vision and Pattern Recognition
Deepfake detection in videos with multiple faces using geometric-fakeness features

Kirill Vyshegorodtsev,Dmitry Kudiyarov,Alexander Balashov,Alexander Kuzmin

2024-10-10

Abstract:Due to the development of facial manipulation techniques in recent years deepfake detection in video stream became an important problem for face biometrics, brand monitoring or online video conferencing solutions. In case of a biometric authentication, if you replace a real datastream with a deepfake, you can bypass a liveness detection system. Using a deepfake in a video conference, you can penetrate into a private meeting. Deepfakes of victims or public figures can also be used by fraudsters for blackmailing, extorsion and financial fraud. Therefore, the task of detecting deepfakes is relevant to ensuring privacy and security. In existing approaches to a deepfake detection their performance deteriorates when multiple faces are present in a video simultaneously or when there are other objects erroneously classified as faces. In our research we propose to use geometric-fakeness features (GFF) that characterize a dynamic degree of a face presence in a video and its per-frame deepfake scores. To analyze temporal inconsistencies in GFFs between the frames we train a complex deep learning model that outputs a final deepfake prediction. We employ our approach to analyze videos with multiple faces that are simultaneously present in a video. Such videos often occur in practice e.g., in an online video conference. In this case, real faces appearing in a frame together with a deepfake face will significantly affect a deepfake detection and our approach allows to counter this problem. Through extensive experiments we demonstrate that our approach outperforms current state-of-the-art methods on popular benchmark datasets such as FaceForensics++, DFDC, Celeb-DF and WildDeepFake. The proposed approach remains accurate when trained to detect multiple different deepfake generation techniques.

Computer Vision and Pattern Recognition,Cryptography and Security
Level Up the Deepfake Detection: a Method to Effectively Discriminate Images Generated by GAN Architectures and Diffusion Models

Luca Guarnera,Oliver Giudice,Sebastiano Battiato

2023-03-02

Abstract:The image deepfake detection task has been greatly addressed by the scientific community to discriminate real images from those generated by Artificial Intelligence (AI) models: a binary classification task. In this work, the deepfake detection and recognition task was investigated by collecting a dedicated dataset of pristine images and fake ones generated by 9 different Generative Adversarial Network (GAN) architectures and by 4 additional Diffusion Models (DM). A hierarchical multi-level approach was then introduced to solve three different deepfake detection and recognition tasks: (i) Real Vs AI generated; (ii) GANs Vs DMs; (iii) AI specific architecture recognition. Experimental results demonstrated, in each case, more than 97% classification accuracy, outperforming state-of-the-art methods.

Computer Vision and Pattern Recognition
Comparison of Deepfake Detection Techniques through Deep Learning

Maryam Taeb,Hongmei Chi

DOI: https://doi.org/10.3390/jcp2010007

2022-03-04

Journal of Cybersecurity and Privacy

Abstract:Deepfakes are realistic-looking fake media generated by deep-learning algorithms that iterate through large datasets until they have learned how to solve the given problem (i.e., swap faces or objects in video and digital content). The massive generation of such content and modification technologies is rapidly affecting the quality of public discourse and the safeguarding of human rights. Deepfakes are being widely used as a malicious source of misinformation in court that seek to sway a court’s decision. Because digital evidence is critical to the outcome of many legal cases, detecting deepfake media is extremely important and in high demand in digital forensics. As such, it is important to identify and build a classifier that can accurately distinguish between authentic and disguised media, especially in facial-recognition systems as it can be used in identity protection too. In this work, we compare the most common, state-of-the-art face-detection classifiers such as Custom CNN, VGG19, and DenseNet-121 using an augmented real and fake face-detection dataset. Data augmentation is used to boost performance and reduce computational resources. Our preliminary results indicate that VGG19 has the best performance and highest accuracy of 95% when compared with other analyzed models.
Multi-attentional Deepfake Detection

Hanqing Zhao,Tianyi Wei,Wenbo Zhou,Weiming Zhang,Dongdong Chen,Nenghai Yu

DOI: https://doi.org/10.1109/cvpr46437.2021.00222

2021-01-01

Computer Vision and Pattern Recognition

Abstract:Face forgery by deepfake is widely spread over the internet and has raised severe societal concerns. Recently, how to detect such forgery contents has become a hot research topic and many deepfake detection methods have been proposed. Most of them model deepfake detection as a vanilla binary classification problem, i.e, first use a backbone network to extract a global feature and then feed it into a binary classifier (real/fake). But since the difference between the real and fake images in this task is often subtle and local, we argue this vanilla solution is not optimal. In this paper, we instead formulate deepfake detection as a fine-grained classification problem and propose a new multi-attentional deepfake detection network. Specifically, it consists of three key components: 1) multiple spatial attention heads to make the network attend to different local parts; 2) textural feature enhancement block to zoom in the subtle artifacts in shallow features; 3) aggregate the low-level textural feature and high-level semantic features guided by the attention maps. Moreover, to address the learning difficulty of this network, we further introduce a new regional independence loss and an attention guided data augmentation strategy. Through extensive experiments on different datasets, we demonstrate the superiority of our method over the vanilla binary classifier counterparts, and achieve state-of-the-art performance. The models will be released recently at https://github.com/yoctta/multiple-attention.
An efficient deepfake video detection using robust deep learning

Abdul Qadir,Rabbia Mahum,Mohammed A El-Meligy,Adham E Ragab,Abdulmalik AlSalman,Muhammad Awais

DOI: https://doi.org/10.1016/j.heliyon.2024.e25757

IF: 3.776

2024-02-09

Heliyon

Abstract:The creation and manipulation of synthetic images have evolved rapidly, causing serious concerns about their effects on society. Although there have been various attempts to identify deep fake videos, these approaches are not universal. Identifying these misleading deepfakes is the first step in preventing them from spreading on social media sites. We introduce a unique deep-learning technique to identify fraudulent clips. Most deepfake identifiers currently focus on identifying face exchange, lip synchronous, expression modification, puppeteers, and other factors. However, exploring a consistent basis for all forms of fake videos and images in real-time forensics is challenging. We propose a hybrid technique that takes input from videos of successive targeted frames, then feeds these frames to the ResNet-Swish-BiLSTM, an optimized convolutional BiLSTM-based residual network for training and classification. This proposed method helps identify artifacts in deepfake images that do not seem real. To assess the robustness of our proposed model, we used the open deepfake detection challenge dataset (DFDC) and Face Forensics deepfake collections (FF++). We achieved 96.23% accuracy when using the FF++ digital record. In contrast, we attained 78.33% accuracy using the aggregated records from FF++ and DFDC. We performed extensive experiments and believe that our proposed method provides more significant results than existing techniques.
Face manipulated deepfake generation and recognition approaches: a survey

Mansi Rehaan,Nirmal Kaur,Staffy Kingra,Mansi RehaanNirmal KaurStaffy KingraUIET,Panjab University,Chandigarh,India

DOI: https://doi.org/10.1080/23080477.2023.2268380

2023-10-31

Smart Science

Abstract:With the progression of deep-learning techniques, digital media recording and synthesis media generation have become exceptionally easy. Due to open access of user-friendly deepfaking applications generated using Artificial Intelligence methods especially Generative Adversarial Networks (GANs) and Variational Auto-encoders (VAEs), synthesis of recorded media has been made more effortless. Digital media synthesized using such applications is termed as deepfake. Generation of realistic fake audio/video content poses critical threats to an individual and society at large. To curb the threat of deepfaking, numerous deepfake detection algorithms have been proposed. This paper presents a survey on state-of-the-art deepfake generation techniques, categorized into face swap, attribute manipulation, and lip-sync manipulation. An analysis of some recently developed techniques that can generate images from text is also presented in the proposed paper. In addition, state-of-art image and video datasets released in the domain of deepfake detection are also discussed. The analysis provided in this survey reveals that every new deepfake generation technique calls for the development of novel deepfake detection techniques. Among deepfake detection techniques proposed so far, MobileNet-CNN model, multi-scale temporal CNN model, and GAN-based technique outperform good for face swap, lip-syncing, and attribute manipulation detection with an accuracy of 99.28%, 97.1% ,and 100%, respectively. This survey would help researchers to understand the literature on deepfake generation and detection which is required for future development in this field.
Deepfake Generation and Detection: A Benchmark and Survey

Gan Pei,Jiangning Zhang,Menghan Hu,Zhenyu Zhang,Chengjie Wang,Yunsheng Wu,Guangtao Zhai,Jian Yang,Chunhua Shen,Dacheng Tao

2024-05-16

Abstract:Deepfake is a technology dedicated to creating highly realistic facial images and videos under specific conditions, which has significant application potential in fields such as entertainment, movie production, digital human creation, to name a few. With the advancements in deep learning, techniques primarily represented by Variational Autoencoders and Generative Adversarial Networks have achieved impressive generation results. More recently, the emergence of diffusion models with powerful generation capabilities has sparked a renewed wave of research. In addition to deepfake generation, corresponding detection technologies continuously evolve to regulate the potential misuse of deepfakes, such as for privacy invasion and phishing attacks. This survey comprehensively reviews the latest developments in deepfake generation and detection, summarizing and analyzing current state-of-the-arts in this rapidly evolving field. We first unify task definitions, comprehensively introduce datasets and metrics, and discuss developing technologies. Then, we discuss the development of several related sub-fields and focus on researching four representative deepfake fields: face swapping, face reenactment, talking face generation, and facial attribute editing, as well as forgery detection. Subsequently, we comprehensively benchmark representative methods on popular datasets for each field, fully evaluating the latest and influential published works. Finally, we analyze challenges and future research directions of the discussed fields.

Computer Vision and Pattern Recognition
SoK: Facial Deepfake Detectors

Binh M. Le,Jiwon Kim,Shahroz Tariq,Kristen Moore,Alsharif Abuadbba,Simon S. Woo

2024-06-25

Abstract:Deepfakes have rapidly emerged as a profound and serious threat to society, primarily due to their ease of creation and dissemination. This situation has triggered an accelerated development of deepfake detection technologies. However, many existing detectors rely heavily on lab-generated datasets for validation, which may not effectively prepare them for novel, emerging, and real-world deepfake techniques. In this paper, we conduct an extensive and comprehensive review and analysis of the latest state-of-the-art deepfake detectors, evaluating them against several critical criteria. These criteria facilitate the categorization of these detectors into 4 high-level groups and 13 fine-grained sub-groups, all aligned with a unified standard conceptual framework. This classification and framework offer deep and practical insights into the factors that affect detector efficacy. We assess the generalizability of 16 leading detectors across various standard attack scenarios, including black-box, white-box, and gray-box settings. Our systematized analysis and experimentation lay the groundwork for a deeper understanding of deepfake detectors and their generalizability, paving the way for future research focused on creating detectors adept at countering various attack scenarios. Additionally, this work offers insights for developing more proactive defenses against deepfakes.

Computer Vision and Pattern Recognition,Cryptography and Security,Machine Learning
A survey on face forgery detection of Deepfake

Ying Zhang,Feng Gao,Zichen Zhou,Hong Guo

DOI: https://doi.org/10.1117/12.2600889

2021-06-30

Abstract:With the development of internet technology, artificial intelligence shows its rapid growth in recent year as well. More and more people pay attention to this field, including criminals inevitably. It is noted that one technology called “Deepfake” appeared on the internet at the end of 2017. As the name suggests, it is a portmanteau of “deep learning” and “fake”. In essence, Deepfake is a deep-learning framework in the field of image composite and replacement, which swap faces in images or videos. However detection of face forgery is still in its early stages, due to its novelty and complexity. In this paper we will demonstrate some dataset for deepfake forensics firstly, and then describe various existing detection methods. Those methods are reviewed in two parts: detection based on frame sequences and detection based on single frame. The former is implemented by differences between frames including human features, optical flow, timeline and so on, while the latter is based on features of single frame including extracted features and fusion boundary. Various convolutional Neural Networks (abbreviated as CNN) will be illustrated in this paper. Accordingly, performances of above algorithms are likely to be demonstrated and compared, and a further explanation will be given regarding on their applicable dataset. Finally, further research of face forgery detection of deepfake including methods and applications will be discussed.
Deepfake detection by exploiting surface anomalies: the SurFake approach

Andrea Ciamarra,Roberto Caldelli,Federico Becattini,Lorenzo Seidenari,Alberto Del Bimbo

2024-04-17

Abstract:The ever-increasing use of synthetically generated content in different sectors of our everyday life, one for all media information, poses a strong need for deepfake detection tools in order to avoid the proliferation of altered messages. The process to identify manipulated content, in particular images and videos, is basically performed by looking for the presence of some inconsistencies and/or anomalies specifically due to the fake generation process. Different techniques exist in the scientific literature that exploit diverse ad-hoc features in order to highlight possible modifications. In this paper, we propose to investigate how deepfake creation can impact on the characteristics that the whole scene had at the time of the acquisition. In particular, when an image (video) is captured the overall geometry of the scene (e.g. surfaces) and the acquisition process (e.g. illumination) determine a univocal environment that is directly represented by the image pixel values; all these intrinsic relations are possibly changed by the deepfake generation process. By resorting to the analysis of the characteristics of the surfaces depicted in the image it is possible to obtain a descriptor usable to train a CNN for deepfake detection: we refer to such an approach as SurFake. Experimental results carried out on the FF++ dataset for different kinds of deepfake forgeries and diverse deep learning models confirm that such a feature can be adopted to discriminate between pristine and altered images; furthermore, experiments witness that it can also be combined with visual data to provide a certain improvement in terms of detection accuracy.

Computer Vision and Pattern Recognition

The Effect of External Ventricular Drain Use in Intracerebral Hemorrhage.

Fighting Deepfake by Exposing the Convolutional Traces on Images

Unmasking DeepFakes with simple Features

Deepfake Media Forensics: State of the Art and Challenges Ahead

DeepFake Detection by Analyzing Convolutional Traces

Deepfake video detection: challenges and opportunities

Combating deepfakes: a comprehensive multilayer deepfake video detection framework

Deep learning model for deep fake face recognition and detection

Deep Fake Detection: Survey of Facial Manipulation Detection Solutions

Mastering Deepfake Detection: A Cutting-Edge Approach to Distinguish GAN and Diffusion-Model Images

DeepFakes: a New Threat to Face Recognition? Assessment and Detection

Deepfake detection in videos with multiple faces using geometric-fakeness features

Level Up the Deepfake Detection: a Method to Effectively Discriminate Images Generated by GAN Architectures and Diffusion Models

Comparison of Deepfake Detection Techniques through Deep Learning

Multi-attentional Deepfake Detection

An efficient deepfake video detection using robust deep learning

Face manipulated deepfake generation and recognition approaches: a survey

Deepfake Generation and Detection: A Benchmark and Survey

SoK: Facial Deepfake Detectors

A survey on face forgery detection of Deepfake

Deepfake detection by exploiting surface anomalies: the SurFake approach