What's in a spot?

T. Houseal,K. Klinger

DOI: https://doi.org/10.1093/HMG/3.8.1215

IF: 5.1214

1994-08-01

Human Molecular Genetics

Abstract:

What problem does this paper attempt to address?

Real‐time object‐removal tampering localization in surveillance videos by employing YOLO‐V8

Sandhya,Abhishek Kashyap

DOI: https://doi.org/10.1111/1556-4029.15516

2024-04-06

Journal of Forensic Sciences

Abstract:Videos are considered as most trustworthy means of communication in the present digital era. The advancement in multimedia technology has made video content sharing and manipulation very easy. Hence, the video authenticity is a challenging task for the research community. Video forensics refer to uncovering the forgery traces. The detection of spatiotemporal object‐removal forgery in surveillance videos is crucial for judicial forensics, as the presence of objects in the video has significant information as legal evidence. The author proposes a passive max–median averaging motion residual algorithm for revealing the forgery traces, successfully giving visible object‐removal traces followed by a deep learning approach, YOLO‐V8, for forged region localization. YOLO‐V8 is the latest deep learning model, which has a wide scope for real‐time application. The proposed method utilizes YOLO‐V8 for object‐removal forgery in surveillance videos. The network is trained on the SYSU‐OBJFORG dataset for object‐removal forged region localization in videos. The fine‐tuned YOLO‐V8 successfully classifies and localizes the object‐removal tampered region with an F1‐score of 0.99 and a precision of 0.99. The observed high confidence score of the bounding box around the forged region makes the model reliable. This fine‐tuned YOLO‐V8 would be a better choice in real‐time applications as it solves the complex object‐based forgery detection in videos. The performance of the proposed system is far better than the existing deep learning approach.

medicine, legal
VFDHSOG: Copy-Move Video Forgery Detection Using Histogram of Second Order Gradients

Punam Sunil Raskar,Sanjeevani Kiran Shah

DOI: https://doi.org/10.1007/s11277-021-08964-5

IF: 2.017

2021-08-25

Wireless Personal Communications

Abstract:It is a generic belief that digital video can be proffered as visual evidence in areas like politics, criminal litigation, journalism and military intelligence services. Multicamera smartphones with megapixels of resolution are a common hand-held device used by everyone. This has made the task of video recording very easy. At the same time a variety of applications available on smart phones have made this indispensable source of information vulnerable to deliberate manipulations. Hence, content authentication of video evidence becomes essential. Copy-move forgery or Copy-paste forgery is consequential forgery done by forgers for changing the basic understanding of the scene. Removal or addition of frames in a video clip can also be managed by advanced apps on smartphones. In case of surveillance, the video camera and the background are stable which makes forgery easy and imperceptible. Therefore, accurate Video forgery detection is crucial. This paper proposes an efficient method—VFDHSOG based on Histograms of the second order gradient to locate ‘suspicious’ frames and then localize the CMF within the frame. A ‘suspicious’ frame is located by computing correlation coefficients of the HSOG feature after obtaining a binary image of a frame. Performance evaluation is done using the benchmark datasets Surrey university library for forensic analysis (SULFA), the Video tampering dataset (VTD) and SYSU-OBJFORGED dataset. SULFA has video files of different quality like q10, q20 etc., which represents high compression. The VTD dataset provides both, i.e. inter and intra frame forgery. The SYSU dataset covers different attacks like scaling and rotation. An overall accuracy of 92.26% is achieved with the capability to identify attacks like scale up/down and rotation.

telecommunications
YOLO-FORGERY: Forgery Detection in images via Deep Clifford gradient-based YOLOv4 Network

Litty Koshy,S. PraylaShyry

DOI: https://doi.org/10.1007/s11760-023-02854-y

IF: 1.583

2024-01-20

Signal Image and Video Processing

Abstract:Image forgery identification is the technique of analysing and spotting any unauthorised or fraudulent adjustment in digital images. Digital images are easily altered due to advances in image processing technology and the widespread use of modern cameras. Object insertion forgery detection is complex due to the need to identify seamlessly integrated objects that might not exhibit visual anomalies to the naked eye. However, forgeries are often employed for expressive or amusement purposes with good intentions but can be misused when certain circumstances arise. The primary challenge of this research is to accurately detect object insertion forgery within images. The objective is to develop a forgery detection system that effectively utilises the capabilities of neural networks for object detection to identify instances of object insertion forgery in images. In this work, a novel deep learning-based YOLO-Forgery model has been proposed for Object insertion forgery detection in images. The input images are fed into the RGB to YUV conversion to enhance the images. Then, the pre-processed images are given as the input to the Clifford gradient technique for feature extraction. The extracted features are concatenated and fed into the deep learning-based YOLOv4 network to identify the forgery region in the images with the bounding boxes. The proposed YOLO-Forgery is accomplished with an average classification accuracy of 99.41%.

engineering, electrical & electronic,imaging science & photographic technology
Detecting video forgery: A machine learning approach for consistency analysis of video frames

Raksha Pandey,Alok Kumar Singh Kushwaha,Vinay Kumar

DOI: https://doi.org/10.3233/jifs-235818

2024-01-24

Journal of Intelligent & Fuzzy Systems

Abstract:Video forgery, a prevalent concern in today's digital age, involves the deliberate manipulation of video content, often carried out using sophisticated video editing software. In response to this challenge, the need for an automated approach to detect forged video footage has become increasingly pressing. Our proposed methodology addresses this need by employing a multi-faceted strategy. It begins with the classification of video frames as either originating from genuine sources or having undergone manipulation. To assess the authenticity, the Δ r ̄ s metric is applied to evaluate the coherence of frame sequences. Additionally, we've harnessed the power of machine learning, training a model on a diverse dataset, namely the VIFFD dataset. This robust machine learning approach, particularly the suggested Support Vector Machine (SVM) method, consistently achieves an impressive average accuracy of 94.4%, showcasing its potential as a dependable and effective solution for video forgery detection. In an era where the trustworthiness of video content is of paramount importance, our method emerges as a pivotal safeguard, contributing significantly to the preservation of the integrity and credibility of visual media.
Real-Time Video Forgery Detection Via Vision-WiFi Silhouette Correspondence

Jianwei Liu,Xinyue Fang,Yike Chen,Jiantao Yuan,Guanding Yu,Jinsong Han

DOI: https://doi.org/10.1109/tmc.2024.3483550

IF: 6.075

2024-01-01

IEEE Transactions on Mobile Computing

Abstract:For safety guard and crime prevention, video surveillance systems have been pervasively deployed in many security-critical scenarios, such as the residence, retail stores, and banks. However, these systems could be infiltrated by the adversary and the video streams would be modified or replaced, i.e., under the video forgery attack. The prevalence of Internet of Things (IoT) devices and the emergence of Deepfake- like techniques severely emphasize the vulnerability of video surveillance systems under such attacks. To secure existing surveillance systems, in this paper we propose a vision-WiFi cross-modal video forgery detection system, namely WiSil . Leveraging a theoretical model based on the principle of signal propagation, WiSil constructs wave front information of the object in the monitoring area from WiFi signals. With a well-designed deep learning network, WiSil further recovers silhouettes from the wave front information. Based on a Siamese network-based semantic feature extractor, WiSil can eventually determine whether a frame is manipulated by comparing the semantic feature vectors extracted from the video's silhouette with those extracted from the WiFi's silhouette. We enhance the basic version of WiSil [1] by developing a model compression method and a forgery trace localization method. Extensive experiments show that WiSil achieves 95%+ accuracy in detecting tampered frames.
Video forgery detection and localization using optimized attention squeezenet adversarial network

C. H. Lakshmi Kumari,K. V. Prasad

DOI: https://doi.org/10.1007/s11042-024-18774-z

IF: 2.577

2024-03-21

Multimedia Tools and Applications

Abstract:Video forgery (VF) is manipulating fake videos by modifying, coordinating or generating new content in the video sequence. The generated fake videos pose a great threat to social stability, enhancing the necessity to introduce fast, efficient video forgery identification techniques. Many existing studies reported effective techniques to detect forged videos at minimal complexity. However, existing techniques failed to obtain global assessments of the entire video frames and are less robust against fast-moving objects. Thus, this article proposes a novel optimized trident encoder-decoder network with adaptive deep learning models for detecting and localizing video forgeries. Initially, the input videos are converted into multiple frames and forwarded to the encoder part of the detection network. In this encoder part, an Attention SqueezeNet (AttSNet) is proposed for obtaining three branches of frames: pristine, forgery and both (pristine and forgery). Then, the bi-directional long short-term memory (Bi-LSTM) model is introduced in the decoder part to accurately detect the presence/absence of forgery from the given video frames. After detection, the forged region is analyzed by proposing a novel Adaptive ResNet (A-ResNet) with a generative adversarial network (GAN) model in the localization process. Here, the features from forgery-detected video frames are extracted by employing A-ResNet and the forged regions are localized effectively by the GAN method. In addition, this study proposes a hybridized wild-hunt (WiH) optimizer technique to update the weight parameters of the proposed model. The proposed method is implemented in the Python platform, and the whole experiment is processed with a face forensic database. In the experimental section, the accuracy of 95.4% and 96.1% and the time complexity of 1.43 s are obtained for detection and localization, respectively.

computer science, information systems, theory & methods,engineering, electrical & electronic, software engineering
An efficient model for copy-move image forgery detection

Kha-Tu Huynh,Tu-Nga Ly,Thuong Le-Tien

DOI: https://doi.org/10.1108/ijwis-04-2022-0088

2022-08-04

International Journal of Web Information Systems

Abstract:Purpose This study aims to solve problems of detecting copy-move images. With input images, the problem aims to: Confirm the original or forgery of the images, evaluate the performance of the detection and compare the proposed method's effectiveness to the related ones. Design/methodology/approach This paper proposes an algorithm to identify copy-move images by matching the characteristics of objects in the same group. The method is carried out through two stages of grouping the objects and comparing objects' features. The classification and clustering can improve processing time by skipping groups of only one object, and feature comparison on objects in the same group improves accuracy of the detection. YOLO5, the latest version of you only look once (YOLO) developed by Ultralytics LLC, and K-means are applied to classify and group the objects in the first stage. Then, modified Zernike moments (MZMs) and correlation coefficients are used for the features extraction and matching in the second stage. The Open Images V6 data set is used to train the YOLO5 model. The combination of YOLO5 and MZM makes the effectiveness of the proposed method for copy-move image detection with an average accuracy of 94.26% for images of benchmark and MICC-F600 and 95.37% for natural images. The outstanding feature of the method is that it can balance both processing time and accuracy in detecting duplicate regions on the image. Findings The problem is then solved by doing the following steps: Build a method to detect objects and compare their features to find the similarity if they are copy-move objects; use YOLO5 for the object detection and group the same category objects; ignore the group having only one object and extract the features of the other groups by MZMs; detect copy-move regions using K-means clustering; and calculate and compare the detection accuracy of the proposed method and related methods. Originality/value The main contributions of this paper include: Reduce the processing time by using YOLO5 in objects detection and K-means in clustering; improve the accuracy by using MZM to extract features and correlation coefficients to matching them; and implement and prove the effectiveness of the proposed method for three copy-move data sets: benchmark, MICC-F600 and author-built images.

English Else
A fast forgery frame detection method for video copy-move inter/intra-frame identification

Jun-Liu Zhong,Yan-Fen Gan,Ji-Xiang Yang

DOI: https://doi.org/10.1007/s12652-021-03386-4

IF: 3.662

2021-07-20

Journal of Ambient Intelligence and Humanized Computing

Abstract:Digital video is critical visual evidence in various fields and is easily manipulated under different techniques such as the popular video copy-move forgery. In the past decades, although machine intelligence has been widely adopted to detect the forgery in digital images automatically, It still remains a very challenging detection task for carefully-crafted copy-move forgery in digital video for three reasons: (i) A video of medium length containing hundreds of frames already incurs a prohibitive computational cost; (ii) Similar backgrounds in contiguous frames are easily mistakenly detected as copy-move forgery regions, resulting to a large number of false alarms; (iii) Most state-of-the-art methods cannot detect video copy-move inter-frame or intra-frame forgeries; To effectively address these issues, a fast forgery frame detection method for video copy-move inter/intra-frame identification is proposed: (i) The sparse feature extraction and matching speed-up the algorithm processing and reduce the time cost greatly (Defect (i)); (ii) The adaptive two-pass filtering and copy-move frame-pair matching can address the similarity problem (Defect (ii)) to locate truly forgery frame-pairs (FFP); (iii) Based on the results of these FFP, the type of video copy-move forgery detection can be identified (Defect (iii)). Furthermore, the copy-move frame-pair matching algorithm locates truly FFP, thus further reducing the computation cost and false alarm for detecting the inter/intra-frame forgery efficiently and effectively (Defect (i)). Finally, based on the truly FFP, the video can be checked for forgery or original. If there is no truly FFP, the video is considered as the original one. Otherwise, the video is checked if the forgery is inter-frame (i.e., truly FFP frames are two different frames) or intra-frame (the same frame). The experimental results show that our proposed algorithm achieves higher detection accuracy and higher robustness (false alarm = 2 and F1 = 0.90) in the whole GRIP dataset than the existing state-of-the-art methods under various adverse conditions.

computer science, information systems,telecommunications, artificial intelligence
Deep Convolutional Neural Network for Robust Detection of Object-Based Forgeries in Advanced Video

Ahmad A. Mazhar,Abid Jameel,Mohammad Nadeem,Mohammad Asmatullah Khan,Jawad Hasan Alkhateeb,Faiza Bibi,Ali Mohammad Seerat

DOI: https://doi.org/10.1109/access.2024.3357395

IF: 3.9

2024-02-13

IEEE Access

Abstract:Video forgery detection is a critical aspect of digital forensics, addressing the challenges posed by the manipulation of video content. This paper presents a novel approach for video forgery detection using Deep Convolutional Neural Networks (DCNN). Leveraging the power of deep learning, our method aims to improve the accuracy and efficiency of object-based forgery detection in advanced video sequences. In the proposed approach, we build upon the foundation of an existing method, which utilizes Convolutional Neural Networks, and introduce innovative modifications to the DCNN architecture. These modifications include data preprocessing, network architecture, and training strategies that enhance the model's ability to detect tampered objects in video frames. We conduct experiments on the SYSU-OBJFORG dataset, the largest object-based forged video dataset to date, with advanced video encoding standards. Our DCNN-based approach is compared with the existing method, demonstrating superior performance. The results show increased accuracy and robustness in detecting object-based video forgery. This paper not only contributes to the field of video forgery detection but also underscores the potential of deep learning, particularly DCNN, in addressing the evolving challenges of digital video manipulation. The findings open avenues for future research in the localization of forged regions and the application of DCNN in lower bitrate or lower resolution video sequences.

computer science, information systems,telecommunications,engineering, electrical & electronic
A Light Weight Depthwise Separable Layer Optimized CNN Architecture for Object-Based Forgery Detection in Surveillance Videos

Sandhya,Abhishek Kashyap

DOI: https://doi.org/10.1093/comjnl/bxae005

2024-02-11

The Computer Journal

Abstract:Abstract The present era is at the peak of technological advancement in image and video processing techniques, with user-friendly accessible tools/techniques. This immersive technology development makes video forensics enormously challenging. Specifically, the passive approaches to object-based forgeries in videos are crucial for legal and judicial matters. Hence, to ensure the integrity of the videos, a scientific, statistical and passive investigation of videos is required to maintain the spatial and temporal information content. This paper aims to develop a passive approach for digging out the forgery traces by applying the motion residue windowing technique for object removal forgery in surveillance videos. The novel max averaging windowing techniques improve visual imprints of the object removal forgery in the videos from the existing methods in the literature. A deep learning approach is the next step for achieving forgery detection in surveillance videos. The proposed lightweight depth-separable layer-optimized CNN has fast execution speed, optimized in terms of parameters without compromising the desired accuracy. This network is trained at a frame level with 98.60% testing accuracy, followed by a pipeline architecture of the proposed model for detection of forgery at video level with 99.01% accuracy. The suggested model works better than current models regarding post-processing operations, compression rates, forged video detection accuracy, precision, recall and F1 score.

computer science, information systems, theory & methods, software engineering, hardware & architecture
Inter-frame Passive-Blind Forgery Detection for Video Shot Based on Similarity Analysis

Dong-Ning Zhao,Ren-Kui Wang,Zhe-Ming Lu

DOI: https://doi.org/10.1007/s11042-018-5791-1

IF: 2.577

2018-01-01

Multimedia Tools and Applications

Abstract:Frame insertion, deletion and duplication are common inter-frame tampering operations in digital videos. In this paper, based on similarity analysis, a passive-blind forensics scheme for video shots is proposed to detect inter-frame forgeries. This method is composed of two parts: HSV (Hue-Saturation-Value) color histogram comparison and SURF (Speeded Up Robust Features) feature extraction together with FLANN (Fast Library for Approximate Nearest Neighbors) matching for double-checking. We mainly calculate H-S and S-V color histograms of every frame in a video shot and compare the similarity between histograms to detect and locate tampered frames in the shot. Then we utilize SURF feature extraction and FLANN matching to further confirm the forgery types in the tampered locations. Experimental results demonstrate that the proposed detection method is efficient and accurate in terms of forgery identification and localization. In contrast to other inter-frame forgery detection methods, our scheme can detect three kinds of forgery operations and has its own superiority and applicability as a passive-blind detection method.
Copy-Move Forgery Detection (CMFD) Using Deep Learning for Image and Video Forensics

Yohanna Rodriguez-Ortega,Dora M. Ballesteros,Diego Renza

DOI: https://doi.org/10.3390/jimaging7030059

2021-03-20

Journal of Imaging

Abstract:With the exponential growth of high-quality fake images in social networks and media, it is necessary to develop recognition algorithms for this type of content. One of the most common types of image and video editing consists of duplicating areas of the image, known as the copy-move technique. Traditional image processing approaches manually look for patterns related to the duplicated content, limiting their use in mass data classification. In contrast, approaches based on deep learning have shown better performance and promising results, but they present generalization problems with a high dependence on training data and the need for appropriate selection of hyperparameters. To overcome this, we propose two approaches that use deep learning, a model by a custom architecture and a model by transfer learning. In each case, the impact of the depth of the network is analyzed in terms of precision (P), recall (R) and F1 score. Additionally, the problem of generalization is addressed with images from eight different open access datasets. Finally, the models are compared in terms of evaluation metrics, and training and inference times. The model by transfer learning of VGG-16 achieves metrics about 10% higher than the model by a custom architecture, however, it requires approximately twice as much inference time as the latter.
Detection and localization of multiple inter-frame forgeries in digital videos

Shehnaz

DOI: https://doi.org/10.1007/s11042-024-18263-3

IF: 2.577

2024-02-08

Multimedia Tools and Applications

Abstract:Sanctity and integrity of digital videos are crucial for the diverse real-world applications. It has significant social and legal implications. The technological advancements are posing new challenges as the video processing software that are typically designed to enhance the visual content, can adversely spawn unauthentic and malicious data that can be potentially hazardous. Robust algorithms are therefore needed to counter the deleterious effects. In this paper, we propose a passive-blind approach to detect and localize multiple kinds of inter-frame forgeries in digital videos like frame insertion, deletion and duplication. The forensic artefacts are designed based on correlation inconsistencies between the histogram-similarity patterns of the adjacent texture-feature encoded video frames. For the empirical evaluation, the algorithm uses texture features such as Histogram of Oriented Gradients (HoG), uniform and rotation invariant Local Binary Pattern (LBP). A customized dataset of 1370 tampered videos is created using the benchmark SULFA dataset due to lack of standard video dataset with inter-frame forgeries. A supervised SVM classifier is trained to detect video tampering where extensive analysis based on different histogram-similarity metrics is carried out with the proposed approach that exhibits an overall accuracy 99%. Further, the proposed method localizes the position of tampered frames in the video. It highlights forged frames using Chebyshev's inequality in case of frame insertion and deletion attacks. A comparative analysis with state-of-the-art methods is also presented that exhibits good efficacy of the proposed approach.

computer science, information systems, theory & methods,engineering, electrical & electronic, software engineering
Dual branch convolutional neural network for copy move forgery detection

Nidhi Goel,Samarjeet Kaur,Ruchika Bala

DOI: https://doi.org/10.1049/ipr2.12051

IF: 2.3

2020-12-24

IET Image Processing

Abstract:The advent of digital era has seen a rise in the cases of illegal copying, distribution and forging of images. Even the most secure data channels sometimes suffer to validate the integrity of images. Forgery of multimedia data is devastating in various important applications like defence and satellite. Increased illegal tampering of images has paved way for research in the area of digital forensics. Copy move forgery is one of the various tampering techniques which is used for manipulating an image's content. A deep learning–based passive Copy Move Forgery Detection algorithm is proposed that uses a novel dual branch convolutional neural network to classify images as original and forged. The dual branch convolutional neural network extracts multi‐scale features by employing different kernel sizes in each branch. Fusion of extracted multi‐scale features is then performed to achieve a good accuracy, precision and recall scores. Experiment analysis on MICC F‐2000 dataset has been performed under two different kernel size combinations. Extensive result analysis and comparative analysis proves the efficacy of proposed architecture over existing architecture in terms of performance scores, computation time, and complexity.

computer science, artificial intelligence,engineering, electrical & electronic,imaging science & photographic technology
Forgery detection of low quality deepfake videos

Muhammad Sohaib,Samabia Tehseen

DOI: https://doi.org/10.14311/nnw.2023.33.006

2023-01-01

Neural Network World

Abstract:The rapid growth of online media over different social media platforms or over the internet along with many benefits have some negative effects as well. Deep learning has many positive applications like medical, animations and cybersecurity etc. But over the past few years, it is observed that it is been used for negative aspects as well such as defaming, black-mailing and creating privacy concerns for the general public. Deepfake is common terminology used for facial forgery of a person in media like images or videos.The advancement in the forgery creation area have challenged the researchers to create and develop advance forgery detection systems capable to detect facial forgeries. Proposed forgery detection system works on the CNN-LSTM model in which we first extracted faces from the frames using MTCNN then performed spatial feature extraction using pretrained Xception network and then used LSTM for temporal feature extraction. At the end classification is performed to predict the video as real or fake. The system is capable to detect low quality videos. The current system has shown good accuracy results for detecting real or fake videos on the Google deepfake AI dataset.

computer science, artificial intelligence
Design of Automated Deep Learning-Based Fusion Model for Copy-Move Image Forgery Detection

N. Krishnaraj,B. Sivakumar,Ramya Kuppusamy,Yuvaraja Teekaraman,Amruth Ramesh Thelkar

DOI: https://doi.org/10.1155/2022/8501738

IF: 3.12

2022-01-31

Computational Intelligence and Neuroscience

Abstract:Due to the exponential growth of high-quality fake photos on social media and the Internet, it is critical to develop robust forgery detection tools. Traditional picture- and video-editing techniques include copying areas of the image, referred to as the copy-move approach. The standard image processing methods physically search for patterns relevant to the duplicated material, restricting the usage in enormous data categorization. On the contrary, while deep learning (DL) models have exhibited improved performance, they have significant generalization concerns because of their high reliance on training datasets and the requirement for good hyperparameter selection. With this in mind, this article provides an automated deep learning-based fusion model for detecting and localizing copy-move forgeries (DLFM-CMDFC). The proposed DLFM-CMDFC technique combines models of generative adversarial networks (GANs) and densely connected networks (DenseNets). The two outputs are combined in the DLFM-CMDFC technique to create a layer for encoding the input vectors with the initial layer of an extreme learning machine (ELM) classifier. Additionally, the ELM model’s weight and bias values are optimally adjusted using the artificial fish swarm algorithm (AFSA). The networks’ outputs are supplied into the merger unit as input. Finally, a faked image is used to identify the difference between the input and target areas. Two benchmark datasets are used to validate the proposed model’s performance. The experimental results established the proposed model’s superiority over recently developed approaches.

mathematical & computational biology,neurosciences
Unified Video and Image Representation for Boosted Video Face Forgery Detection

Haotian Liu,Chenhui Pan,Yang Liu,Guoying Zhao,Xiaobai Li

DOI: https://doi.org/10.3233/faia240548

2024-01-01

Abstract:Face forgery detection is crucial in preserving the security and integrity of facial data amidst the rapid developments in face manipulation techniques and deep generative models. Existing methods for video face forgery detection typically assume that all frames in a forged video are manipulated, while identifying partially forged videos with only a subset of altered frames is still a challenge to be solved. To address this issue, we propose a novel framework, i.e., the UVIF, that utilizes additional annotated images to provide fine-grained supervision for detecting partial forgeries in videos. The UVIF integrates a unified encoder and a multi-task learning paradigm to model both facial videos and images for boosted video face forgery detection. A 2D backbone with temporal fusion modules is employed for the unified encoder. A pseudo labeling process is also designed for facial video frames to bridge the representation of individual video frames and static images. Extensive experiments on benchmark datasets demonstrate the effectiveness of our framework, outperforming state-of-the-art methods in detecting partially forged videos while introducing no additional computational overhead. Our code is available at https://github.com/haotianll/UVIF.
Effective and efficient pixel-level detection for diverse video copy-move forgery types

Jun-Liu Zhong,Yan-Fen Gan,Chi-Man Vong,Ji-Xiang Yang,Jing-Hong Zhao,Jia-Hua Luo

DOI: https://doi.org/10.1016/j.patcog.2021.108286

IF: 8

2022-02-01

Pattern Recognition

Abstract:Video copy-move forgery detection (VCMFD) is a significant and greatly challenging task due to a variety of difficulties, including a huge amount of video information, diverse forgery types, rich forgery objects, and homogenous forgery sources. These difficulties raise four unresolved key challenges in VCMFD: i) ineffective detection in some popular forgery cases; ii) inefficient matching in processing numerous video pixels with hundred-dimensional features under dozens of matching iterations; iii) high false positive (FP) in detecting forgery videos; iv) low trade-off of efficiency and effectiveness in filling forgery region, and even failing in indicating forgeries at the pixel level. In this paper, a novel VCMFD method is proposed to address these issues: i) an innovatively improved SIFT structure that can address the thorough feature extraction in all video copy-move forgery cases; ii) a novel fast keypoint-label matching (FKLM) algorithm is proposed that creates some keypoint-label groups so that every high-dimensional feature is assigned into one of these groups. As a result, matching of video pixels can be directly done on a small number of keypoint-label groups only, leading to a nearly 500% raise in matching efficiency; iii) a new coarse-to-fine filtering relying on intrinsic attributes of exact keypoint-matches is designed to more effectively reduce the false keypoint-matches; iv) the adaptive block filling relying on true keypoint-matches contributes to the accurate and efficient suspicious region filling, even at the pixel level. Finally, the suspicious region locations with the forgery vision persistence concept indicate forgery videos. Compared to the state-of-art methods, the experiments show that our proposed method achieves the best detection accuracy, lowest FP, and improved at least 16% and 8% of F1 scores on the GRIP 2.0 dataset and a combination of SULFA 2.0 & REWIND datasets. Furthermore, the proposed method is with low computational time (4.45 s/Mpixels), which is about 1/2-1/3 times of the latest DFMI-BM (8.02 s/Mpixels) and PM-2D (13.1 s/Mpixels) methods.

computer science, artificial intelligence,engineering, electrical & electronic
Deepfake video detection: YOLO-Face convolution recurrent approach

Aya Ismail,Marwa Elpeltagy,Mervat Zaki,Kamal A. ElDahshan

DOI: https://doi.org/10.7717/peerj-cs.730

2021-09-21

PeerJ Computer Science

Abstract:Recently, the deepfake techniques for swapping faces have been spreading, allowing easy creation of hyper-realistic fake videos. Detecting the authenticity of a video has become increasingly critical because of the potential negative impact on the world. Here, a new project is introduced; You Only Look Once Convolution Recurrent Neural Networks (YOLO-CRNNs), to detect deepfake videos. The YOLO-Face detector detects face regions from each frame in the video, whereas a fine-tuned EfficientNet-B5 is used to extract the spatial features of these faces. These features are fed as a batch of input sequences into a Bidirectional Long Short-Term Memory (Bi-LSTM), to extract the temporal features. The new scheme is then evaluated on a new large-scale dataset; CelebDF-FaceForencics++ (c23), based on a combination of two popular datasets; FaceForencies++ (c23) and Celeb-DF. It achieves an Area Under the Receiver Operating Characteristic Curve (AUROC) 89.35% score, 89.38% accuracy, 83.15% recall, 85.55% precision, and 84.33% F1-measure for pasting data approach. The experimental analysis approves the superiority of the proposed method compared to the state-of-the-art methods.

computer science, information systems, artificial intelligence, theory & methods
A deep learning framework for copy-move forgery detection in digital images

Navneet Kaur,Neeru Jindal,Kulbir Singh

DOI: https://doi.org/10.1007/s11042-022-14016-2

IF: 2.577

2022-10-12

Multimedia Tools and Applications

Abstract:Digital images have become widespread in modern life, and they can be modified and produced using an inclusive range of software and hardware tools. Since, digital image forgery can be extremely damaging, thus, understanding the detection and classification of authentic and forged images is of great significance. Without diminishing the importance of other types of forgeries, copy-move forgery (CMF) can be considered among the most widely utilized forgeries because of its ease of implementation. Nowadays, deep learning-based approaches are considered up-to-date for the classification and detection of image forgery owing to their improved accuracy and automated feature extraction skills. A deep learning CMF detection framework is proposed in this paper, which classifies images as authentic or forged using a contrast-limited adaptive histogram equalization (CLAHE) and convolutional neural network (CNN). The CLAHE algorithm makes the hidden features of the image visible, as some of them are hard to detect in CMF. The effectiveness of proposed structure is appraised using benchmark datasets: GRIP, MICC-F2000, IMD and MICC-F220. In terms of various performance metrics, the experimental study demonstrates the effectiveness of the proposed approach among other approaches. Also, the robustness of the proposed technique is demonstrated against several geometrical attacks like scaling, noise addition, JPEG compression, and rotation.

computer science, information systems, theory & methods,engineering, electrical & electronic, software engineering

What's in a spot?

Real‐time object‐removal tampering localization in surveillance videos by employing YOLO‐V8

VFDHSOG: Copy-Move Video Forgery Detection Using Histogram of Second Order Gradients

YOLO-FORGERY: Forgery Detection in images via Deep Clifford gradient-based YOLOv4 Network

Detecting video forgery: A machine learning approach for consistency analysis of video frames

Real-Time Video Forgery Detection Via Vision-WiFi Silhouette Correspondence

Video forgery detection and localization using optimized attention squeezenet adversarial network

An efficient model for copy-move image forgery detection

A fast forgery frame detection method for video copy-move inter/intra-frame identification

Deep Convolutional Neural Network for Robust Detection of Object-Based Forgeries in Advanced Video

A Light Weight Depthwise Separable Layer Optimized CNN Architecture for Object-Based Forgery Detection in Surveillance Videos

Inter-frame Passive-Blind Forgery Detection for Video Shot Based on Similarity Analysis

Copy-Move Forgery Detection (CMFD) Using Deep Learning for Image and Video Forensics

Detection and localization of multiple inter-frame forgeries in digital videos

Dual branch convolutional neural network for copy move forgery detection

Forgery detection of low quality deepfake videos

Design of Automated Deep Learning-Based Fusion Model for Copy-Move Image Forgery Detection

Unified Video and Image Representation for Boosted Video Face Forgery Detection

Effective and efficient pixel-level detection for diverse video copy-move forgery types

Deepfake video detection: YOLO-Face convolution recurrent approach

A deep learning framework for copy-move forgery detection in digital images