Exploring varying color spaces through representative forgery learning to improve deepfake detection
Muhammad Ahmad Amin,Yongjian Hu,Yu Guan,Muhammad Zain Amin
DOI: https://doi.org/10.1016/j.dsp.2024.104426
IF: 2.92
2024-04-01
Digital Signal Processing
Abstract:In the digital age, the rise of deepfake technology has brought unprecedented challenges to multimedia content authentication. The existing deepfake detection methods generally perform well in known settings. However, generalization and robustness are still challenging tasks. Observing that most conventional methods adopt the RGB color space, we introduce a novel deepfake detection approach by utilizing multiple color spaces to enhance the identification of deepfakes. Overall, our proposed detection framework comprises two primary stages, i.e., representative forgery learning through multi-color space reasoning and the color spaces-based forgery detection network (FDN). The representative forgery learning task is realized in succession through the manipulation cue boosting network (MCBN), color space transformations, and the forgery highlighting network (FHN). MCBN improves the feature representation, alternate color spaces provide distinctive advantages over traditional RGB color space, while FHN plays an auxiliary role, where it not only mines the texture inconsistency but also points out high-level semantic forgery clues, aiding in the robustness ability of FDN to discern subtle alterations in digital imagery accurately. Through rigorous evaluation on the benchmark datasets, including the FaceForensics++, DFDC, and CelebDF datasets, our proposed approach exhibits promising results in identifying forged multimedia content across varying color representations, outperforming the state-of-the-art methods.
engineering, electrical & electronic