FakingRecipe: Detecting Fake News on Short Video Platforms from the Perspective of Creative Process

Yuyan Bu,Qiang Sheng,Juan Cao,Peng Qi,Danding Wang,Jintao Li
2024-07-24
Abstract:As short-form video-sharing platforms become a significant channel for news consumption, fake news in short videos has emerged as a serious threat in the online information ecosystem, making developing detection methods for this new scenario an urgent need. Compared with that in text and image formats, fake news on short video platforms contains rich but heterogeneous information in various modalities, posing a challenge to effective feature utilization. Unlike existing works mostly focusing on analyzing what is presented, we introduce a novel perspective that considers how it might be created. Through the lens of the creative process behind news video production, our empirical analysis uncovers the unique characteristics of fake news videos in material selection and editing. Based on the obtained insights, we design FakingRecipe, a creative process-aware model for detecting fake news short videos. It captures the fake news preferences in material selection from sentimental and semantic aspects and considers the traits of material editing from spatial and temporal aspects. To improve evaluation comprehensiveness, we first construct FakeTT, an English dataset for this task, and conduct experiments on both FakeTT and the existing Chinese FakeSV dataset. The results show FakingRecipe's superiority in detecting fake news on short video platforms.
Computer Vision and Pattern Recognition,Computers and Society,Multimedia
What problem does this paper attempt to address?
### Problems the Paper Aims to Solve This paper aims to address the issue of fake news detection on short video platforms. With the increasing popularity of short video sharing platforms (such as Douyin) on mobile internet, the way people access news has undergone a revolutionary change. According to data from the Pew Research Center, by 2023, 33% of adults in the United States have used TikTok, with nearly 43% of users frequently obtaining news from the platform. However, this trend has also facilitated the emergence and spread of fake news videos, posing new threats to the online information ecosystem. Therefore, it has become urgent to develop methods specifically tailored for detecting fake news in short videos. Unlike fake news in text or image formats, fake news on short video platforms has unique characteristics and is increasingly difficult to distinguish between true and false, presenting new challenges for effective detection methods. Most existing fake news video detection methods borrow from research ideas based on text-image detection, primarily focusing on analyzing the authenticity of multimodal content (such as detecting deepfakes) and modeling cross-modal correlations. These methods are more easily misled by edited and repurposed content. Given the increasingly blurred boundaries between true and false, it is necessary to seek new perspectives to capture more effective clues for fake news video detection. The paper proposes a new perspective, analyzing how fake news videos are created. This idea is based on a simple assumption: fake news creators on short video platforms usually lack firsthand authentic news materials and professional editing skills but intentionally produce fake news for specific purposes. In this case, fake news videos may leave some unique features. By capturing more valuable clues from the creation process, the effectiveness of fake news video detection can be improved. ### Research Methods The paper first empirically verifies the effectiveness of clues from the creation process perspective in distinguishing between true and false news videos and designs a dual-branch network model named FakingRecipe, which extracts features from the material selection and editing stages. Ultimately, experimental results show that FakingRecipe outperforms existing methods in detecting fake news on short video platforms. Additionally, the paper constructs an English dataset called FakeTT to support further research.