Abstract:In recent years, social media has increasingly become one of the popular ways for people to consume news. As proliferation of fake news on social media has the negative impacts on individuals and society, automatic fake news detection has been explored by different research communities for combating fake news. With the development of multimedia technology, there is a phenomenon that cannot be ignored is that more and more social media news contains information with different modalities, e.g., texts, pictures and videos. The multiple information modalities show more evidence of the happening of news events and present new opportunities to detect features in fake news. First, for multimodal fake news detection task, it is a challenge of keeping the unique properties for each modality while fusing the relevant information between different modalities. Second, for some news, the information fusion between different modalities may produce the noise information which affects model's performance. Unfortunately, existing methods fail to handle these challenges. To address these problems, we propose a multimodal fake news detection framework based on Crossmodal Attention Residual and Multichannel convolutional neural Networks (CARMN). The Crossmodal Attention Residual Network (CARN) can selectively extract the relevant information related to a target modality from another source modality while maintaining the unique information of the target modality. The Multichannel Convolutional neural Network (MCN) can mitigate the influence of noise information which may be generated by crossmodal fusion component by extracting textual feature representation from original and fused textual information simultaneously. We conduct extensive experiments on four real-world datasets and demonstrate that the proposed model outperforms the state-of-the-art methods and learns more discriminable feature representations.

Multimodal Fake News Detection Through Data Augmentation-Based Contrastive Learning

A Self-Learning Multimodal Approach for Fake News Detection

TLFND: A Multimodal Fusion Model Based on Three-Level Feature Matching Distance for Fake News Detection

Cross-modal Contrastive Learning for Multimodal Fake News Detection

Multi-Level Multi-Modal Cross-Attention Network for Fake News Detection

Multimodal Social Media Fake News Detection Based on 1D-CCNet Attention Mechanism

Fake News Detection Based on Text-Modal Dominance and Fusing Multiple Multi-Model Clues

Improving Generalization for Multimodal Fake News Detection

Text-image multimodal fusion model for enhanced fake news detection

Few-Shot Learning for Misinformation Detection Based on Contrastive Models

Supervised Contrastive Learning for Multimodal Unreliable News Detection in COVID-19 Pandemic

Cross-Modal Augmentation for Few-Shot Multimodal Fake News Detection

LLM-Enhanced multimodal detection of fake news

Modality Perception Learning-Based Determinative Factor Discovery for Multimodal Fake News Detection

Multimodal Short Video Rumor Detection System Based on Contrastive Learning

Ensemble Techniques for Robust Fake News Detection: Integrating Transformers, Natural Language Processing, and Machine Learning

Semantic‐enhanced multimodal fusion network for fake news detection

Multi-modal Fake News Detection on Social Media via Multi-grained Information Fusion

Cross-modal Ambiguity Learning for Multimodal Fake News Detection

Multi-modality frequency-aware cross attention network for fake news detection

A multimodal fake news detection model based on crossmodal attention residual and multichannel convolutional neural networks