Abstract:In recent years, social media has increasingly become one of the popular ways for people to consume news. As proliferation of fake news on social media has the negative impacts on individuals and society, automatic fake news detection has been explored by different research communities for combating fake news. With the development of multimedia technology, there is a phenomenon that cannot be ignored is that more and more social media news contains information with different modalities, e.g., texts, pictures and videos. The multiple information modalities show more evidence of the happening of news events and present new opportunities to detect features in fake news. First, for multimodal fake news detection task, it is a challenge of keeping the unique properties for each modality while fusing the relevant information between different modalities. Second, for some news, the information fusion between different modalities may produce the noise information which affects model's performance. Unfortunately, existing methods fail to handle these challenges. To address these problems, we propose a multimodal fake news detection framework based on Crossmodal Attention Residual and Multichannel convolutional neural Networks (CARMN). The Crossmodal Attention Residual Network (CARN) can selectively extract the relevant information related to a target modality from another source modality while maintaining the unique information of the target modality. The Multichannel Convolutional neural Network (MCN) can mitigate the influence of noise information which may be generated by crossmodal fusion component by extracting textual feature representation from original and fused textual information simultaneously. We conduct extensive experiments on four real-world datasets and demonstrate that the proposed model outperforms the state-of-the-art methods and learns more discriminable feature representations.

Human Cognition-based Consistency Inference Networks for Multi-modal Fake News Detection

Cross-modal Consistency Learning with Fine-grained Fusion Network for Multimodal Fake News Detection

Adaptive Learning of Consistency and Inconsistency Information for Fake News Detection

Natural Language-centered Inference Network for Multi-modal Fake News Detection

See How You Read? Multi-Reading Habits Fusion Reasoning for Multi-Modal Fake News Detection

BC-FND: An Approach Based on Hierarchical Bilinear Fusion and Multimodal Consistency for Fake News Detection

Hierarchical Semantic Enhancement Network for Multimodal Fake News Detection

Multi-Level Multi-Modal Cross-Attention Network for Fake News Detection

Multi-modality frequency-aware cross attention network for fake news detection

CAF-ODNN: Complementary attention fusion with optimized deep neural network for multimodal fake news detection

Inconsistent Matters: A Knowledge-guided Dual-consistency Network for Multi-modal Rumor Detection

Multimodal Social Media Fake News Detection Based on 1D-CCNet Attention Mechanism

Cross-modal Contrastive Learning for Multimodal Fake News Detection

Collaborative Mixture-of-Experts Model for Multi-Domain Fake News Detection

Adaptive Interaction Fusion Networks for Fake News Detection

Fake News Detection Based on Text-Modal Dominance and Fusing Multiple Multi-Model Clues

Semantic‐enhanced multimodal fusion network for fake news detection

Multimodal fake news detection via progressive fusion networks

Multi-modal Fake News Detection on Social Media via Multi-grained Information Fusion

A multimodal fake news detection model based on crossmodal attention residual and multichannel convolutional neural networks

Entity-Oriented Multi-Modal Alignment and Fusion Network for Fake News Detection