Multimodal dual emotion with fusion of visual sentiment for rumor detection
Ge Wang,Li Tan,Ziliang Shang,He Liu,Wang, Ge,Liu, He
DOI: https://doi.org/10.1007/s11042-023-16732-9
IF: 2.577
2023-09-14
Multimedia Tools and Applications
Abstract:In recent years, widely spreading rumors have brought devastating impacts on society, making rumor detection a significant challenge. Exsisting researches improves that image palys an important role in rumor detection. But they only pay attention to semantic features of images' content, while neglecting visual emotions. We propose a Multimodal Dual Emotion feature for rumor detection, which consists of publish visual emotion, publish textual emotion and social emotion. Our experiments proves that the image emotion improves the rumor detection efficiency. To the best of our knowledge, this is the first study which uses visual emotion in rumor detection. The proposed Multimodal Dual Emotion feature serves as a model plugin that can be seamlessly integrated with various rumor detection models, leading to performance enhancements.
computer science, information systems, theory & methods,engineering, electrical & electronic, software engineering