Quantum Fuzzy Neural Network for multimodal sentiment and sarcasm detection

Prayag Tiwari,Lailei Zhang,Zhiguo Qu,Ghulam Muhammad
DOI: https://doi.org/10.1016/j.inffus.2023.102085
IF: 18.6
2023-10-23
Information Fusion
Abstract:Sentiment and sarcasm detection in social media language contribute to judging social opinion trends. Over the years, most artificial intelligence (AI) methods have used real values to characterize the sentimental and sarcastic features in language. These methods overlook the complexity and uncertainty of sentimental and sarcastic elements in human language. Therefore, this paper proposes the Quantum Fuzzy Neural Network (QFNN), a multimodal fusion and multitask learning algorithm with a Seq2Seq structure that combines Classical and Quantum Neural Networks. QFNN integrates fuzzy logic and Quantum Neural Networks. Complex numbers are used for the Fuzzifier to capture sentiment and sarcasm features, and Quantum Neural Networks are used for the Defuzzifier to get the predicted results. The experiments were conducted on classical computers and constructed quantum circuits in a simulated noisy environment. The results show the performance of QFNN in sarcasm and sentiment detection outperforms RCNN-RoBERTa and UPB-MTL on the Mustard and Memotion datasets. Moreover, by detecting the fidelity of quantum circuits in a noisy environment, QFNN was found to have excellent robustness.
computer science, artificial intelligence, theory & methods
What problem does this paper attempt to address?