Emotion detection in psychological texts by fine-tuning BERT using emotion–cause pair extraction

Anshul Kumar,Ankit Kumar Jain
DOI: https://doi.org/10.1007/s10772-022-09982-9
2022-07-13
International Journal of Speech Technology
Abstract:The task of detecting and recognizing the state of emotion when dealing with textual data in the machine learning domain is not a straightforward path. Numerous techniques have emerged that help find patterns which exist when a particular type of emotion is present in the text. The techniques that apply for rule-based semantic analysis work on sentence-level for emotion detection, but the practical implementations of these methods are not feasible and do not produce satisfying results. On the other hand, clause-level detection of emotions and causes has gained significant attention due to its usage in real-world applications. As text data is now available in the psychological domain, Natural Language Processing (NLP) techniques are more effective. New technological advances are happening in deep learning-based pre-trained language models that need fine-tuning on small datasets, and one such model is BERT. In the proposed work, the emotion–cause pair extraction (ECPE) technique is used that works on clause-level detection algorithms to pre-process the text data. The emotion clause and cause Clause gets separated, and then pairing and filtering of these clauses produces a set of emotion and cause pair for a document. The pre-processed data provides input to the BERT. The classifier model produces state-of-the-art results on the benchmark emotion analysis corpus. The pre-existing models are used to compare the performance on English sentences, and the ECPE-BERT emotion classifier is outperforming these models and producing results with 98% accuracy.
What problem does this paper attempt to address?