Human-Computer Interaction with Detection of Speaker Emotions Using Convolution Neural Networks

Abeer Ali Alnuaim,Mohammed Zakariah,Aseel Alhadlaq,Chitra Shashidhar,Wesam Atef Hatamleh,Hussam Tarazi,Prashant Kumar Shukla,Rajnish Ratna
DOI: https://doi.org/10.1155/2022/7463091
IF: 3.12
2022-03-31
Computational Intelligence and Neuroscience
Abstract:Emotions play an essential role in human relationships, and many real-time applications rely on interpreting the speaker’s emotion from their words. Speech emotion recognition (SER) modules aid human-computer interface (HCI) applications, but they are challenging to implement because of the lack of balanced data for training and clarity about which features are sufficient for categorization. This research discusses the impact of the classification approach, identifying the most appropriate combination of features and data augmentation on speech emotion detection accuracy. Selection of the correct combination of handcrafted features with the classifier plays an integral part in reducing computation complexity. The suggested classification model, a 1D convolutional neural network (1D CNN), outperforms traditional machine learning approaches in classification. Unlike most earlier studies, which examined emotions primarily through a single language lens, our analysis looks at numerous language data sets. With the most discriminating features and data augmentation, our technique achieves 97.09%, 96.44%, and 83.33% accuracy for the BAVED, ANAD, and SAVEE data sets, respectively.
mathematical & computational biology,neurosciences
What problem does this paper attempt to address?