Abstract:Emotions are considered an integral and vital part of human life. It acts as a means of expressing one's opinions and informing others about one's bodily and emotional well-being. The Speech Emotion Recognition (SER) system is used to extract and predict the emotional tone of a speaker through audio signals. Universally, emotions can be often categorized and grouped into mere types like Anger, Happiness, Sadness, and even Neutral emotional state. One can then use this as a criterion to develop a system provided, they are equipped with finite and required resources. Then through proper training and procedure, the system can be made to recognize the speaker's emotional state. In these situations, speech emotion detection is performed using spectral and prosodic capabilities because each of those aspects includes the essential data to determine the speaker's emotional state. Mel-frequency Cepstral Coefficients (MFCC) are one of the spectral features that can be used to detect the speaker's emotional state. Frequency, loudness, and pitch of a sound signal are some of the many available prosodic features that would then be able to help train and construct a machine-learning model that can uniquely identify and differentiate between the underlying emotions present in a given speech signal. It is known that the pitch of an audio signal is unique and can be used as a measure to easily distinguish between different audio signals. They can be detected from the selected features, allowing us to classify the gender type of the speaker. Support Vector Machines (SVM) are supervised learning models that examine the data for regression and classification in machine learning. They generally identify and classify the gender of the speaker in the case of a Speech Emotion Recognition system. Furthermore, some studies rely on Radial-Basis Function (RBF) and Back Propagation networks. They are capable enough to be used to identify and recognize the human emotions in the signal constrained on specific and selected features. This study presents a Speech Emotion Recognition system that outperforms an existing system in terms of data, feature selection, and methodology. Its goal is to identify speech precepts based on emotions more accurately, on average 78% accurately, and with fewer false positives. The paper aims to discuss the importance of emotions in human communication and introduce the concept of Speech Emotion Recognition, which extracts and predicts the emotional tone of a speaker through audio signals. It explains how spectral and prosodic features can be used to identify the emotional state of the speaker, with MFCC being one of the commonly used spectral features. Prosodic features such as pitch, loudness, and frequency can also be used to identify gender and differentiate between emotions in speech signals. SVM, RBF, and Back Propagation networks are machine learning models used in speech emotion recognition; these more advanced models outperform existing systems in data collection and feature selection methodology, achieving an accuracy rate of 78% with fewer false positives.

Sentiment Analysis on Speaker Specific Speech Data

Audio Sentiment Analysis by Heterogeneous Signal Features Learned from Utterance-Based Parallel Neural Network.

Speaker Discrimination on Broadcast News and Telephonic Calls Using a Fusion of Neural and Statistical Classifiers

An Emotion based Sentiment Analysis on Twitter Dataset

Integrative Sentiment Analysis: Leveraging Audio, Visual, and Textual Data

Machine learning techniques for speech emotion recognition using paralinguistic acoustic features

Speech Recognition with Deep Learning

Exploring and Applying Audio-Based Sentiment Analysis in Music

Sentiment analysis in non-fixed length audios using a Fully Convolutional Neural Network

A Review on Emotion Detection and Classification using Speech

Two-dimensional Sentiment Analysis of text

Speaker Identification from emotional and noisy speech data using learned voice segregation and Speech VGG

Human-Computer Interaction for Recognizing Speech Emotions Using Multilayer Perceptron Classifier

Machine Learning Framework for Audio-Based Content Evaluation using MFCC, Chroma, Spectral Contrast, and Temporal Feature Engineering

Sentiment Analysis : A Literature Survey

Multimodal Sentiment Analysis: A Survey of Methods, Trends, and Challenges

Speaker Identification Investigation and Analysis in Unbiased and Biased Emotional Talking Environments

Emotional speech Recognition using CNN and Deep learning techniques

Sentiment Analysis: Automatically Detecting Valence, Emotions, and Other Affectual States from Text

Dialog speech sentiment classification for imbalanced datasets

Feature extraction algorithms to improve the speech emotion recognition rate