Abstract:Speech emotion recognition systems have high prediction latency because of the high computational requirements for deep learning models and low generalizability mainly because of the poor reliability of emotional measurements across multiple corpora. To solve these problems, we present a speech emotion recognition system based on a reductionist approach of decomposing and analyzing syllable-level features. Mel-spectrogram of an audio stream is decomposed into syllable-level components, which are then analyzed to extract statistical features. The proposed method uses formant attention, noise-gate filtering, and rolling normalization contexts to increase feature processing speed and tolerance to adversity. A set of syllable-level formant features is extracted and fed into a single hidden layer neural network that makes predictions for each syllable as opposed to the conventional approach of using a sophisticated deep learner to make sentence-wide predictions. The syllable level predictions help to achieve the real-time latency and lower the aggregated error in utterance level cross-corpus predictions. The experiments on IEMOCAP (IE), MSP-Improv (MI), and RAVDESS (RA) databases show that the method archives real-time latency while predicting with state-of-the-art cross-corpus unweighted accuracy of 47.6% for IE to MI and 56.2% for MI to IE.

Fast Fuzzy Keyword Spotting Using Syllable Confusion Network Indexing

A Fast Fuzzy Keyword Spotting Algorithm Based on Syllable Confusion Network.

Keyword Spotting Based on Syllable Confusion Network.

Syllable Based Audio Search Using Confusion Network Arc As Indexing Unit

A Two-Step Keyword Spotting Method Using Fuzzy Search Algorithm

Experimental Investigation into Alignment-based Acoustic Confidence Measures in Keyword Verification for Mandarin Speech

Improving the Syllable-Synchronous Network Search Algorithm for Word Decoding in Continuous Chinese Speech Recognition

Two-stage Keyword Spotting System Based on Syllable Graphs

Efficient Keyword Spotting System for Information Retrieval

A New Keyword Spotting Approach for Spontaneous Mandarin Speech

Efficient System Combination for Chinese Spoken Term Detection

Real-time Speech Emotion Recognition Based on Syllable-Level Feature Extraction

Efficient System Combination for Syllable-Confusion-Network-Based Chinese Spoken Term Detection

Keyword Spotting Based on Phoneme Confusion Matrix

Fast Vocabulary-Independent Audio Search Based on Syllable Confusion Network Indexing in Mandarin Spontaneous Speech

Speech Emotion Recognition Based on Syllable-Level Feature Extraction

A VOCABULARY-INDEPENDENT KEYWORD SPOTTER FOR SPONTANEOUS CHINESE SPEECH

ON CHINESE CONTINUOUS SPEECH RECOGNITION SYSTEM AND KNOWLEDGE BASED SEARCH STRATEGIES SONG Zhanjiang

Syllable Level Speech Emotion Recognition Based on Formant Attention

Research on continuous Chinese speech recognition system and knowledge based search strategies