Abstract:In the field of human-computer interaction, the current more advanced speech recognition systems are all single speech recognition, and it is urgent to adopt new in-depth learning technology to improve the existing speech recognition system. In this context, this research is based on DNN and investigates mixed speech recognition techniques for both Chinese and English. A single speech recognition algorithm based on DNN is first investigated, and then a new hybrid Chinese and English speech recognition model is constructed by fusing the attention mechanism and CTC loss function. In the construction of the hybrid speech recognition model, the end-to-end model and Transformer framework are used to combine the monotonic alignment property of the CTC loss function, which allows complex sound units to be transformed into characters for easy extraction and recognition. The performance of the constructed models was tested on Chinese speech dataset, English speech dataset and mixed Chinese and English speech dataset to determine the recognition accuracy and speed of the models. The results show that the proposed recognition model achieves 81.2% recognition accuracy and 100 recognition speed/minute on the Chinese-English mixed speech dataset, which is much better than the other three models. This study successfully addresses the need for improved speech recognition systems by introducing a novel hybrid model for mixed Chinese-English speech recognition. The experimental results confirm the superiority of the proposed model, achieving high accuracy and rapid recognition speed. The developed model holds promising potential for enhancing human-computer interaction and enabling efficient communication between Chinese and English speakers.

Research on Speech Emotion Recognition Technology based on Deep and Shallow Neural Network

Exploring Spatio-Temporal Representations by Integrating Attention-based Bidirectional-LSTM-RNNs and FCNs for Speech Emotion Recognition

Deep Spectrum Feature Representations for Speech Emotion Recognition

Self-attention Transfer Networks for Speech Emotion Recognition

Research on Chinese Speech Emotion Recognition Based on Deep Neural Network and Acoustic Features

Speech Emotion Recognition Using Deep Convolutional Neural Network and Discriminant Temporal Pyramid Matching

Research on Speech Emotion Recognition Based on Deep Neural Network

Speech Emotion Recognition Based on Linear Discriminant Analysis and Support Vector Machine Decision Tree

Emotion recognition using support vector machine and deep neural network

Speech Emotion Recognition with Hybrid Neural Network

Speech emotion recognition using deep 1D & 2D CNN LSTM networks

Facial Expression Recognition Based on Sparse Autoencoder and Shallow Convolutional Neural Network.

Speech-based emotion recognition using a hybrid RNN-CNN network

A New Network Structure for Speech Emotion Recognition Research

EEG-Based Emotion Classification Using a Deep Neural Network and Sparse Autoencoder.

Deep Neural Network-based Mixed Speech Recognition Technology for Chinese and English

A Study on a Speech Emotion Recognition System with Effective Acoustic Features Using Deep Learning Algorithms

Deep Learning Based Affective Model for Speech Emotion Recognition

Deep Learning and SVM-based Emotion Recognition from Chinese Speech for Smart Affective Services

Pre-trained Deep Convolution Neural Network Model With Attention for Speech Emotion Recognition

Facial Expression Recognition System Based On Deep Residual Fusion Neural Network