Abstract:In the field of human-computer interaction, the current more advanced speech recognition systems are all single speech recognition, and it is urgent to adopt new in-depth learning technology to improve the existing speech recognition system. In this context, this research is based on DNN and investigates mixed speech recognition techniques for both Chinese and English. A single speech recognition algorithm based on DNN is first investigated, and then a new hybrid Chinese and English speech recognition model is constructed by fusing the attention mechanism and CTC loss function. In the construction of the hybrid speech recognition model, the end-to-end model and Transformer framework are used to combine the monotonic alignment property of the CTC loss function, which allows complex sound units to be transformed into characters for easy extraction and recognition. The performance of the constructed models was tested on Chinese speech dataset, English speech dataset and mixed Chinese and English speech dataset to determine the recognition accuracy and speed of the models. The results show that the proposed recognition model achieves 81.2% recognition accuracy and 100 recognition speed/minute on the Chinese-English mixed speech dataset, which is much better than the other three models. This study successfully addresses the need for improved speech recognition systems by introducing a novel hybrid model for mixed Chinese-English speech recognition. The experimental results confirm the superiority of the proposed model, achieving high accuracy and rapid recognition speed. The developed model holds promising potential for enhancing human-computer interaction and enabling efficient communication between Chinese and English speakers.

Chinese Dialect Speech Recognition Based on End-to-end Machine Learning

Chinese dialect speech recognition: a comprehensive survey

Advances in Cantonese Speech Recognition: A Language-Specific Pretraining Model and RNN-T Loss

Multi-Dialect Speech Recognition With A Single Sequence-To-Sequence Model

A reweighting method for speech recognition with imbalanced data of Mandarin and sub-dialects

DLD: An Optimized Chinese Speech Recognition Model Based on Deep Learning

A hybrid CTC+Attention model based on end-to-end framework for multilingual speech recognition

Research on acoustic Model of Putian Dialect Speech Recognition Based on Deep Learning

Speech recognition of south China languages based on federated learning and mathematical construction

End-to-end Code-switched TTS with Mix of Monolingual Recordings.

Deep Neural Network-based Mixed Speech Recognition Technology for Chinese and English

Improving Minority Language Speech Recognition Based on Distinctive Features

Towards Language-Universal Mandarin-English Speech Recognition

Two-stage Training for Chinese Dialect Recognition

Research on speech recognition models in the Chinese dictation machine

Unsupervised Neural Dialect Translation with Commonality and Diversity Modeling

Deep Speech 2: End-to-End Speech Recognition in English and Mandarin

Investigation of Deep Neural Network Acoustic Modelling Approaches for Low Resource Accented Mandarin Speech Recognition

A comparative study on selecting acoustic modeling units in deep neural networks based large vocabulary Chinese speech recognition

A Novel Chinese Dialect TTS Frontend with Non-Autoregressive Neural Machine Translation

Support Vector Machine Based Chinese Dialect Identification