Abstract:In the field of human-computer interaction, the current more advanced speech recognition systems are all single speech recognition, and it is urgent to adopt new in-depth learning technology to improve the existing speech recognition system. In this context, this research is based on DNN and investigates mixed speech recognition techniques for both Chinese and English. A single speech recognition algorithm based on DNN is first investigated, and then a new hybrid Chinese and English speech recognition model is constructed by fusing the attention mechanism and CTC loss function. In the construction of the hybrid speech recognition model, the end-to-end model and Transformer framework are used to combine the monotonic alignment property of the CTC loss function, which allows complex sound units to be transformed into characters for easy extraction and recognition. The performance of the constructed models was tested on Chinese speech dataset, English speech dataset and mixed Chinese and English speech dataset to determine the recognition accuracy and speed of the models. The results show that the proposed recognition model achieves 81.2% recognition accuracy and 100 recognition speed/minute on the Chinese-English mixed speech dataset, which is much better than the other three models. This study successfully addresses the need for improved speech recognition systems by introducing a novel hybrid model for mixed Chinese-English speech recognition. The experimental results confirm the superiority of the proposed model, achieving high accuracy and rapid recognition speed. The developed model holds promising potential for enhancing human-computer interaction and enabling efficient communication between Chinese and English speakers.

Improving Minority Language Speech Recognition Based on Distinctive Features

Chinese Dialect Speech Recognition Based on End-to-end Machine Learning

Deep Neural Network-based Mixed Speech Recognition Technology for Chinese and English

Enhancing CTC-based speech recognition with diverse modeling units

A Fusion Approach to Spoken Language Identification Based on Combining Multiple Phone Recognizers and Speech Attribute Detectors

Robust Speech Recognition With Speech Enhanced Deep Neural Networks

English speech recognition based on deep learning with multiple features

INTEGRATING DISCRETE AND NEURAL FEATURES VIA MIXED-FEATURE TRANS-DIMENSIONAL RANDOM FIELD LANGUAGE MODELS

A hybrid CTC+Attention model based on end-to-end framework for multilingual speech recognition

Improving Accented Mandarin Speech Recognition by Using Recurrent Neural Network Based Language Model Adaptation

Performance Optimization of Speech Recognition System with Deep Neural Network Model

Improve Mispronunciation Detection with Tandem Feature

Improving Blstm Rnn Based Mandarin Speech Recognition Using Accent Dependent Bottleneck Features

Deep Speech 2: End-to-End Speech Recognition in English and Mandarin

Deep Learning based Multilingual Speech Synthesis using Multi Feature Fusion Methods

DLD: An Optimized Chinese Speech Recognition Model Based on Deep Learning

End-To-End Neural Text Classification For Tibetan

Deep Discriminative Feature Learning for Accent Recognition

Improved BLSTM RNN Based Accent Speech Recognition Using Multi-task Learning and Accent Embeddings

Multilingual and Crosslingual Speech Recognition Using Phonological-Vector Based Phone Embeddings

Multi-task Recurrent Model for True Multilingual Speech Recognition