Abstract:Utilizing speech as the transmission medium in Internet of things (IoTs) is an effective way to reduce latency while improving the efficiency of human-machine interaction. In the field of speech recognition, Recurrent Neural Network (RNN) has significant advantages to achieve accuracy improvement on speech recognition. However, some of RNN-based intelligence speech recognition applications are insufficient in the privacy-preserving of speech data, and others with privacy-preserving are time-consuming, especially about model training and speech recognition. Therefore, in this paper we propose a novel P rivacy-preserving S peech R ecognition framework using B idirectional L ong short-term memory neural network, namely PSRBL. On the one hand, PSRBL designs new functions to construct security activation functions by combing with an additive secret sharing protocol, namely a secure piecewise-linear Sigmoid and a secure piecewise-linear Tanh respectively, to achieve privacy-preserving of speech data during speech recognition process running on edge servers. On the other hand, in order to reduce the time spent on both the training and the recognition of the speech model while keeping high accuracy during speech recognition process, PSRBL first utilizes secure activation functions to refit original activation functions in the bidirectional L ong S hort- T erm M emory neural network (LSTM), and then makes full use of the left and the right context information of speech data by employing bidirectional LSTM. Experiments conducted on the speech dataset TIMIT show that our framework PSRBL performs well. Specifically compared with the state-of-the-art ones, PSRBL significantly reduces the time consumption on both the training and the recognition of the speech model under the premise that PSRBL and the comparisons are consistent in the privacy-preserving of speech data.

A GDPR-compliant Ecosystem for Speech Recognition with Transfer, Federated, and Evolutionary Learning

Parameter-Efficient Transfer Learning under Federated Learning for Automatic Speech Recognition

Ethical Considerations Related to Personal Data Collection and Reuse: Trust and Transparency in Language and Speech Technologies

End-to-End Speech Recognition from Federated Acoustic Models

Personalized Adversarial Data Augmentation for Dysarthric and Elderly Speech Recognition

Federated Self-Learning with Weak Supervision for Speech Recognition

Robust Federated Learning Against Adversarial Attacks for Speech Emotion Recognition

Data Augmentation with Locally-time Reversed Speech for Automatic Speech Recognition

Channel-Aware Domain-Adaptive Generative Adversarial Network for Robust Speech Recognition

Improving Speech Recognition for African American English With Audio Classification

Towards Lifelong Learning of End-to-End ASR.

The Gift of Feedback: Improving ASR Model Quality by Learning from User Corrections through Federated Learning

Speech Recognition with Augmented Synthesized Speech

Transferable Adversarial Attacks against ASR

Privacy against Real-Time Speech Emotion Detection via Acoustic Adversarial Evasion of Machine Learning

Label-Synchronous Neural Transducer for Adaptable Online E2E Speech Recognition

Privacy-Preserving Outsourced Speech Recognition for Smart IoT Devices

A Deep Learning System for Domain-specific Speech Recognition

FedSpeech: Federated Text-to-Speech with Continual Learning

Recent Advances in End-to-End Automatic Speech Recognition

A Novel Privacy-Preserving Speech Recognition Framework Using Bidirectional LSTM