Abstract:Currently, many smart speakers, even social robots, appear on the market to help people's lives become more convenient. Usually, people use smart speakers to check their daily schedule or control home appliances in their house. Many social robots also include smart speakers. They have the common property of being used in voice control machines. Regardless of where the smart speaker is installed and used, when people start a conversation with voice equipment, a security or privacy risk is exposed. Hence, we want to build a speech recognition (SR) that contains the privacy identification information (PII) system in this paper. We call this the SR-PII system. We used a Google Artificial-Intelligence-Yourself (AIY) Voice Kit released from Google to build a simple, smart dialog speaker and included our SR-PII system. In our experiments, we test SR accuracy and the reliability of privacy settings in three environments (quiet, noise, and playing music). We also examine the cloud response and speaker response times during our experiments. The results show that the speaker response is approximately 3.74 s in the cloud environment and approximately 9.04 s from the speaker. We also showed the response accuracy of the speaker, which successfully prevented personal information with the SR-PII system in three environments. The speaker has a response mean time of approximately 8.86 s with 93% mean accuracy in a quiet room, approximately 9.18 s with 89% mean accuracy in a noisy environment, and approximately 9.62 s with 90% mean accuracy in an environment that plays music. We conclude that the SR-PII system can secure private information and that the most important factor affecting the response speed of the speaker is the network connection status. We hope that people can, through our experiments, have some guidelines in building social robots and installing the SR-PII system to protect users' personal identification information.

Configurable Privacy-Preserving Automatic Speech Recognition

MicPro: Microphone-based Voice Privacy Protection

Voice Privacy with Smart Digital Assistants in Educational Settings

Emotionless: Privacy-Preserving Speech Analysis for Voice Assistants

On-Device Voice Authentication with Paralinguistic Privacy

Safeguarding Voice Privacy: Harnessing Near-Ultrasonic Interference To Protect Against Unauthorized Audio Recording

Two-Stage Voice Anonymization for Enhanced Privacy

Privacy versus Emotion Preservation Trade-offs in Emotion-Preserving Speaker Anonymization

Anonymizing Speech: Evaluating and Designing Speaker Anonymization Techniques

Privacy against Real-Time Speech Emotion Detection via Acoustic Adversarial Evasion of Machine Learning

Privacy-preserving and Privacy-attacking Approaches for Speech and Audio -- A Survey

Privacy-Preserving End-to-End Spoken Language Understanding

Building a speech recognition system with privacy identification information based on Google Voice for social robots

Voice-Indistinguishability: Protecting Voiceprint in Privacy-Preserving Speech Data Release

A Benchmark for Multi-speaker Anonymization

Privacy-Utility Balanced Voice De-Identification Using Adversarial Examples

Privacy-preserving Representation Learning for Speech Understanding

Exploratory Evaluation of Speech Content Masking

A Non-intrusive and Adaptive Speaker De-Identification Scheme Using Adversarial Examples

On the Generation and Removal of Speaker Adversarial Perturbation for Voice-Privacy Protection

Representation Learning for Audio Privacy Preservation using Source Separation and Robust Adversarial Learning