Abstract:The growing use of voice user interfaces has led to a surge in the collection and storage of speech data. While data collection allows for the development of efficient tools powering most speech services, it also poses serious privacy issues for users as centralized storage makes private personal speech data vulnerable to cyber threats. With the increasing use of voice-based digital assistants like Amazon's Alexa, Google's Home, and Apple's Siri, and with the increasing ease with which personal speech data can be collected, the risk of malicious use of voice-cloning and speaker/gender/pathological/etc. recognition has increased. This thesis proposes solutions for anonymizing speech and evaluating the degree of the anonymization. In this work, anonymization refers to making personal speech data unlinkable to an identity while maintaining the usefulness (utility) of the speech signal (e.g., access to linguistic content). We start by identifying several challenges that evaluation protocols need to consider to evaluate the degree of privacy protection properly. We clarify how anonymization systems must be configured for evaluation purposes and highlight that many practical deployment configurations do not permit privacy evaluation. Furthermore, we study and examine the most common voice conversion-based anonymization system and identify its weak points before suggesting new methods to overcome some limitations. We isolate all components of the anonymization system to evaluate the degree of speaker PPI associated with each of them. Then, we propose several transformation methods for each component to reduce as much as possible speaker PPI while maintaining utility. We promote anonymization algorithms based on quantization-based transformation as an alternative to the most-used and well-known noise-based approach. Finally, we endeavor a new attack method to invert anonymization.

Modeling Pseudo-Speaker Uncertainty in Voice Anonymization

Asynchronous Voice Anonymization Using Adversarial Perturbation On Speaker Embedding

MicPro: Microphone-based Voice Privacy Protection

NWPU-ASLP System for the VoicePrivacy 2022 Challenge

Distinguishable Speaker Anonymization Based on Formant and Fundamental Frequency Scaling

Speaker Anonymization for Personal Information Protection Using Voice Conversion Techniques

Reprogramming Self-supervised Learning-based Speech Representations for Speaker Anonymization

Anonymizing Speech: Evaluating and Designing Speaker Anonymization Techniques

A Benchmark for Multi-speaker Anonymization

Two-Stage Voice Anonymization for Enhanced Privacy

Analyzing Language-Independent Speaker Anonymization Framework under Unseen Conditions

V-Cloak: Intelligibility-, Naturalness- & Timbre-Preserving Real-Time Voice Anonymization

NPU-NTU System for Voice Privacy 2024 Challenge

On the Generation and Removal of Speaker Adversarial Perturbation for Voice-Privacy Protection

Language-Independent Speaker Anonymization Approach using Self-Supervised Pre-Trained Models

Speaker anonymization using neural audio codec language models

Multi-speaker Text-to-speech Training with Speaker Anonymized Data

Speaker anonymization using orthogonal Householder neural network

Distinctive and Natural Speaker Anonymization via Singular Value Transformation-assisted Matrix

SALT: Distinguishable Speaker Anonymization Through Latent Space Transformation