Abstract:Privacy-preserving voice protection approaches primarily suppress privacy-related information derived from paralinguistic attributes while preserving the linguistic content. Existing solutions focus on single-speaker scenarios. However, they lack practicality for real-world applications, i.e., multi-speaker scenarios. In this paper, we present an initial attempt to provide a multi-speaker anonymization benchmark by defining the task and evaluation protocol, proposing benchmarking solutions, and discussing the privacy leakage of overlapping conversations. Specifically, ideal multi-speaker anonymization should preserve the number of speakers and the turn-taking structure of the conversation, ensuring accurate context conveyance while maintaining privacy. To achieve that, a cascaded system uses speaker diarization to aggregate the speech of each speaker and speaker anonymization to conceal speaker privacy and preserve speech content. Additionally, we propose two conversation-level speaker vector anonymization methods to improve the utility further. Both methods aim to make the original and corresponding pseudo-speaker identities of each speaker unlinkable while preserving or even improving the distinguishability among pseudo-speakers in a conversation. The first method minimizes the differential similarity across speaker pairs in the original and anonymized conversations to maintain original speaker relationships in the anonymized version. The other method minimizes the aggregated similarity across anonymized speakers to achieve better differentiation between speakers. Experiments conducted on both non-overlap simulated and real-world datasets demonstrate the effectiveness of the multi-speaker anonymization system with the proposed speaker anonymizers. Additionally, we analyzed overlapping speech regarding privacy leakage and provide potential solutions.

Nes Plus Plus : Number System For Encryption Based Privacy Preserving Speaker Verification

NES++: Number System for Encryption Based Privacy Preserving Speaker Verification

Private Set Intersection for Unequal Set Sizes with Mobile Applications.

Homomorphic Encryption for Speaker Recognition: Protection of Biometric Templates and Vendor Model Parameters

A Smart Image Encryption Technology via Applying Personal Information and Speaker-Verification System

A CELP-Speech Information Hiding Algorithm Based on Vector Quantization

Novel data encryption scheme and its application to secure multi-party communication

Information Hiding Technique Based Speech Secure Communication over Pstn

A Dual-Channel Speech Encryption Scheme Based on Silicon Photonic Microcavity (SPM) Chaos and Dynamic DNA Encoding

A Benchmark for Multi-speaker Anonymization

Integration of an RSA-2048-bit public key cryptography solution in the development of secure voice recognition processing applications

NPU-NTU System for Voice Privacy 2024 Challenge

Distinguishable Speaker Anonymization Based on Formant and Fundamental Frequency Scaling

Data hiding in speech signal using steganography and encryption

An encryption method with multiple encrypted keys based on interference principle.

A Secure Communication System with Multiple Encryption Algorithms

${\\ssr{PriWhisper}}$ : Enabling Keyless Secure Acoustic Communication for Smartphones

Attribute-hiding fuzzy encryption for privacy-preserving data evaluation

Collaborative calculation and application of interreal and real interval relations to protect privacy

FedSP - Federated Speaker Verification with Personal Privacy Preservation.

Privacy-preserving V2I communication and secure authentication using ECC with physical unclonable function