Abstract:Large Language Models (LLMs) are gaining increasing attention due to their exceptional performance across numerous tasks. As a result, the general public utilize them as an influential tool for boosting their productivity while natural language processing researchers endeavor to employ them in solving existing or new research problems. Unfortunately, individuals can only access such powerful AIs through APIs, which ultimately leads to the transmission of raw data to the models' providers and increases the possibility of privacy data leakage. Current privacy-preserving methods for cloud-deployed language models aim to protect privacy information in the pre-training dataset or during the model training phase. However, they do not meet the specific challenges presented by the remote access approach of new large-scale language models. This paper introduces a novel task, "User Privacy Protection for Dialogue Models," which aims to safeguard sensitive user information from any possible disclosure while conversing with chatbots. We also present an evaluation scheme for this task, which covers evaluation metrics for privacy protection, data availability, and resistance to simulation attacks. Moreover, we propose the first framework for this task, namely privacy protection through text sanitization. Before sending the input to remote large models, it filters out the sensitive information, using several rounds of text sanitization based on privacy types that users define. Upon receiving responses from the larger model, our framework automatically restores privacy to ensure that the conversation goes smoothly, without intervention from the privacy filter. Experiments based on real-world datasets demonstrate the efficacy of our privacy-preserving approach against eavesdropping from potential attackers.

Anti Leakage: Protecting Privacy Hidden in Our Speech

Taming Information-Stealing Smartphone Applications (On Android)

MicPro: Microphone-based Voice Privacy Protection

Privacy-preserving Liveness Detection for Securing Smart Voice Interfaces

Privacy versus Emotion Preservation Trade-offs in Emotion-Preserving Speaker Anonymization

UniAP: Protecting Speech Privacy with Non-Targeted Universal Adversarial Perturbations

Speech Sanitizer: Speech Content Desensitization and Voice Anonymization

Privacy-preserving and Privacy-attacking Approaches for Speech and Audio -- A Survey

Research on Internet data security and privacy protection

Emotionless: Privacy-Preserving Speech Analysis for Voice Assistants

Protecting User Privacy in Remote Conversational Systems: A Privacy-Preserving framework based on text sanitization

Motion Sensor-based Privacy Attack on Smartphones

Privacy against Real-Time Speech Emotion Detection via Acoustic Adversarial Evasion of Machine Learning

A Survey of Privacy Protection Techniques for Mobile Devices

Privacy in Speech Technology

VoiceMask: Anonymize and Sanitize Voice Input on Mobile Devices

PrivacyAsst: Safeguarding User Privacy in Tool-Using Large Language Model Agents

Exploring the Privacy Protection Capabilities of Chinese Large Language Models

Phoneme-Based Proactive Anti-Eavesdropping with Controlled Recording Privilege

Privacy Threats of Acoustic Covert Communication among Smart Mobile Devices

Privacy-Preserving End-to-End Spoken Language Understanding