Abstract:The rapid development of LLMs brings both convenience and potential threats. As costumed and private LLMs are widely applied, model copyright protection has become important. Text watermarking is emerging as a promising solution to AI-generated text detection and model protection issues. However, current text watermarks have largely ignored the critical need for injecting different watermarks for different users, which could help attribute the watermark to a specific individual. In this paper, we explore the personalized text watermarking scheme for LLM copyright protection and other scenarios, ensuring accountability and traceability in content generation. Specifically, we propose a novel text watermarking method PersonaMark that utilizes sentence structure as the hidden medium for the watermark information and optimizes the sentence-level generation algorithm to minimize disruption to the model's natural generation process. By employing a personalized hashing function to inject unique watermark signals for different users, personalized watermarked text can be obtained. Since our approach performs on sentence level instead of token probability, the text quality is highly preserved. The injection process of unique watermark signals for different users is time-efficient for a large number of users with the designed multi-user hashing function. As far as we know, we achieved personalized text watermarking for the first time through this. We conduct an extensive evaluation of four different LLMs in terms of perplexity, sentiment polarity, alignment, readability, etc. The results demonstrate that our method maintains performance with minimal perturbation to the model's behavior, allows for unbiased insertion of watermark information, and exhibits strong watermark recognition capabilities.

TabularMark: Watermarking Tabular Datasets for Machine Learning

Leveraging Unlabeled Data for Watermark Removal of Deep Neural Networks

Watermarking Generative Tabular Data

Adaptive and Robust Watermark for Generative Tabular Data

Watermarking Text Data on Large Language Models for Dataset Copyright

CodeMark: Imperceptible Watermarking for Code Datasets against Neural Code Completion Models

Did You Train on My Dataset? Towards Public Dataset Protection with Clean-Label Backdoor Watermarking

Proving membership in LLM pretraining data via data watermarks

Making Watermark Survive Model Extraction Attacks in Graph Neural Networks.

WaterPark: A Robustness Assessment of Language Model Watermarking

Pairwise Open-Sourced Dataset Protection Based on Adaptive Blind Watermarking

Clean-Label Backdoor Watermarking for Dataset Copyright Protection via Trigger Optimization

Watermarking Counterfactual Explanations

A Robust and Adaptive Watermarking Technique for Relational Database

Not Just Change the Labels, Learn the Features: Watermarking Deep Neural Networks with Multi-View Data

A Statistical Characteristics Preserving Watermarking Scheme for Time Series Databases

Segmenting Watermarked Texts From Language Models

PointNCBW: Towards Dataset Ownership Verification for Point Clouds via Negative Clean-label Backdoor Watermark

PersonaMark: Personalized LLM watermarking for model protection and user attribution

Data Watermarking for Sequential Recommender Systems

ModelShield: Adaptive and Robust Watermark against Model Extraction Attack