Abstract:LLMs now exhibit human-like skills in various fields, leading to worries about misuse. Thus, detecting generated text is crucial. However, passive detection methods are stuck in domain specificity and limited adversarial robustness. To achieve reliable detection, a watermark-based method was proposed for white-box LLMs, allowing them to embed watermarks during text generation. The method involves randomly dividing the model vocabulary to obtain a special list and adjusting the probability distribution to promote the selection of words in the list. A detection algorithm aware of the list can identify the watermarked text. However, this method is not applicable in many real-world scenarios where only black-box language models are available. For instance, third-parties that develop API-based vertical applications cannot watermark text themselves because API providers only supply generated text and withhold probability distributions to shield their commercial interests. To allow third-parties to autonomously inject watermarks into generated text, we develop a watermarking framework for black-box language model usage scenarios. Specifically, we first define a binary encoding function to compute a random binary encoding corresponding to a word. The encodings computed for non-watermarked text conform to a Bernoulli distribution, wherein the probability of a word representing bit-1 being approximately 0.5. To inject a watermark, we alter the distribution by selectively replacing words representing bit-0 with context-based synonyms that represent bit-1. A statistical test is then used to identify the watermark. Experiments demonstrate the effectiveness of our method on both Chinese and English datasets. Furthermore, results under re-translation, polishing, word deletion, and synonym substitution attacks reveal that it is arduous to remove the watermark without compromising the original semantics.

COSYWA: Enhancing Semantic Integrity in Watermarking Natural Language Generation.

Protecting Your NLG Models with Semantic and Robust Watermarks

Token-Specific Watermarking with Enhanced Detectability and Semantic Coherence for Large Language Models

Necessary and Sufficient Watermark for Large Language Models

A Novel Scheme for Watermarking Natural Language Text

Watermarking Conditional Text Generation for AI Detection: Unveiling Challenges and a Semantic-Aware Watermark Remedy

A novel watermarking framework for intellectual property protection of NLG APIs.

Watermarking Text Generated by Black-Box Language Models

Towards Codable Text Watermarking for Large Language Models

Towards Codable Watermarking for Injecting Multi-bits Information to LLMs

Protecting Intellectual Property of Language Generation APIs with Lexical Watermark

On the Reliability of Watermarks for Large Language Models

Signal Watermark on Large Language Models

A Semantic Invariant Robust Watermark for Large Language Models

A Robust Semantics-based Watermark for Large Language Model against Paraphrasing

Improving the Generation Quality of Watermarked Large Language Models via Word Importance Scoring

Tracing Text Provenance Via Context-Aware Lexical Substitution

WatME: Towards Lossless Watermarking Through Lexical Redundancy

Mark My Words: Analyzing and Evaluating Language Model Watermarks

Reversible source-aware natural language watermarking via customized lexical substitution

Segmenting Watermarked Texts From Language Models