Scalable watermarking for identifying large language model outputs

Sumanth Dathathri,Abigail See,Sumedh Ghaisas,Po-Sen Huang,Rob McAdam,Johannes Welbl,Vandana Bachani,Alex Kaskasoli,Robert Stanforth,Tatiana Matejovicova,Jamie Hayes,Nidhi Vyas,Majd Al Merey,Jonah Brown-Cohen,Rudy Bunel,Borja Balle,Taylan Cemgil,Zahra Ahmed,Kitty Stacpoole,Ilia Shumailov,Ciprian Baetu,Sven Gowal,Demis Hassabis,Pushmeet Kohli

DOI: https://doi.org/10.1038/s41586-024-08025-4

IF: 64.8

2024-10-24

Nature

Abstract:Large language models (LLMs) have enabled the generation of high-quality synthetic text, often indistinguishable from human-written content, at a scale that can markedly affect the nature of the information ecosystem 1,2,3 . Watermarking can help identify synthetic text and limit accidental or deliberate misuse 4 , but has not been adopted in production systems owing to stringent quality, detectability and computational efficiency requirements. Here we describe SynthID-Text, a production-ready text watermarking scheme that preserves text quality and enables high detection accuracy, with minimal latency overhead. SynthID-Text does not affect LLM training and modifies only the sampling procedure; watermark detection is computationally efficient, without using the underlying LLM. To enable watermarking at scale, we develop an algorithm integrating watermarking with speculative sampling, an efficiency technique frequently used in production systems 5 . Evaluations across multiple LLMs empirically show that SynthID-Text provides improved detectability over comparable methods, and standard benchmarks and human side-by-side ratings indicate no change in LLM capabilities. To demonstrate the feasibility of watermarking in large-scale-production systems, we conducted a live experiment that assessed feedback from nearly 20 million Gemini 6 responses, again confirming the preservation of text quality. We hope that the availability of SynthID-Text 7 will facilitate further development of watermarking and responsible use of LLM systems.

multidisciplinary sciences

What problem does this paper attempt to address?

Scalable watermarking for identifying large language model outputs

On the Reliability of Watermarks for Large Language Models

Advancing Beyond Identification: Multi-bit Watermark for Large Language Models

Towards Codable Text Watermarking for Large Language Models

Signal Watermark on Large Language Models

Mark My Words: Analyzing and Evaluating Language Model Watermarks

Adaptive Text Watermark for Large Language Models

REMARK-LLM: A Robust and Efficient Watermarking Framework for Generative Large Language Models

Towards Codable Watermarking for Injecting Multi-bits Information to LLMs

Token-Specific Watermarking with Enhanced Detectability and Semantic Coherence for Large Language Models

A Watermark for Large Language Models

Baselines for Identifying Watermarked Large Language Models

DeepTextMark: A Deep Learning-Driven Text Watermarking Approach for Identifying Large Language Model Generated Text

Necessary and Sufficient Watermark for Large Language Models

PostMark: A Robust Blackbox Watermark for Large Language Models

Can Watermarking Large Language Models Prevent Copyrighted Text Generation and Hide Training Data?

A Semantic Invariant Robust Watermark for Large Language Models

Unbiased Watermark for Large Language Models

Watermarking Large Language Models and the Generated Content: Opportunities and Challenges

A Survey of Text Watermarking in the Era of Large Language Models

Publicly-Detectable Watermarking for Language Models