Abstract:With the rapid development of natural language processing techniques, the use of language models in text classification and sentiment analysis has been increasing.However, language models are susceptible to piracy and redistribution by adversaries, posing a serious threat to the intellectual property of model owners.Therefore, researchers have been working on designing protection mechanisms to identify the copyright information of language models.However, existing watermarking of language models for text classification tasks cannot be associated with the owner’s identity, and they are not robust enough and cannot regenerate trigger sets.To solve these problems, a new model, namely black-box watermarking scheme for text classification tasks, was proposed.It was a scheme that can remotely and quickly verify model ownership.The copyright message and the key of the model owner were obtained through the Hash-based Message Authentication Code (HMAC), and the message digest obtained by HMAC can prevent forgery and had high security.A certain amount of text data was randomly selected from each category of the original training set and the digest was combined with the text data to construct the trigger set, then the watermark was embedded on the language model during the training process.To evaluate the performance of the proposed scheme, watermarks were embedded on three common language models on the IMDB’s movie reviews and CNews text classification datasets.The experimental results show that the accuracy of the proposed watermarking verification scheme can reach 100% without affecting the original model.Even under common attacks such as model fine-tuning and pruning, the proposed watermarking scheme shows strong robustness and resistance to forgery attacks.Meanwhile, the embedding of the watermark does not affect the convergence time of the model and has high embedding efficiency.

Neural Network Model Protection with Piracy Identification and Tampering Localization Capability

The Secret Revealer: Generative Model-Inversion Attacks Against Deep Neural Networks

Robust Hashing for Neural Network Models via Heterogeneous Graph Representation

Perceptual Model Hashing: Towards Neural Network Model Authentication

Protecting Intellectual Property with Reliable Availability of Learning Models in AI-Based Cybersecurity Services

Convolutional Neural Networks Tamper Detection and Location Based on Fragile Watermarking

A Robust Watermarking Method For Image Processing Models

PCPT and ACPT: Copyright Protection and Traceability Scheme for DNN Model

PCPT and ACPT: Copyright Protection and Traceability Scheme for DNN Models

Have You Stolen My Model? Evasion Attacks Against Deep Neural Network Watermarking Techniques

NLP Neural Network Copyright Protection Based on Black Box Watermark

Semi-fragile Neural Network Watermarking for Content Authentication and Tampering Localization

TamperNN: Efficient Tampering Detection of Deployed Neural Nets

SecureNet: Proactive intellectual property protection and model security defense for DNNs based on backdoor learning

Perceptual Hashing of Deep Convolutional Neural Networks for Model Copy Detection

A novel method for identifying the deep neural network model with the Serial Number

Model Copyright Protection in Buyer-seller Environment

Efficient Model Stealing Defense with Noise Transition Matrix

Intellectual Property Protection for Deep Learning Models: Taxonomy, Methods, Attacks, and Evaluations

EvilModel: Hiding Malware Inside of Neural Network Models

Automatically Lock Your Neural Networks When You're Away