Abstract:Text-to-image models are trained using large datasets collected by scraping image-text pairs from the internet. These datasets often include private, copyrighted, and licensed material. Training models on such datasets enables them to generate images with such content, which might violate copyright laws and individual privacy. This phenomenon is termed imitation -- generation of images with content that has recognizable similarity to its training images. In this work we study the relationship between a concept's frequency in the training dataset and the ability of a model to imitate it. We seek to determine the point at which a model was trained on enough instances to imitate a concept -- the imitation threshold. We posit this question as a new problem: Finding the Imitation Threshold (FIT) and propose an efficient approach that estimates the imitation threshold without incurring the colossal cost of training multiple models from scratch. We experiment with two domains -- human faces and art styles -- for which we create four datasets, and evaluate three text-to-image models which were trained on two pretraining datasets. Our results reveal that the imitation threshold of these models is in the range of 200-600 images, depending on the domain and the model. The imitation threshold can provide an empirical basis for copyright violation claims and acts as a guiding principle for text-to-image model developers that aim to comply with copyright and privacy laws. We release the code and data at \url{<a class="link-external link-https" href="https://github.com/vsahil/MIMETIC-2.git" rel="external noopener nofollow">this https URL</a>} and the project's website is hosted at \url{<a class="link-external link-https" href="https://how-many-van-goghs-does-it-take.github.io" rel="external noopener nofollow">this https URL</a>}.

Imitating the Functionality of Image-to-Image Models Using a Single Example

How Many Van Goghs Does It Take to Van Gogh? Finding the Imitation Threshold

Adversarial Imitation Attack

Black-Box Ripper: Copying black-box models using generative evolutionary algorithms

Transformers for One-Shot Visual Imitation

A one-to-many conditional generative adversarial network framework for multiple image-to-image translations

The False Promise of Imitating Proprietary LLMs

Fake it till you make it: Learning transferable representations from synthetic ImageNet clones

Resolving Copycat Problems in Visual Imitation Learning via Residual Action Prediction

Learning Program Behavioral Models from Synthesized Input-Output Pairs

Resolving Copycat Problems in Visual Imitation Learning Via Residual Action Prediction

Adversarial Imitation Learning from Visual Observations using Latent Information

InfoGAIL: Interpretable Imitation Learning from Visual Demonstrations

Keyframe-Focused Visual Imitation Learning

Curriculum-Based Imitation of Versatile Skills

Imitation Learning Inputting Image Feature to Each Layer of Neural Network

State-only Imitation with Transition Dynamics Mismatch

Imitated Detectors

Imitation Learning from Imperfection: Theoretical Justifications and Algorithms

Towards Learning to Imitate from a Single Video Demonstration

Sample-efficient Adversarial Imitation Learning from Observation