Abstract:Copy-Paste is a simple and effective data augmentation strategy for instance segmentation. By randomly pasting object instances onto new background images, it creates new training data for free and significantly boosts the segmentation performance, especially for rare object categories. Although diverse, high-quality object instances used in Copy-Paste result in more performance gain, previous works utilize object instances either from human-annotated instance segmentation datasets or rendered from 3D object models, and both approaches are too expensive to scale up to obtain good diversity. In this paper, we revisit Copy-Paste at scale with the power of newly emerged zero-shot recognition models (e.g., CLIP) and text2image models (e.g., StableDiffusion). We demonstrate for the first time that using a text2image model to generate images or zero-shot recognition model to filter noisily crawled images for different object categories is a feasible way to make Copy-Paste truly scalable. To make such success happen, we design a data acquisition and processing framework, dubbed “X-Paste", upon which a systematic study is conducted. On the LVIS dataset, X-Paste provides impressive improvements over the strong baseline CenterNet2 with Swin-L as the backbone. Specifically, it archives +2.6 box AP and +2.1 mask AP gains on all classes and even more significant gains with +6.8 box AP, +6.5 mask AP on long-tail classes. Our code and models are available at https://github.com/yoctta/XPaste.

Content-aware copying and pasting in images

Image Copy-and-paste with Optimized Gradient

Image Inpainting Based on Gradient Weighted Patch Propagation and Color Rectification

Environment-Sensitive cloning in images

L0 Gradient-Preserving Color Transfer

Color Transfer Between Images with Auto Selecting Swatches

Improved method of image color transfer.

Enrich the content of the image Using Context-Aware Copy Paste

Large Image Fast Compositing Based on Uniform Sample

StereoPasting: interactive composition in stereoscopic images.

Harmonic Coordinates for Real-Time Image Cloning

X-Paste: Revisiting Scalable Copy-Paste for Instance Segmentation Using CLIP and StableDiffusion

Object cloning using constrained mean value interpolation

Image Copy-Move Forgery Detection Based on Fused Features and Density Clustering

Content-based copy detection through multimodal feature representation and temporal pyramid matching

Diffusion-Based Image Inpainting Forensics Via Gradient Domain Guided Filtering Enhancement

A cohesive forgery detection for splicing and copy-paste in digital images

Image copy-move forgery passive detection based on improved PCNN and self-selected sub-images

PFB-Diff: Progressive Feature Blending diffusion for text-driven image editing

MPB: A modified Poisson blending technique

An efficient expanding block algorithm for image copy-move forgery detection