Abstract:Image composition involves seamlessly integrating given objects into a specific visual context. Current training-free methods rely on composing attention weights from several samplers to guide the generator. However, since these weights are derived from disparate contexts, their combination leads to coherence confusion and loss of appearance information. These issues worsen with their excessive focus on background generation, even when unnecessary in this task. This not only impedes their swift implementation but also compromises foreground generation quality. Moreover, these methods introduce unwanted artifacts in the transition area. In this paper, we formulate image composition as a subject-based local editing task, solely focusing on foreground generation. At each step, the edited foreground is combined with the noisy background to maintain scene consistency. To address the remaining issues, we propose PrimeComposer, a faster training-free diffuser that composites the images by well-designed attention steering across different noise levels. This steering is predominantly achieved by our Correlation Diffuser, utilizing its self-attention layers at each step. Within these layers, the synthesized subject interacts with both the referenced object and background, capturing intricate details and coherent relationships. This prior information is encoded into the attention weights, which are then integrated into the self-attention layers of the generator to guide the synthesis process. Besides, we introduce a Region-constrained Cross-Attention to confine the impact of specific subject-related tokens to desired regions, addressing the unwanted artifacts shown in the prior method thereby further improving the coherence in the transition area. Our method exhibits the fastest inference efficiency and extensive experiments demonstrate our superiority both qualitatively and quantitatively.

CFDiffusion: Controllable Foreground Relighting in Image Compositing Via Diffusion Model

Image Harmonization with Diffusion Model

Foreground Harmonization and Shadow Generation for Composite Image

ControlCom: Controllable Image Composition using Diffusion Model

Painterly Image Harmonization using Diffusion Model

DiffHarmony: Latent Diffusion Model Meets Image Harmonization

Novel 3D-Aware Composition Images Synthesis for Object Display with Diffusion Model.

PFB-Diff: Progressive Feature Blending diffusion for text-driven image editing

Relightful Harmonization: Lighting-aware Portrait Background Replacement

NeSF: Neural Shading Field for Image Harmonization

PrimeComposer: Faster Progressively Combined Diffusion for Image Composition with Attention Steering

High-Fidelity Diffusion-based Image Editing

Illuminator: Image-based Illumination Editing for Indoor Scene Harmonization

Cross-domain Compositing with Pretrained Diffusion Models

Diff-Shadow: Global-guided Diffusion Model for Shadow Removal

CC-Diff: Enhancing Contextual Coherence in Remote Sensing Image Synthesis

Collaborative Diffusion for Multi-Modal Face Generation and Editing

Scene Diffusion: Text-driven Scene Image Synthesis Conditioning on a Single 3D Model

Collage Diffusion

MagDiff: Multi-Alignment Diffusion for High-Fidelity Video Generation and Editing