Abstract:Personalized text-to-image generation methods can generate customized images based on the reference images, which have garnered wide research interest. Recent methods propose a finetuning-free approach with a decoupled cross-attention mechanism to generate personalized images requiring no test-time finetuning. However, when multiple reference images are provided, the current decoupled cross-attention mechanism encounters the object confusion problem and fails to map each reference image to its corresponding object, thereby seriously limiting its scope of application. To address the object confusion problem, in this work we investigate the relevance of different positions of the latent image features to the target object in diffusion model, and accordingly propose a weighted-merge method to merge multiple reference image features into the corresponding objects. Next, we integrate this weighted-merge method into existing pre-trained models and continue to train the model on a multi-object dataset constructed from the open-sourced SA-1B dataset. To mitigate object confusion and reduce training costs, we propose an object quality score to estimate the image quality for the selection of high-quality training samples. Furthermore, our weighted-merge training framework can be employed on single-object generation when a single object has multiple reference images. The experiments verify that our method achieves superior performance to the state-of-the-arts on the Concept101 dataset and DreamBooth dataset of multi-object personalized image generation, and remarkably improves the performance on single-object personalized image generation. Our code is available at <a class="link-external link-https" href="https://github.com/hqhQAQ/MIP-Adapter" rel="external noopener nofollow">this https URL</a>.

Selecting Suitable Image Retargeting Methods with Multi-instance Multi-label Learning

Objective Quality Assessment of Retargeted Images Based on RBF Neural Network with Structural Distortion and Content Change

Multi-operator Image Retargeting Based on Automatic Quality Assessment

Learning Based Intelligent Image Retargeting Technique

Learning Quality Assessment of Retargeted Images

Learning to Rank Retargeted Images.

Image Retargeting Assessment Based on Salient Region Similarity

Automatic Image Retargeting Evaluation Based on User Perception.

Beyond Visual Retargeting: A Feature Retargeting Approach for Visual Recognition and Its Applications.

Video Retargeting Using Optimized Crop-and-scale

Human Detection Method Based on Multi-Part Detector and Multi-Instance Learning

Enhanced multi-label feature selection considering label-specific relevant information

Resolving Multi-Condition Confusion for Finetuning-Free Personalized Image Generation

Objective Quality Prediction of Image Retargeting Algorithms

Diverse and Tailored Image Generation for Zero-shot Multi-label Classification

Learning To Assess Image Retargeting

Retargeting Semantically-Rich Photos

Ranking-Preserving Cross-Source Learning for Image Retargeting Quality Assessment

Image Retargeting for Preserving Robust Local Feature: Application to Mobile Visual Search

Optimal-Scaling-Factor Assignment for Patch-wise Image Retargeting.

Exploiting Click Constraints and Multi-view Features for Image Re-ranking