Learning Multi-dimensional Human Preference for Text-to-Image Generation

Sixian Zhang,Bohan Wang,Junqiang Wu,Yan Li,Tingting Gao,Di Zhang,Zhongyuan Wang

2024-05-23

Abstract:Current metrics for text-to-image models typically rely on statistical metrics which inadequately represent the real preference of humans. Although recent work attempts to learn these preferences via human annotated images, they reduce the rich tapestry of human preference to a single overall score. However, the preference results vary when humans evaluate images with different aspects. Therefore, to learn the multi-dimensional human preferences, we propose the Multi-dimensional Preference Score (MPS), the first multi-dimensional preference scoring model for the evaluation of text-to-image models. The MPS introduces the preference condition module upon CLIP model to learn these diverse preferences. It is trained based on our Multi-dimensional Human Preference (MHP) Dataset, which comprises 918,315 human preference choices across four dimensions (i.e., aesthetics, semantic alignment, detail quality and overall assessment) on 607,541 images. The images are generated by a wide range of latest text-to-image models. The MPS outperforms existing scoring methods across 3 datasets in 4 dimensions, enabling it a promising metric for evaluating and improving text-to-image generation.

Computer Vision and Pattern Recognition

What problem does this paper attempt to address?

The problem that this paper attempts to solve is that the current metrics used to evaluate text - to - image generation models cannot fully represent the real human preferences. Although the existing statistical metrics can indicate the image quality to some extent, they may not reflect the evaluations of human observers on the fidelity, coherence or aesthetic appeal of the images. Moreover, although some studies attempt to learn these preferences through manually - annotated images, these methods usually simplify the rich human preferences into a single overall score, ignoring the multi - dimensionality of human preferences. When humans evaluate images from different perspectives, the preference results will be different. Therefore, using a one - dimensional evaluation method is not sufficient to capture a wide range of personalized needs and preferences.

To this end, the authors propose a Multi - dimensional Preference Score (MPS) model, which is the first multi - dimensional preference scoring model for evaluating text - to - image models. MPS is trained based on a Multi - dimensional Human Preference (MHP) dataset containing 918,315 human preference selections, which cover four dimensions (i.e., aesthetics, semantic consistency, detail quality and overall evaluation) and involve 607,541 images. These images are generated by a series of the latest text - to - image models. The experimental results show that MPS outperforms the existing scoring methods in four dimensions of three datasets, making it a promising metric for evaluating and improving text - to - image generation.