ANNA: Abstractive Text-to-Image Synthesis with Filtered News Captions

Aashish Anantha Ramakrishnan,Sharon X. Huang,Dongwon Lee
2024-07-02
Abstract:Advancements in Text-to-Image synthesis over recent years have focused more on improving the quality of generated samples using datasets with descriptive prompts. However, real-world image-caption pairs present in domains such as news data do not use simple and directly descriptive captions. With captions containing information on both the image content and underlying contextual cues, they become abstractive in nature. In this paper, we launch ANNA, an Abstractive News captioNs dAtaset extracted from online news articles in a variety of different contexts. We explore the capabilities of current Text-to-Image synthesis models to generate news domain-specific images using abstractive captions by benchmarking them on ANNA, in both standard training and transfer learning settings. The generated images are judged on the basis of contextual relevance, visual quality, and perceptual similarity to ground-truth image-caption pairs. Through our experiments, we show that techniques such as transfer learning achieve limited success in understanding abstractive captions but still fail to consistently learn the relationships between content and context features. The Dataset is available at <a class="link-external link-https" href="https://github.com/aashish2000/ANNA" rel="external noopener nofollow">this https URL</a> .
Computer Vision and Pattern Recognition
What problem does this paper attempt to address?
The problem that this paper attempts to solve is the insufficient ability of existing text - to - image synthesis models in handling abstract - style headlines in the news field. Specifically: 1. **Limitations of Existing Datasets**: Current datasets used for text - to - image synthesis mainly focus on simple, descriptive prompts and lack abstract - style headlines containing situational information. These datasets are usually from specific narrow fields or unfiltered image - text pairs extracted from multiple online sources and cannot fully reflect the complexity in the real world. 2. **Limitations of Model Performance Evaluation**: Most models mainly focus on the quality of the generated images when evaluating, while ignoring the alignment between the generated image and the input text headline. Especially when dealing with non - descriptive headlines, the evaluation of this alignment is more important. 3. **Image Generation Requirements in the News Media**: As Internet news media and social networking websites become the main channels for information dissemination, the application potential of generation models in the news media industry is huge. The generation of news images not only requires high - quality visual effects but also needs to be able to accurately convey the narrative and additional information of the article. To solve these problems, the author introduced **ANNA** (Abstractive News captioNs dAtaset), an abstract - style news headline dataset extracted from online news articles. By benchmarking existing text - to - image synthesis models on **ANNA**, the author hopes to evaluate the performance of these models in handling abstract - style headlines and explore the effects of different fine - tuning techniques. Specific goals include: - **Constructing the **ANNA** Dataset**: Containing approximately 30,000 abstract - style image - headline pairs, obtained from well - known media organizations. - **Evaluating Existing Models**: In zero - shot and fine - tuning settings, using multiple evaluation metrics (such as FID CLIP, ImageReward, and Human Preference Score V2) to evaluate the performance of different models. - **Analyzing Results**: Through quantitative and qualitative experimental results, showing success and failure cases of different fine - tuning techniques in understanding and generating abstract - style headlines. Through these efforts, the author hopes to promote the development of more complex text - to - image synthesis tasks, especially in the news media field, and improve the model's ability to generate high - quality and semantically relevant images.