Persuasion Strategies in Advertisements

Yaman Kumar Singla,Rajat Jha,Arunim Gupta,Milan Aggarwal,Aditya Garg,Tushar Malyan,Ayush Bhardwaj,Rajiv Ratn Shah,Balaji Krishnamurthy,Changyou Chen
DOI: https://doi.org/10.48550/arXiv.2208.09626
2023-05-06
Abstract:Modeling what makes an advertisement persuasive, i.e., eliciting the desired response from consumer, is critical to the study of propaganda, social psychology, and marketing. Despite its importance, computational modeling of persuasion in computer vision is still in its infancy, primarily due to the lack of benchmark datasets that can provide persuasion-strategy labels associated with ads. Motivated by persuasion literature in social psychology and marketing, we introduce an extensive vocabulary of persuasion strategies and build the first ad image corpus annotated with persuasion strategies. We then formulate the task of persuasion strategy prediction with multi-modal learning, where we design a multi-task attention fusion model that can leverage other ad-understanding tasks to predict persuasion strategies. Further, we conduct a real-world case study on 1600 advertising campaigns of 30 Fortune-500 companies where we use our model's predictions to analyze which strategies work with different demographics (age and gender). The dataset also provides image segmentation masks, which labels persuasion strategies in the corresponding ad images on the test split. We publicly release our code and dataset <a class="link-external link-https" href="https://midas-research.github.io/persuasion-advertisements/" rel="external noopener nofollow">this https URL</a>.
Computation and Language,Computer Vision and Pattern Recognition
What problem does this paper attempt to address?
The problem this paper attempts to address is the modeling of persuasion strategies in advertisements. Specifically, the researchers aim to develop a method to identify and predict the persuasion strategies used in advertisements, thereby better understanding how ads influence consumer behavior and attitudes. This issue is of significant importance in propaganda, social psychology, and marketing research, but computational modeling in the field of computer vision is still in its early stages, primarily due to the lack of benchmark datasets annotated with persuasion strategies. To achieve this goal, the researchers: 1. Introduced an extensive vocabulary of persuasion strategies and constructed the first corpus of advertisement images annotated with persuasion strategies. 2. Proposed a multi-task attention fusion model to predict persuasion strategies from multimodal data (such as images, text, and symbols). 3. Built a dataset containing image segmentation masks that annotate the persuasion strategies in advertisement images in the test set. Through these efforts, the researchers hope to advance the study of automatically understanding the informational strategies conveyed by visual advertisements.