AI and data-driven media analysis of TV content for optimised digital content marketing

Lyndon Nixon,Konstantinos Apostolidis,Evlampios Apostolidis,Damianos Galanopoulos,Vasileios Mezaris,Basil Philipp,Rasa Bocyte
DOI: https://doi.org/10.1007/s00530-023-01195-7
IF: 3.9
2024-01-20
Multimedia Systems
Abstract:To optimise digital content marketing for broadcasters, the Horizon 2020 funded ReTV project developed an end-to-end process termed "Trans-Vector Publishing" and made it accessible through a Web-based tool termed "Content Wizard". This paper presents this tool with a focus on each of the innovations in data and AI-driven media analysis to address each key step in the digital content marketing workflow: topic selection, content search and video summarisation. First, we use predictive analytics over online data to identify topics the target audience will give the most attention to at a future time. Second, we use neural networks and embeddings to find the video asset closest in content to the identified topic. Third, we use a GAN to create an optimally summarised form of that video for publication, e.g. on social networks. The result is a new and innovative digital content marketing workflow which meets the needs of media organisations in this age of interactive online media where content is transient, malleable and ubiquitous.
computer science, information systems, theory & methods
What problem does this paper attempt to address?
### The Problem the Paper Attempts to Solve The paper aims to address the issue of how to optimize television content to enhance its appeal and impact on digital channels in digital content marketing. Specifically, the paper introduces an end-to-end process called "Trans-Vector Publishing" and its accompanying tool "Content Wizard" to solve the following key problems: 1. **Topic Selection**: How to use predictive analytics to identify the topics that the target audience will be most interested in at a future point in time from online data. 2. **Content Search**: How to use neural networks and embedding techniques to find the video material most relevant to the identified topics from the media library. 3. **Video Summarization**: How to use Generative Adversarial Networks (GAN) to create video summaries suitable for publication on specific digital channels. Through these innovations, the paper proposes a new, efficient digital content marketing workflow that helps media organizations better adapt to the immediacy, malleability, and broad reach of content in the current interactive online media era, thereby attracting and retaining audience attention.