Object-Level Video Advertising: an Optimization Framework

Haijun Zhang,Xiong Cao,John K. L. Ho,Tommy W. S. Chow
DOI: https://doi.org/10.1109/tii.2016.2605629
IF: 12.3
2017-01-01
IEEE Transactions on Industrial Informatics
Abstract:In this paper, we present new models and algorithms for object-level video advertising. A framework that aims to embed content-relevant ads within a video stream is investigated in this context. First, a comprehensive optimization model is designed to minimize intrusiveness to viewers when ads are inserted in a video. For human clothing advertising, we design a deep convolutional neural network using face features to recognize human genders in a video stream. Human parts alignment is then implemented to extract human part features that are used for clothing retrieval. Second, we develop a heuristic algorithm to solve the proposed optimization problem. For comparison, we also employ the genetic algorithm to find solutions approaching the global optimum. Our novel framework is examined in various types of videos. Experimental results demonstrate the effectiveness of the proposed method for object-level video advertising.
What problem does this paper attempt to address?