A Description Scheme for Video Overview Based on Scene Detection and Face Clustering

Boyuan Tang,Weiting Chen
DOI: https://doi.org/10.1142/s021812662150002x
2020-01-01
Journal of Circuits Systems and Computers
Abstract:With the rapid growth of online videos, it is crucial to generate overviews of videos to help audiences make viewing decisions and save time. Video summarization and video captioning are two of the most common solutions. In this paper, we proposed a new solution in the form of a series of scene-person pairs generated from our proposed video description scheme. This new formation takes substantially less time than watching video summaries and is more acceptable than video captions. In addition, our method can be generalized to different types of videos. We also proposed a face clustering method and a scene detection method. The experimental results indicate that our methods outperform other state-of-the-art methods and are highly generalizable. As an example, a demo application is developed to demonstrate the proposed description scheme.
What problem does this paper attempt to address?