Abstract:Online video sharing (e.g., via YouTube or YouKu) has emerged as one of the most important services in the current Internet, where billions of videos on the cloud are awaiting exploration. Hence, a personalized video retrieval system is needed to help users find interesting videos from big data content. Two of the main challenges are to process the increasing amount of video big data and resolve the accompanying cold start issue efficiently. Another challenge is to satisfy the users need for personalized retrieval results, of which the accuracy is unknown. In this paper, we formulate the personalized video big data retrieval problem as an interaction between the user and the system via a stochastic process, not just a similarity matching, accuracy (feedback) model of the retrieval; introduce users real-time context into the retrieval system; and propose a general framework for this problem. By using a novel contextual multiarmed bandit-based algorithm to balance the accuracy and efficiency, we propose a context-based online big-data-oriented personalized video retrieval system. This system can support datasets that are dynamically increasing in size and has the property of cross-modal retrieval. Our approach provides accurate retrieval results with sublinear regret and linear storage complexity and significantly improves the learning speed. Furthermore, by learning for a cluster of similar contexts simultaneously, we can realize sublinear storage complexity with the same regret but slightly poorer performance on the cold start issue compared to the previous approach. We validate our theoretical results experimentally on a tremendously large dataset; the results demonstrate that the proposed algorithms outperform existing bandit-based online learning methods in terms of accuracy and efficiency and the adaptation from the bandit framework offers additional benefits.

Consumer video retargeting: context assisted spatial-temporal grid optimization.

Video Retargeting Using Optimized Crop-and-scale

Sports video retargeting.

Spatiotemporal Grid Flow for Video Retargeting

Grid-Based Retargeting with Transformation Consistency Smoothing

Video Retargeting with Multi-Scale Trajectory Optimization

Videoader: a video advertising system based on intelligent analysis of visual content

Spatio-Temporal Video Segmentation of Static Scenes and Its Applications

Retargeting video with an end-to-end framework

Perceptual Temporal Incoherence-Guided Stereo Video Retargeting.

Video Abstraction via Attention Model and On-Line Clustering

Video abstraction based on the visual attention model and online clustering

Random-sampling-based spatial-temporal feature for consumer video concept classification

A Survey on High Coherence Visual Media Retargeting: Recent Advances and Applications

Context-Aware Video Object Proposals.

Context-aware network with foreground recalibration for grounding natural language in video

Depth-Aware Stereo Video Retargeting

FastShrinkage

Fast Retargeting with Adaptive Grid Optimization

Human-oriented video retargeting via object detection and patch decision

Video Big Data Retrieval Over Media Cloud: A Context-Aware Online Learning Approach