Abstract:Online video sharing (e.g., via YouTube or YouKu) has emerged as one of the most important services in the current Internet, where billions of videos on the cloud are awaiting exploration. Hence, a personalized video retrieval system is needed to help users find interesting videos from big data content. Two of the main challenges are to process the increasing amount of video big data and resolve the accompanying cold start issue efficiently. Another challenge is to satisfy the users need for personalized retrieval results, of which the accuracy is unknown. In this paper, we formulate the personalized video big data retrieval problem as an interaction between the user and the system via a stochastic process, not just a similarity matching, accuracy (feedback) model of the retrieval; introduce users real-time context into the retrieval system; and propose a general framework for this problem. By using a novel contextual multiarmed bandit-based algorithm to balance the accuracy and efficiency, we propose a context-based online big-data-oriented personalized video retrieval system. This system can support datasets that are dynamically increasing in size and has the property of cross-modal retrieval. Our approach provides accurate retrieval results with sublinear regret and linear storage complexity and significantly improves the learning speed. Furthermore, by learning for a cluster of similar contexts simultaneously, we can realize sublinear storage complexity with the same regret but slightly poorer performance on the cold start issue compared to the previous approach. We validate our theoretical results experimentally on a tremendously large dataset; the results demonstrate that the proposed algorithms outperform existing bandit-based online learning methods in terms of accuracy and efficiency and the adaptation from the bandit framework offers additional benefits.

On-demand Information Retrieval from Videos Using Deep Learning in Wireless Networks: Demo Abstract.

Deep Learning on Mobile and Embedded Devices: State-of-the-art, Challenges, and Future Directions

NetVision: On-Demand Video Processing in Wireless Networks

CrowdVision: A Computing Platform for Video Crowdprocessing Using Deep Learning

Edge-Cloud Collaborative Streaming Video Analytics with Multi-agent Deep Reinforcement Learning

CloudEye: A New Paradigm of Video Analysis System for Mobile Visual Scenarios

Video Surveillance on Mobile Edge Networks—A Reinforcement-Learning-Based Approach

Instant Mobile Video Search with Layered Audio-Video Indexing and Progressive Transmission

A Query Engine for Zero-Streaming Cameras

When Wireless Video Streaming Meets AI: A Deep Learning Approach

JointRec: A Deep-Learning-Based Joint Cloud Video Recommendation Framework for Mobile IoT

Reinforcement Learning-based Mobile Edge Computing and Transmission Scheduling for Video Surveillance

Supporting Video Queries on Zero-Streaming Cameras.

On-Demand Video Dispatch Networks: A Scalable End-to-End Learning Approach

Edge Computing Enabled Real-Time Video Analysis via Adaptive Spatial-Temporal Semantic Filtering

Video Processing of Complex Activity Detection in Resource-Constrained Networks

Listen, look, and gotcha: instant video search with mobile phones by layered audio-video indexing.

Deep action: A mobile action recognition framework using edge offloading

Video Big Data Retrieval Over Media Cloud: A Context-Aware Online Learning Approach

Deep Learning Based Semantic Video Indexing and Retrieval

Scan Without a Glance: Towards Content-Free Crowd-Sourced Mobile Video Retrieval System