Abstract:Mobile video is quickly becoming a mass consumer phenomenon. More and more people are using their smartphones to search and browse video content while on the move. In this paper, we have developed an innovative instant mobile video search system through which users can discover videos by simply pointing their phones at a screen to capture a very few seconds of what they are watching. The system is able to index large-scale video data using a new layered audio-video indexing approach in the cloud, as well as extract light-weight joint audio-video signatures in real time and perform progressive search on mobile devices. Unlike most existing mobile video search applications that simply send the original video query to the cloud, the proposed mobile system is one of the first attempts at instant and progressive video search leveraging the light-weight computing capacity of mobile devices. The system is characterized by four unique properties: 1) a joint audio-video signature to deal with the large aural and visual variances associated with the query video captured by the mobile phone, 2) layered audio-video indexing to holistically exploit the complementary nature of audio and video signals, 3) light-weight fingerprinting to comply with mobile processing capacity, and 4) a progressive query process to significantly reduce computational costs and improve the user experience---the search process can stop anytime once a confident result is achieved. We have collected 1,400 query videos captured by 25 mobile users from a dataset of 600 hours of video. The experiments show that our system outperforms state-of-the-art methods by achieving 90.79% precision when the query video is less than 10 seconds and 70.07% even when the query video is less than 5 seconds.

Fast Video Indexing Based on Content

A Fast Motion Estimation Method for Mobile Video Communication

Video Content Analysis Technique

A Motion Estimation Algorithm for Mobile Video Communications

Fast and robust video clip search using index structure.

Video News Indexing Using Semantic-Face

An Indexing and Browsing System for Home Video.

Listen, look, and gotcha: instant video search with mobile phones by layered audio-video indexing.

Video Indexing by Motion Activity Maps

An Efficient Approach to Content-Based Object Retrieval in Videos.

Content-Based Analysis and Indexing of Sports Video

Fast and robust short video clip search using an index structure.

A Video Content Retrieval Method Based on Spatio-temporal Change Information

Instant Mobile Video Search with Layered Audio-Video Indexing and Progressive Transmission

Design and Implementation of Video-Server-Oriented Content-Based Video Analysis and Retrieval System

Fast Image Retrieval Based on Video Metadata Information

Automatic Moving Object Extraction toward Content-Based Video Representation and Indexing

Face Indexing and Searching from Videos.

A novel video abstraction method based on fast clustering of the regions of interest in key frames

Content-Based Image And Video Indexing And Retrieval

A content-based video copy detection method with randomly projected binary features.