Abstract:Now with a large lexicon of over 300 semantic concepts available for indexing purpose, video retrieval can be made easier by leveraging on the available semantic indices. However, any successful concept-based video retrieval approach must take the following into account: though improving continuously, these concept indexing results are still far from perfect; more concepts are awaiting for detection instead of being detected due to the limited amount of annotated data. If possible, a structured query formulation other than a simple AND logic of some chosen concepts is more desirable to model the complex query need with the fixed concept lexicon. In this paper, we propose a concept-based interactive video retrieval approach to tackle these problems. To better represent the query information need, the proposed approach learns through the feedback information a structured formulation which consists of multiple semantic concept combination terms. Instead of taking the top-ranked items from the selected concepts, it leverages on a simple mining algorithm to drill down to concept-segments where the positive examples are most densely populated than the negative examples. We evaluate the proposed method on the large scale TRECVid 05&06 data sets, and achieve promising results. Retrieval in concept-segment level has a 14% improvement upon the concept-level. Structured query formulation improves around 13% compared with the simple logical AND formulation. The learning and retrieval process only takes 300ms, satisfying the real-time interactive search need.

Interactive Video Retrieval Using Combination of Semantic Index and Instance Search.

Video browser showdown by NUS

TRECVID 2010 Known-item Search by NUS.

Known-Item Search by MCG-ICT-CAS.

Sketch-Based Retrieval in Large-Scale Image Database Via Position-Aware Silhouette Matching.

An Interactive Video Search Platform for Multi-modal Retrieval with Advanced Concepts

Learning Structured Concept-Segments for Interactive Video Retrieval

Utilizing Related Samples to Enhance Interactive Concept-Based Video Search

Interactive Video Retrieval with Rich Features and Friendly Interface

Fast and robust short video clip search using an index structure.

An Efficient Approach Based on Image Pixel and Semantic Features Towards Video Retrieval

Fast and robust video clip search using index structure.

Fast And Accurate Content-Based Semantic Search In 100m Internet Videos

PKU_ICST at TRECVID 2018: Instance Search Task.

The Interactive Video Retrieval System in SMARTV 2009

Utilizing Related Samples to Learn Complex Queries in Interactive Concept-Based Video Search

SVM-Based Interactive Retrieval for Intelligent Visual Surveillance System

Interactive search in XML data.

Semantic-based surveillance video retrieval

Mapping Query to Semantic Concepts: Leveraging Semantic Indices for Automatic and Interactive Video Retrieval

PKU-ICST @TRECVID2012: Known-item Search Task.