Abstract:The growing rate of public space CCTV installations has generated a need for automated methods for exploiting video surveillance data including scene understanding, query, behaviour annotation and summarization. For this reason, extensive research has been performed on surveillance scene understanding and analysis. However, most studies have considered single scenes, or groups of adjacent scenes. The semantic similarity between different but related scenes (e.g., many different traffic scenes of similar layout) is not generally exploited to improve any automated surveillance tasks and reduce manual effort. Exploiting commonality, and sharing any supervised annotations, between different scenes is however challenging due to: Some scenes are totally un-related -- and thus any information sharing between them would be detrimental; while others may only share a subset of common activities -- and thus information sharing is only useful if it is selective. Moreover, semantically similar activities which should be modelled together and shared across scenes may have quite different pixel-level appearance in each scene. To address these issues we develop a new framework for distributed multiple-scene global understanding that clusters surveillance scenes by their ability to explain each other's behaviours; and further discovers which subset of activities are shared versus scene-specific within each cluster. We show how to use this structured representation of multiple scenes to improve common surveillance tasks including scene activity understanding, cross-scene query-by-example, behaviour classification with reduced supervised labelling requirements, and video summarization. In each case we demonstrate how our multi-scene model improves on a collection of standard single scene models and a flat model of all scenes.

Analyzing similarity of news video stories based on ″scene words″

Audio scene semantic similarity computing approach

Method Based On Temporal Constrain Shot Method Based On Temporal Constrain Shot Similarity.

Research on News Video Multi-topic Extraction and Summarization

Video Scene Detection Using Slide Windows Method Based on Temporal Constrain Shot Similarity

Automatic Scene Detection for Advanced Story Retrieval.

Exploring the Interactions of Storylines from Informative News Events.

Scene Segmentation Based on Video Structure and Spectral Methods

A New Approach For Video Scene Boundary Detection

Visual Storylines: Semantic Visualization of Movie Sequence.

Optimized Video Scene Segmentation.

A Multilingual Similarity Dataset for News Article Frame

Discovery of Shared Semantic Spaces for Multi-Scene Video Query and Summarization

Semantic Content Mining Approach in Video Based on Vector Space Model

Video Scene Analysis in 3D Wavelet Transform Domain

Video scene segmentation and semantic representation using a novel scheme

Tv News Story Segmentation Based On A Simple Statistic Model

Story-Based retrieval by learning and measuring the concept-based and content-based similarity

Video Scene Analysis: A Machine Learning Perspective

Clip-based Similarity Measure for Query-Dependent Clip Retrieval and Video Summarization.

Extracting Story Units in Sports Video Based on Unsupervised Video Scene Clustering