Abstract:Video shot boundary detection (SBD) is the first and essential step for content-based video management and structural analysis. Great efforts have been paid to develop SBD algorithms for years. However, the high computational cost in the SBD becomes a block for further applications such as video indexing, browsing, retrieval, and representation. Motivated by the requirement of the real-time interactive applications, a unified fast SBD scheme is proposed in this paper. We adopted a candidate segment selection and singular value decomposition (SVD) to speed up the SBD. Initially, the positions of the shot boundaries and lengths of gradual transitions are predicted using adaptive thresholds and most non-boundary frames are discarded at the same time. Only the candidate segments that may contain the shot boundaries are preserved for further detection. Then, for all frames in each candidate segment, their color histograms in the hue-saturation-value) space are extracted, forming a frame-feature matrix. The SVD is then performed on the frame-feature matrices of all candidate segments to reduce the feature dimension. The refined feature vector of each frame in the candidate segments is obtained as a new metric for boundary detection. Finally, cut and gradual transitions are identified using our pattern matching method based on a new similarity measurement. Experiments on TRECVID 2001 test data and other video materials show that the proposed scheme can achieve a high detection speed and excellent accuracy compared with recent SBD schemes.

Shot Content Analysis for Video Retrieval Applications

Video Content Representation for Shot Retrieval and Scene Extraction.

Video Scene Extraction by Force Competition

Description and Browsing of Video Story Structure

Method Based On Temporal Constrain Shot Method Based On Temporal Constrain Shot Similarity.

Content-based Sports Video Analysis and Modeling

Survey on Video Temporal Segmentation

A Unified Framework for Semantic Shot Representation of Sports Video

Content-Based Analysis and Indexing of Sports Video

A Tree-Based Paradigm for Content-Based Video Retrieval and Management

Shot-Based Similarity Measure For Content-Based Video Summarization

OM-based Video Shot Retrieval by One-to-one Matching

An adaptive video shot segmentation scheme based on dual-detection model

Video Scene Detection Using Slide Windows Method Based on Temporal Constrain Shot Similarity

An Approach for Shot Retrieval by Optimal Matching in the Bipartite Graph

Approach for shot segmentation using MPEG compressed data

Video abstraction based on the visual attention model and online clustering

Multi-scale Shot Segmentation Based on Weighted Subregion Color Histogram.

Scene Segmentation Based on Video Structure and Spectral Methods

An Improved Video Identification Scheme Based on Video Tomography.

Fast Video Shot Boundary Detection Based on SVD and Pattern Matching