Abstract:Video shot boundary detection (SBD) is the first and essential step for content-based video management and structural analysis. Great efforts have been paid to develop SBD algorithms for years. However, the high computational cost in the SBD becomes a block for further applications such as video indexing, browsing, retrieval, and representation. Motivated by the requirement of the real-time interactive applications, a unified fast SBD scheme is proposed in this paper. We adopted a candidate segment selection and singular value decomposition (SVD) to speed up the SBD. Initially, the positions of the shot boundaries and lengths of gradual transitions are predicted using adaptive thresholds and most non-boundary frames are discarded at the same time. Only the candidate segments that may contain the shot boundaries are preserved for further detection. Then, for all frames in each candidate segment, their color histograms in the hue-saturation-value) space are extracted, forming a frame-feature matrix. The SVD is then performed on the frame-feature matrices of all candidate segments to reduce the feature dimension. The refined feature vector of each frame in the candidate segments is obtained as a new metric for boundary detection. Finally, cut and gradual transitions are identified using our pattern matching method based on a new similarity measurement. Experiments on TRECVID 2001 test data and other video materials show that the proposed scheme can achieve a high detection speed and excellent accuracy compared with recent SBD schemes.

Shot scale distribution in art films

On the influence of shot scale on film mood and narrative engagement in film viewers

CineScale: A dataset of cinematic shot scale in movies

CineScale2: a dataset of cinematic camera features in movies

Multi-scale Shot Segmentation Based on Weighted Subregion Color Histogram.

Moviescope: Large-scale Analysis of Movies using Multiple Modalities

A lightweight weak semantic framework for cinematographic shot classification

Exploring challenge and explainable shot type classification using SAM-guided approaches

A Unified Framework for Shot Type Classification Based on Subject Centric Lens

Fast Video Shot Boundary Detection Based on SVD and Pattern Matching

An efficient method for video shot boundary detection and keyframe extraction using SIFT-point distribution histogram

Where to look at the movies: Analyzing visual attention to understand movie editing

Shot Classification for Action Movies Based on Motion Characteristics

A dynamic scale-mixture model of motion in natural scenes

PyCinemetrics: Computational film studies tool based on deep learning and PySide2

A Novel Shot Boundary Detection Framework

Shot Content Analysis for Video Retrieval Applications

Watching More Closely: Shot Scale Affects Film Viewers’ Theory of Mind Tendency But Not Ability

Method Based On Temporal Constrain Shot Method Based On Temporal Constrain Shot Similarity.

Two-dimensional Entropy Model for Video Shot Partitioning.

Automatic Identification of Digital Video Based on Shot-Level Sequence Matching.