Abstract:Shot boundary detection (SBD) is widely used in scene segmentation, semantic analysis, and video retrieval. However, existing SBD algorithms have certain applications in video processing, but they have the following three problems. Firstly, these algorithms cannot effectively handle shot boundaries caused by sudden lighting changes. Secondly, when there are dimly lighting frames in the video, these algorithms cannot perform boundary detection well. Thirdly, when there is object or camera motion in the video, these algorithms also fail to work. To resolve these issues, we propose an SBD algorithm with color clustering changes in small regions (CCSR) to detect the shot transitions, which are abrupt changes and gradual transitions (dissolve and fade). The main idea behind the CCSR algorithm is to compute the distance of color features and to preserve the spatio-temporal information as much as possible. This model has relatively less dependence on the threshold parameters and sliding windows. Unlike other SBD algorithms, the clustering results of CCSR weaken factors such as object motion and illumination changes between adjacent frames in the video, which is helpful for reducing false detections. Furthermore, we utilize an attention mechanism in the gradual transitions to improve detection efficiency and accuracy. Finally, we evaluated the SBD algorithm, which was tested on a standard TRECVID dataset. The experimental results suggest that our algorithm yields significant improvements in precision and recall compared to the current techniques, with an average improvement of 10.35% and 8.85%, respectively. Moreover, compared with state-of-the-art algorithms, the results prove that the proposed method improves the F-score by more than 2.64% and the computation time efficiency by over 10%.

Unsupervised Clustering Algorithm for Video Shots Using Spectral Division

Investigation on Unsupervised Clustering Algorithms for Video Shot Categorization

New Fusional Framework Combining Sparse Selection and Clustering for Key Frame Extraction.

Video Shot Spectral Clustering Algorithm by Optimized Automatic Cluster Model Selection

Unsupervised Sports Video Scene Clustering And Its Applications To Story Units Detection

An Unsupervised Approach To Dominant Video Scene Clustering

Shot Boundary Detection Using Unsupervised Clustering and Hypothesis Testing

Key Frame Extraction Using Unsupervised Clustering Based on a Statistical Model

Joint Inter and Intra Shot Modeling for Spectral Video Shot Clustering

Shot Boundary Detection Method For News Video

Improving Classification of Video Shots Using Information-Theoretic Co-Clustering

Real-Time, Adaptive, and Locality-Based Graph Partitioning Method for Video Scene Clustering

Video shot segmentation using graph-based dominant-set clustering

An Efficient Scene Detection Using Rough Set-Based Fuzzy Clustering for Film Video

Multi-scale Shot Segmentation Based on Weighted Subregion Color Histogram.

Efficient shot cluster-based scene detection method for movie video retrieval

Shot Boundary Detection Using Color Clustering and Attention Mechanism

Unsupervised Categorization of Human Motion Sequences

Video abstraction based on the visual attention model and online clustering

Statistical Framework For Shot Segmentation And Classification In Sports Video

Automatic Video Summarization By Discovering Frequent Patterns With Support Vector Clustering