Abstract:Key frame extraction can facilitate rapid browsing and efficient video indexing in many applications. However, to be effective, key frames must preserve sufficient video content while also being compact and representative. This study proposes a syncretic key frame extraction framework that combines sparse selection (SS) and mutual information‐based agglomerative hierarchical clustering (MIAHC) to generate effective video summaries. In the proposed framework, the SS algorithm is first applied to the original video sequences to obtain optimal key frames. Then, using content‐loss minimisation and representativeness ranking, several candidate key frames are efficiently selected and grouped as initial clusters. A post‐processor – an improved MIAHC – subsequently performs further processing to eliminate redundant images and generate the final key frames. The proposed framework overcomes issues such as information redundancy and computational complexity that afflict conventional SS methods by first obtaining candidate key frames instead of accurate key frames. Subsequently, application of the improved MIAHC to these candidate key frames rather than the original video not only results in the generation of accurate key frames, but also reduces the computation time for clustering large videos. The results of comparative experiments conducted on two benchmark datasets verify that the performance of the proposed SS–MIAHC framework is superior to that of conventional methods.

An improved clustering method for shot segmentation

New Fusional Framework Combining Sparse Selection and Clustering for Key Frame Extraction.

Multi-scale Shot Segmentation Based on Weighted Subregion Color Histogram.

Video Shot Segmentation Method Using Linear Segmentation and Sequences Combination

Video shot segmentation using graph-based dominant-set clustering

An Improved Moving-Window Method for Shot Boundary Detection

A New Approach for Real-Time Segmenting Moving Objects under Cluttered Background

Video abstraction based on the visual attention model and online clustering

Shot Boundary Detection Method For News Video

Improved Intelligent Scissors and Snake based VOP Interpolation for Semiautomatic Video Object Segmentation

An adaptive video shot segmentation scheme based on dual-detection model

Fast video shot boundary detection framework employing pre-processing techniques

Efficient shot cluster-based scene detection method for movie video retrieval

An Efficient Scene Detection Using Rough Set-Based Fuzzy Clustering for Film Video

A novel video abstraction method based on fast clustering of the regions of interest in key frames

Method Based On Temporal Constrain Shot Method Based On Temporal Constrain Shot Similarity.

Video Shot Grouping Using Best-First Model Merging

Real-Time, Adaptive, and Locality-Based Graph Partitioning Method for Video Scene Clustering

Investigation on Unsupervised Clustering Algorithms for Video Shot Categorization

Temporal shot clustering analysis for video concept detection

Video Abstraction via Attention Model and On-Line Clustering