Abstract:Key frame extraction can facilitate rapid browsing and efficient video indexing in many applications. However, to be effective, key frames must preserve sufficient video content while also being compact and representative. This study proposes a syncretic key frame extraction framework that combines sparse selection (SS) and mutual information‐based agglomerative hierarchical clustering (MIAHC) to generate effective video summaries. In the proposed framework, the SS algorithm is first applied to the original video sequences to obtain optimal key frames. Then, using content‐loss minimisation and representativeness ranking, several candidate key frames are efficiently selected and grouped as initial clusters. A post‐processor – an improved MIAHC – subsequently performs further processing to eliminate redundant images and generate the final key frames. The proposed framework overcomes issues such as information redundancy and computational complexity that afflict conventional SS methods by first obtaining candidate key frames instead of accurate key frames. Subsequently, application of the improved MIAHC to these candidate key frames rather than the original video not only results in the generation of accurate key frames, but also reduces the computation time for clustering large videos. The results of comparative experiments conducted on two benchmark datasets verify that the performance of the proposed SS–MIAHC framework is superior to that of conventional methods.

Video Segmentation And Key Frame Extraction With Parametric Model

Parametric Model for Video Content Analysis

A Novel Compact Yet Rich Key Frame Creation Method for Compressed Video Summarization

New Fusional Framework Combining Sparse Selection and Clustering for Key Frame Extraction.

Video Shot Segmentation Method Using Linear Segmentation and Sequences Combination

An algorithm for automatic segmentation of video objects based on intra-frame image partition

Automatic Extraction Of Moving Objects In Video Sequences Based On Spatio-Temporal Information

Adaptive Video Segmentation Algorithm Using Hidden Conditional Random Fields

Vision-Based Scattering Key-Frame Extraction for VideoSAR Summarization

Video Segmentation Based on Inte R-Frame Motion

Video abstraction based on the visual attention model and online clustering

Joint Shot Boundary Detection and Key Frame Extraction

Adaptive Key Frame Extraction Using Dynamic Programming

A Video Key Frame Extraction Method Based on Multiview Fusion

Video scene segmentation and semantic representation using a novel scheme

Shot Segmentation Based on Von Neumann Entropy for Key Frame Extraction

A General Framework of Video Segmentation to Logical Unit Based on Conditional Random Fields

Motion feature extraction scheme for content-based video retrieval

Key Frame Extraction from Video Based on Determinant-Type of Sparse Measure and DC Programming.

Key Frame Extraction with Attention Based Deep Neural Networks

A Video Shot Segmentation Algorithm Based on Dual-detection Model