Abstract:Key frame extraction can facilitate rapid browsing and efficient video indexing in many applications. However, to be effective, key frames must preserve sufficient video content while also being compact and representative. This study proposes a syncretic key frame extraction framework that combines sparse selection (SS) and mutual information‐based agglomerative hierarchical clustering (MIAHC) to generate effective video summaries. In the proposed framework, the SS algorithm is first applied to the original video sequences to obtain optimal key frames. Then, using content‐loss minimisation and representativeness ranking, several candidate key frames are efficiently selected and grouped as initial clusters. A post‐processor – an improved MIAHC – subsequently performs further processing to eliminate redundant images and generate the final key frames. The proposed framework overcomes issues such as information redundancy and computational complexity that afflict conventional SS methods by first obtaining candidate key frames instead of accurate key frames. Subsequently, application of the improved MIAHC to these candidate key frames rather than the original video not only results in the generation of accurate key frames, but also reduces the computation time for clustering large videos. The results of comparative experiments conducted on two benchmark datasets verify that the performance of the proposed SS–MIAHC framework is superior to that of conventional methods.

Improved Key Frame Extraction Algorithm Based on Shot for MPEG Compressed Video

A Novel Compact Yet Rich Key Frame Creation Method for Compressed Video Summarization

New Fusional Framework Combining Sparse Selection and Clustering for Key Frame Extraction.

A Unified Approach to Extraction of Keyframes from MPEG Compressed Video

Automatic Extraction Of Moving Objects In Video Sequences Based On Spatio-Temporal Information

Key frame vector and its application to shot retrieval

An improved smart key frame extraction algorithm for vehicle target recognition

Optical Flow Approximation Based Motion Object Extraction for MPEG-2 Video Stream

Fast Multi-frame Motion Estimation Algorithms for H.264

A Fast and Accurate Moving Object Extraction Scheme in the MPEG Compressed Domain

Approach for shot segmentation using MPEG compressed data

An Adaptive And Fast H.264 Multi-Frame Selection Algorithm Based On Information From Previous Searches

Compressed Domain Moving Object Extraction Algorithm For Mpeg-2 Video Stream

Key Frame Extraction Using Inter-Shot Information

Joint Shot Boundary Detection and Key Frame Extraction

Dynamic Selection and Effective Compression of Key Frames for Video Abstraction.

Global motion estimation for moving object extraction in MPEG video streams

Video abstraction based on the visual attention model and online clustering

AN ADAPTIVEAND FASTH.264MULTI-FRAMESELECTIONALGORITHM BASED ON INFORMATION FROM PREVIOUSSEARCHES

An Improved Video Identification Scheme Based on Video Tomography.

A novel video abstraction method based on fast clustering of the regions of interest in key frames