Abstract:Key frame extraction can facilitate rapid browsing and efficient video indexing in many applications. However, to be effective, key frames must preserve sufficient video content while also being compact and representative. This study proposes a syncretic key frame extraction framework that combines sparse selection (SS) and mutual information‐based agglomerative hierarchical clustering (MIAHC) to generate effective video summaries. In the proposed framework, the SS algorithm is first applied to the original video sequences to obtain optimal key frames. Then, using content‐loss minimisation and representativeness ranking, several candidate key frames are efficiently selected and grouped as initial clusters. A post‐processor – an improved MIAHC – subsequently performs further processing to eliminate redundant images and generate the final key frames. The proposed framework overcomes issues such as information redundancy and computational complexity that afflict conventional SS methods by first obtaining candidate key frames instead of accurate key frames. Subsequently, application of the improved MIAHC to these candidate key frames rather than the original video not only results in the generation of accurate key frames, but also reduces the computation time for clustering large videos. The results of comparative experiments conducted on two benchmark datasets verify that the performance of the proposed SS–MIAHC framework is superior to that of conventional methods.

Keyframe Extraction for Human Motion Capture Data Based on Affinity Propagation

New Fusional Framework Combining Sparse Selection and Clustering for Key Frame Extraction.

An Efficient Keyframe Extraction from Motion Capture Data

Keyframe Extraction for Human Motion Capture Data Based on Joint Kernel Sparse Representation.

An Efficient Method of Key-Frame Extraction Based on a Cluster Algorithm

3D Human Motion Retrieval Based on Key-Frames

Optimization-based key frame extraction for motion capture animation

Extraction of keyframe from motion capture data based on quantum-behaved particle swarm optimization

VIDEO KEY FRAME EXTRACTION USING AFFINITY PROPAGATION CLUSTERING

Motion Key-Frame Extraction By Using Optimized T-Stochastic Neighbor Embedding

Keyframe Extraction From Human Motion Capture Data Based On A Multiple Population Genetic Algorithm

Key frame extraction from motion capture data based on gpu

Key Frames Extraction from Human Motion Capture Data Based on Hybrid Particle Swarm Optimization Algorithm

A novel video abstraction method based on fast clustering of the regions of interest in key frames

Key-Frame Extraction from Motion Capture Data

Efficient Key-Frame Extraction Using Density-Estimation-based Nonparametric Clustering

Extraction of Keyframe of Motion Capture Data Based on Layered Curve Simplification

Near-duplicate Keyframe Retrieval by Nonrigid Image Matching.

Extraction of Key-frame from Motion Capture Data Based on Pre-selection and Reconstruction Error Optimization

Key Frame Extraction Based on Space-time Slice

A Novel Key Frames Matching Approach for Human Locomotion Interpolation.