Abstract:Keyframe extraction plays a significant role in wide variety of real-time video processing applications such as video summarization, video management and retrieval, etc. A keyframe captures the whole content of its shot and does not contain any redundant information. The keyframe extraction algorithms are facing challenges due to different visual characteristics in videos of different categories. Therefore, a single feature is not enough to capture visual characteristics of a variety of videos. In order to tackle this problem, we propose an approach of keyframe extraction that uses hybridization of features. In the present article, we propose a novel shot detection-based keyframe extraction algorithm based on combination of two features: one is Pearson correlation coefficient (PCC) and other is color moments (CM). The linear transformation invariance property of PCC facilitates the proposed algorithm to work well under varying lighting conditions. On the other hand, the scale and rotation invariance properties of color moments are beneficial for representation of complex objects that may be present in different poses and orientations. These sustained reasons support the combination of these two features, which brings significant benefits for keyframe extraction in the proposed method. The proposed method detects shot boundaries by employing combo feature set (PCC and CM). From each shot, the frame with highest mean and standard deviation is selected as keyframe. Furthermore, another important contribution is that we developed a new dataset by collecting the videos of different categories such as movies, news, serials, animations and personal interviews and made it available online. The proposed method is experimented on three datasets: two publicly available datasets and one dataset developed by us. The performance of the proposed method on these datasets has been evaluated on the basis of different evaluation parameters: figure of merit, detection percentage, accuracy, and missing factor. Principal advantage of proposed work lies in the fact that it is capable to detect both the abrupt and gradual shot transitions. In real-time videos, it is common to have abrupt and small transitions. The experimental results show the superior performance of the proposed method over the other state-of-the-art methods.

Key Frame Extraction Using Unsupervised Clustering Based on a Statistical Model

New Fusional Framework Combining Sparse Selection and Clustering for Key Frame Extraction.

Adaptive Key Frame Extraction Using Unsupervised Clustering

Video Key Frame Extraction by Unsupervised Clustering and Feedback Adjustment

A Novel Compact Yet Rich Key Frame Creation Method for Compressed Video Summarization

A novel video abstraction method based on fast clustering of the regions of interest in key frames

Key frame extraction based on the visual attention model for lane surveillance video

Joint Shot Boundary Detection and Key Frame Extraction

Key Frame Extraction Using Inter-Shot Information

Shot Segmentation Based on Von Neumann Entropy for Key Frame Extraction

Key frame extraction based on global motion statistics for team-sport videos

Video abstraction based on the visual attention model and online clustering

VIDEO KEY FRAME EXTRACTION USING AFFINITY PROPAGATION CLUSTERING

Video Abstraction via Attention Model and On-Line Clustering

A New Hierarchical Key Frame Tree-Based Video Representation Method Using Independent Component Analysis

Large Model based Sequential Keyframe Extraction for Video Summarization

Key frame vector and its application to shot retrieval

Unsupervised video summarization framework using keyframe extraction and video skimming

Shot Boundary Detection Using Unsupervised Clustering and Hypothesis Testing

An effective Key Frame Extraction technique based on Feature Fusion and Fuzzy-C means clustering with Artificial Hummingbird

Keyframe extraction using Pearson correlation coefficient and color moments