Abstract:Keyframe extraction plays a significant role in wide variety of real-time video processing applications such as video summarization, video management and retrieval, etc. A keyframe captures the whole content of its shot and does not contain any redundant information. The keyframe extraction algorithms are facing challenges due to different visual characteristics in videos of different categories. Therefore, a single feature is not enough to capture visual characteristics of a variety of videos. In order to tackle this problem, we propose an approach of keyframe extraction that uses hybridization of features. In the present article, we propose a novel shot detection-based keyframe extraction algorithm based on combination of two features: one is Pearson correlation coefficient (PCC) and other is color moments (CM). The linear transformation invariance property of PCC facilitates the proposed algorithm to work well under varying lighting conditions. On the other hand, the scale and rotation invariance properties of color moments are beneficial for representation of complex objects that may be present in different poses and orientations. These sustained reasons support the combination of these two features, which brings significant benefits for keyframe extraction in the proposed method. The proposed method detects shot boundaries by employing combo feature set (PCC and CM). From each shot, the frame with highest mean and standard deviation is selected as keyframe. Furthermore, another important contribution is that we developed a new dataset by collecting the videos of different categories such as movies, news, serials, animations and personal interviews and made it available online. The proposed method is experimented on three datasets: two publicly available datasets and one dataset developed by us. The performance of the proposed method on these datasets has been evaluated on the basis of different evaluation parameters: figure of merit, detection percentage, accuracy, and missing factor. Principal advantage of proposed work lies in the fact that it is capable to detect both the abrupt and gradual shot transitions. In real-time videos, it is common to have abrupt and small transitions. The experimental results show the superior performance of the proposed method over the other state-of-the-art methods.

Keyframe extraction using Pearson correlation coefficient and color moments

A Novel Compact Yet Rich Key Frame Creation Method for Compressed Video Summarization

New Fusional Framework Combining Sparse Selection and Clustering for Key Frame Extraction.

Near-duplicate Keyframe Retrieval by Nonrigid Image Matching.

An efficient method for video shot boundary detection and keyframe extraction using SIFT-point distribution histogram

An effective Key Frame Extraction technique based on Feature Fusion and Fuzzy-C means clustering with Artificial Hummingbird

Joint Shot Boundary Detection and Key Frame Extraction

Key frame vector and its application to shot retrieval

Adaptive Key Frame Extraction Using Unsupervised Clustering

Key Frame Extraction Based on Entropy Difference and Perceptual Hash

A novel video abstraction method based on fast clustering of the regions of interest in key frames

A comparative analysis on major key-frame extraction techniques

Key frame extraction based on quaternion Fourier transform with multiple features fusion

Keyframe-based real-time camera tracking

Keyframe recommendation based on feature intercross and fusion

Key frame extraction based on global motion statistics for team-sport videos

Movie keyframe retrieval based on cross-media correlation detection and context model

Key Frame Extraction Using Inter-Shot Information

Near-duplicate Keyframe Retrieval by Semi-Supervised Learning and Nonrigid Image Matching

Research on Real-Time Video Key Frame Extraction Technology Based on Clustering

A Fast Near-duplicate Keyframe Detection Method Based on Local Features