Abstract:Keyframe extraction plays a significant role in wide variety of real-time video processing applications such as video summarization, video management and retrieval, etc. A keyframe captures the whole content of its shot and does not contain any redundant information. The keyframe extraction algorithms are facing challenges due to different visual characteristics in videos of different categories. Therefore, a single feature is not enough to capture visual characteristics of a variety of videos. In order to tackle this problem, we propose an approach of keyframe extraction that uses hybridization of features. In the present article, we propose a novel shot detection-based keyframe extraction algorithm based on combination of two features: one is Pearson correlation coefficient (PCC) and other is color moments (CM). The linear transformation invariance property of PCC facilitates the proposed algorithm to work well under varying lighting conditions. On the other hand, the scale and rotation invariance properties of color moments are beneficial for representation of complex objects that may be present in different poses and orientations. These sustained reasons support the combination of these two features, which brings significant benefits for keyframe extraction in the proposed method. The proposed method detects shot boundaries by employing combo feature set (PCC and CM). From each shot, the frame with highest mean and standard deviation is selected as keyframe. Furthermore, another important contribution is that we developed a new dataset by collecting the videos of different categories such as movies, news, serials, animations and personal interviews and made it available online. The proposed method is experimented on three datasets: two publicly available datasets and one dataset developed by us. The performance of the proposed method on these datasets has been evaluated on the basis of different evaluation parameters: figure of merit, detection percentage, accuracy, and missing factor. Principal advantage of proposed work lies in the fact that it is capable to detect both the abrupt and gradual shot transitions. In real-time videos, it is common to have abrupt and small transitions. The experimental results show the superior performance of the proposed method over the other state-of-the-art methods.

A comparative analysis on major key-frame extraction techniques

New Fusional Framework Combining Sparse Selection and Clustering for Key Frame Extraction.

A Novel Compact Yet Rich Key Frame Creation Method for Compressed Video Summarization

A novel video abstraction method based on fast clustering of the regions of interest in key frames

Key frame extraction based on the visual attention model for lane surveillance video

Keyframe Extraction Algorithm for Continuous Sign-Language Videos Using Angular Displacement and Sequence Check Metrics

An effective Key Frame Extraction technique based on Feature Fusion and Fuzzy-C means clustering with Artificial Hummingbird

Keyframe extraction using Pearson correlation coefficient and color moments

Video abstraction based on the visual attention model and online clustering

An efficient method for video shot boundary detection and keyframe extraction using SIFT-point distribution histogram

Key frame extraction based on global motion statistics for team-sport videos

Key frame extraction from motion capture data based on gpu

Key Frame Extraction with Attention Based Deep Neural Networks

Observe Finer to Select Better: Learning Key Frame Extraction Via Semantic Coherence for Dynamic Facial Expression Recognition in the Wild

Eratosthenes sieve based key-frame extraction technique for event summarization in videos

Joint Shot Boundary Detection and Key Frame Extraction

Key Frames Hysteresis-Seeking Based on Motion Change Points for Rgb-D Video

Optimization-based key frame extraction for motion capture animation

A Unified Approach to Extraction of Keyframes from MPEG Compressed Video

Video Key Frame Extraction by Unsupervised Clustering and Feedback Adjustment

Near-duplicate Keyframe Retrieval by Nonrigid Image Matching.