Abstract:Extracting key frames from a video can reduce redundancies in continuous scenes and pithy represent the entire video. This technique copes with the issue of how to efficiently manage a large amount of video data and has many applications such as video indexing, querying, and browsing. Current key frame extraction methods often utilize sparse modeling, which assumes that each video frame can be expressed as a linear combination of a few representative key frames. Although these methods are successful, they are less aware of the fact that videos have spatio-temporal structure and used ℓ1 norm based sparsity measure. In this paper, we propose a key frame extraction method that considers spatio-temporal information of videos. We employ a sparsity measure that is based on the determinant of the Gram matrix computed from entire video frames. The determinant sparsity measure is computed for the entire matrix, not for single frames, and thus it reflects the spatial or joint sparseness of the entire video. With this measure, the solutions are sparser than conventional sparseness measures but the cost function is non-convex and optimization becomes harder. Then, utilizing the fact that the proposed cost function is the difference of two convex functions, we employ an efficient algorithm based on the difference-of-convex (DC) programming, which often finds the global solution of the non-convex cost function. Experiments show that the proposed algorithm generates high-quality, high-compression key frames, compared with the existing key frame extraction method with the ℓ1 norm. The determinant sparsity measure was recently proposed and can be utilized for more video processing applications such as video saliency detection.

Key-Frame Extraction Method from Single-Lens Undersea Video Sequences

New Fusional Framework Combining Sparse Selection and Clustering for Key Frame Extraction.

A Novel Compact Yet Rich Key Frame Creation Method for Compressed Video Summarization

Key frame extraction based on the visual attention model for lane surveillance video

Fish Keypoints Detection for Ecology Monitoring Based on Underwater Visual Intelligence

A Unified Approach to Extraction of Keyframes from MPEG Compressed Video

Vision-Based Scattering Key-Frame Extraction for VideoSAR Summarization

A novel video abstraction method based on fast clustering of the regions of interest in key frames

Key Frame Extraction Based on Entropy Difference and Perceptual Hash

Joint Shot Boundary Detection and Key Frame Extraction

Video Key Frame Extracting Method and System

Key Frame Extraction Using Inter-Shot Information

Keyframe-Based Imaging Sonar Localization and Navigation Using Elastic Windowed Optimization

Non-uniform Illumination Underwater Image Enhancement Via Events and Frame Fusion

Structured Sparse Coding with the Group Log-regularizer for Key Frame Extraction

A Video Key Frame Extraction Method Based on Multiview Fusion

Key Frame Extraction from Video Based on Determinant-Type of Sparse Measure and DC Programming.

An Efficient Keyframe Extraction from Motion Capture Data

An efficient method for video shot boundary detection and keyframe extraction using SIFT-point distribution histogram

DC Programming for Solving a Sparse Modeling Problem of Video Key Frame Extraction

Large Model based Sequential Keyframe Extraction for Video Summarization