Abstract:In this paper we introduce an effective and unified approach to creating quality video abstractions. The research was motivated by a recently developed subspace learning method called 2D-LPP, or two-dimensional Locality Preserving Projection, which proved to be effective for dimensionality reduction and discriminating enough in 'appearance-based' image recognitions. By exploiting temporal constraints (sequential correlations / contextual content) inherent in a video (vs. random collection of static images) and the use of two 2D-LPP in tandem, an image in the original extremely high (m×n)-dimensional pixel-based image space Im×n is transformed into a point in the compact (d×d)-dimensional feature subspace fd×d, with (d ≪ m) and (d << n). This feature subspace has the desired property that visually similar images in Im×n stay close in fd×d and the intrinsic geometry and local structure of the original data are preserved. The feature subspace then lends itself easily to a conventional data clustering technique to identify suitably scattered but temporally connected clusters. If necessary, a global visual colour descriptor can also be used, so the distance metric in clustering incorporates both global and local characteristics. From the clusters, which satisfy some cluster-validity constraints and user requirements (e.g., the number of clusters, most stable or most dynamic content, etc), a summary storyboard of the video is created, comprising pertinent video frames whose features are closest to the centroid of each cluster, for content browsing and search purposes. Experiments on various videos show that the summarisation results are very encouraging when compared with manually acquired 'ground truth'.

Weighted Block-Sparse Low Rank Representation For Face Clustering In Videos

A Video Face Clustering Approach Based on Sparse Subspace Representation

Video Face Clustering via Constrained Sparse Representation

Face Clustering Via Learning a Sparsity Preserving Low-Rank Graph

Learning Low-Rank Representation with Block-Sparse Structure for Single Sample Face Recognition.

Face Clustering in Videos with Proportion Prior.

Weighted Block Subspace Clustering Based on Least Square Regression

A Subspace Clustering Algorithm Based on Simultaneously Sparse and Low-Rank Representation

Research on Face Image Optimization Method Based on Face Clustering in Video

Constrained Multi-View Video Face Clustering.

A Submodule Clustering Method for Multi-way Data by Sparse and Low-Rank Representation.

VideoClusterNet: Self-Supervised and Adaptive Face Clustering For Videos

Adaptive Weighted Low-Rank Sparse Representation for Multi-View Clustering.

Appearance-based Video Clustering in 2D Locality Preserving Projection Subspace.

A Submodule Clustering Method for Multi-way Data by Sparse and Low-Rank Representation

Multi-view Clustering via Structured Low-rank Representation.

Low-Rank Linear Embedding for Robust Clustering.

Robust Rank-Constrained Sparse Learning: A Graph-Based Framework for Single View and Multiview Clustering.

Sparse Subspace Clustering with Low-Rank Transformation

Subspace Clustering by Block Diagonal Representation

Robust Subspace Clustering Based on Latent Low-rank Representation with Weighted Schatten-<i>p</i> Norm Minimization