Abstract:In this paper we introduce an effective and unified approach to creating quality video abstractions. The research was motivated by a recently developed subspace learning method called 2D-LPP, or two-dimensional Locality Preserving Projection, which proved to be effective for dimensionality reduction and discriminating enough in 'appearance-based' image recognitions. By exploiting temporal constraints (sequential correlations / contextual content) inherent in a video (vs. random collection of static images) and the use of two 2D-LPP in tandem, an image in the original extremely high (m×n)-dimensional pixel-based image space Im×n is transformed into a point in the compact (d×d)-dimensional feature subspace fd×d, with (d ≪ m) and (d << n). This feature subspace has the desired property that visually similar images in Im×n stay close in fd×d and the intrinsic geometry and local structure of the original data are preserved. The feature subspace then lends itself easily to a conventional data clustering technique to identify suitably scattered but temporally connected clusters. If necessary, a global visual colour descriptor can also be used, so the distance metric in clustering incorporates both global and local characteristics. From the clusters, which satisfy some cluster-validity constraints and user requirements (e.g., the number of clusters, most stable or most dynamic content, etc), a summary storyboard of the video is created, comprising pertinent video frames whose features are closest to the centroid of each cluster, for content browsing and search purposes. Experiments on various videos show that the summarisation results are very encouraging when compared with manually acquired 'ground truth'.

A Video Face Clustering Approach Based on Sparse Subspace Representation

Video Face Clustering via Constrained Sparse Representation

Weighted Block-Sparse Low Rank Representation For Face Clustering In Videos

Constrained Multi-View Video Face Clustering.

Joint Structured Sparsity Regularized Multiview Dimension Reduction for Video-Based Facial Expression Recognition.

Multi-View Subspace Clustering for Face Images.

A novel video face clustering algorithm based on divide and conquer strategy

Appearance-based Video Clustering in 2D Locality Preserving Projection Subspace.

VideoClusterNet: Self-Supervised and Adaptive Face Clustering For Videos

A New Method for Multi-view Face Clustering in Video Sequence

Video-based Semi-supervised Face Recognition Using Clustering

Human Facial Expression Recognition Based On 3d Cuboids And Improved K-Means Clustering Algorithm

Exploiting Unsupervised and Supervised Constraints for Subspace Clustering

Research on Face Image Optimization Method Based on Face Clustering in Video

Face Clustering Via Learning a Sparsity Preserving Low-Rank Graph

Robust Discriminative Multi-View K-means Clustering with Feature Selection and Group Sparsity Learning

Video object segmentation by motion-based sequential feature clustering.

Video-based face recognition using tensor and clustering

Joint Sparse Representation for Video-Based Face Recognition

ClusterFace: Joint Clustering and Classification for Set-Based Face Recognition

Title Co-Learned MultiView Spectral Clustering for FaceRecognition Based on Image Sets