Abstract:To improve both the efficiency and accuracy of video semantic recognition, we can perform feature selection on the extracted video features to select a subset of features from the high-dimensional feature set for a compact and accurate video data representation. Provided the number of labeled videos is small, supervised feature selection could fail to identify the relevant features that are discriminative to target classes. In many applications, abundant unlabeled videos are easily accessible. This motivates us to develop semisupervised feature selection algorithms to better identify the relevant video features, which are discriminative to target classes by effectively exploiting the information underlying the huge amount of unlabeled video data. In this paper, we propose a framework of video semantic recognition by semisupervised feature selection via spline regression (S(2)FS(2)R) . Two scatter matrices are combined to capture both the discriminative information and the local geometry structure of labeled and unlabeled training videos: A within-class scatter matrix encoding discriminative information of labeled training videos and a spline scatter output from a local spline regression encoding data distribution. An l2,1 -norm is imposed as a regularization term on the transformation matrix to ensure it is sparse in rows, making it particularly suitable for feature selection. To efficiently solve S(2)FS(2)R , we develop an iterative algorithm and prove its convergency. In the experiments, three typical tasks of video semantic recognition, such as video concept detection, video classification, and human action recognition, are used to demonstrate that the proposed S(2)FS(2)R achieves better performance compared with the state-of-the-art methods.

Robust Supervised Spline Embedding

Learning Exemplar-Represented Manifolds in Latent Space for Classification.

Robust safe semi-supervised learning framework for high-dimensional data classification

Signed Laplacian Embedding for Supervised Dimension Reduction.

A Semi-supervised Orthogonal Subspace Learning with Spline Embedding

Unsupervised robust discriminative subspace representation based on discriminative approximate isometric embedding

Semi-Supervised Classification Via Local Spline Regression

Spline embedding for nonlinear dimensionality reduction

Neighbourhood Sensitive Preserving Embedding for Pattern Classification.

Robust Hessian Locally Linear Embedding Techniques for High-Dimensional Data

Robust Discriminant Subspace Clustering with Adaptive Local Structure Embedding.

Semisupervised Feature Selection via Spline Regression for Video Semantic Recognition

Nonlinear Supervised Dimensionality Reduction via Smooth Regular Embeddings

Unsupervised feature extraction by low-rank and sparsity preserving embedding

Semi-Supervised Graph Based Embedding with Non-Convex Sparse Coding Techniques

Nonlinear Dimensionality Reduction with Local Spline Embedding

Robust dimensionality reduction via feature space to feature space distance metric learning.

Sparse and Efficient Estimation for Partial Spline Models with Increasing Dimension

Learning Latent Low-Rank and Sparse Embedding for Robust Image Feature Extraction

Robust Neighborhood Embedding for Unsupervised Feature Selection.

SplineCam: Exact Visualization and Characterization of Deep Network Geometry and Decision Boundaries