Abstract:Co-training is a well-known semi-supervised learning approach which trains classifiers on two or more different views and exchanges pseudo labels of unlabeled instances in an iterative way. During the co-training process, pseudo labels of unlabeled instances are very likely to be false especially in the initial training, while the standard co-training algorithm adopts a "draw without replacement" strategy and does not remove these wrongly labeled instances from training stages. Besides, most of the traditional co-training approaches are implemented for two-view cases, and their extensions in multi-view scenarios are not intuitive. These issues not only degenerate their performance as well as available application range but also hamper their fundamental theory. Moreover, there is no optimization model to explain the objective a co-training process manages to optimize. To address these issues, in this study we design a unified self-paced multi-view co-training (SPamCo) framework which draws unlabeled instances with replacement. Two specified co-regularization terms are formulated to develop different strategies for selecting pseudo-labeled instances during training. Both forms share the same optimization strategy which is consistent with the iteration process in co-training and can be naturally extended to multi-view scenarios. A distributed optimization strategy is also introduced to train the classifier of each view in parallel to further improve the efficiency of the algorithm. Furthermore, the SPamCo algorithm is proved to be PAC learnable, supporting its theoretical soundness. Experiments conducted on synthetic, text categorization, person re-identification, image recognition and object detection data sets substantiate the superiority of the proposed method.

Sparse Online Co-regularization Using Conjugate Functions

A Dual Perspective of Sparse and Robust Online Learning Algorithm

Embedding Regularizer Learning for Multi-View Semi-Supervised Classification.

Learning Deep Sparse Regularizers with Applications to Multi-View Clustering and Semi-Supervised Classification

Sparse word embeddings using l1 regularized online learning

Joint Structured Sparsity Regularized Multiview Dimension Reduction for Video-Based Facial Expression Recognition.

Online Kernel Learning with a Near Optimal Sparsity Bound

Constrained Tensor Representation Learning for Multi-View Semi-Supervised Subspace Clustering

Joint Learning of Latent Similarity and Local Embedding for Multi-View Clustering

Co-Learning Non-Negative Correlated and Uncorrelated Features for Multi-View Data

Multi-view Feature Learning with Discriminative Regularization.

Hessian-regularized Co-Training for Social Activity Recognition.

Feature Selection with &Lt;inline-Formula> &Lt;tex-Math Notation="latex">$\ell_{2,1-2}$ &Lt;/tex-Math> &Lt;/inline-Formula> Regularization

Multi-view clustering based on pairwise co-regularization and robust dual graph non-negative matrix factorization

Self-paced Multi-view Co-training.

Sparse Norm-Regularized Reconstructive Coefficients Learning

Constrained Low-Rank Learning Using Least Squares-Based Regularization

Multi-view Local Learning

Efficient Algorithms for Regularized Nonnegative Scale-invariant Low-rank Approximation Models

Feature Selection With $\ell_{2,1-2}$ Regularization

Multiview Tensor Spectral Clustering via Co-Regularization