Abstract:Semi-supervised multi-view learning machine is developed to process the corresponding semi-supervised multi-view data sets which consist of labeled and unlabeled instances. But in real-world applications, for a multi-view data set, only few instances are labeled with the limitation of manpower and cost. As a result, few prior knowledge which is necessary for the designing of a learning machine is provided. Moreover, in practice, different views and features play diverse discriminant roles while traditional learning machines treat these roles equally and assign the same weight just for convenience. In order to solve these problems, we introduce Universum learning to obtain more prior knowledge and assign different weights for views and features to reflect their diverse discriminant roles. The proposed learning machine is named as weight-and-Universum-based semi-supervised multi-view learning machine (WUSM). In WUSM, we first obtain weights of views and features. Then, we construct Universum set to obtain more prior knowledge on the basis of these weights. Different from traditional construction ways, the used construction way makes full use of the information of all labeled and unlabeled instances rather than only a pair of positive and negative training instances. Finally, we design the machine with the usage of the Universum set along with original data set. Our contributions are given as follows. (1) With the usage of all (labeled, unlabeled) instances of the data set, the Universum set provides more useful prior knowledge. (2) WUSM considers the diversities of views and features. (3) WUSM advances the development of semi-supervised multi-view learning machines. Experiments on bipartite ranking, feature selection, dimensionality reduction, classification, clustering, etc. validate the advantages of WUSM and draw a conclusion that with the introduction of Universum learning, view weights, and feature weights, the performance of a semi-supervised multi-view learning machine is boosted.

Creating Universum for class imbalance via locality and its application in multiview subspace learning

Multi-View Clustering Via Simultaneously Learning Shared Subspace And Affinity Matrix

Universum Discriminant Canonical Correlation Analysis

Multi-view Dimensionality Reduction Based on Universum Learning

Iterative Multiview Subspace Learning for Unpaired Multiview Clustering

Multi-view Learning with Universum

Intuitionistic fuzzy multi-view support vector machines with universum data

Unbalanced Multi-view Deep Learning

Recursive Universum Linear Discriminant Analysis

Salient and consensus representation learning based incomplete multiview clustering

Multiview Latent Structure Learning: Local Structure-Guided Cross-View Discriminant Analysis

Multi-view universum support vector machines with insensitive pinball loss

Universum driven cost-sensitive learning method with asymmetric loss function

Bilevel Multiview Latent Space Learning

Weight-and-Universum-based Semi-Supervised Multi-View Learning Machine

Multiple Universum Empirical Kernel Learning

Deep Multi-View Subspace Clustering With Unified and Discriminative Learning.

Rank-consistency-based Multi-View Learning with Universum

Generalized Incomplete Multiview Clustering With Flexible Locality Structure Diffusion

Multiset Feature Learning for Highly Imbalanced Data Classification

Unified View Imputation and Feature Selection Learning for Incomplete Multi-view Data