Abstract:Semi-supervised multi-view learning machine is developed to process the corresponding semi-supervised multi-view data sets which consist of labeled and unlabeled instances. But in real-world applications, for a multi-view data set, only few instances are labeled with the limitation of manpower and cost. As a result, few prior knowledge which is necessary for the designing of a learning machine is provided. Moreover, in practice, different views and features play diverse discriminant roles while traditional learning machines treat these roles equally and assign the same weight just for convenience. In order to solve these problems, we introduce Universum learning to obtain more prior knowledge and assign different weights for views and features to reflect their diverse discriminant roles. The proposed learning machine is named as weight-and-Universum-based semi-supervised multi-view learning machine (WUSM). In WUSM, we first obtain weights of views and features. Then, we construct Universum set to obtain more prior knowledge on the basis of these weights. Different from traditional construction ways, the used construction way makes full use of the information of all labeled and unlabeled instances rather than only a pair of positive and negative training instances. Finally, we design the machine with the usage of the Universum set along with original data set. Our contributions are given as follows. (1) With the usage of all (labeled, unlabeled) instances of the data set, the Universum set provides more useful prior knowledge. (2) WUSM considers the diversities of views and features. (3) WUSM advances the development of semi-supervised multi-view learning machines. Experiments on bipartite ranking, feature selection, dimensionality reduction, classification, clustering, etc. validate the advantages of WUSM and draw a conclusion that with the introduction of Universum learning, view weights, and feature weights, the performance of a semi-supervised multi-view learning machine is boosted.

Multi-view Learning with Universum

A Novel Multi-View Learning Developed from Single-View Patterns

A new multi-task learning method with universum data

Intuitionistic fuzzy multi-view support vector machines with universum data

Multi-view Dimensionality Reduction Based on Universum Learning

Multi-task twin support vector machine with Universum data

Multi-view universum support vector machines with insensitive pinball loss

Multiple Universum Empirical Kernel Learning

Unbalanced Multi-view Deep Learning

Creating Universum for class imbalance via locality and its application in multiview subspace learning

Double-fold localized multiple matrix learning machine with Universum

A novel multi-view classifier based on Nyström approximation

Multi-view learning for hyperspectral image classification: An overview

Weight-and-Universum-based Semi-Supervised Multi-View Learning Machine

DMTMV: A Unified Learning Framework for Deep Multi-task Multi-view Learning.

Multiclass Universum SVM

Multi-view Learning Based on Nonparallel Support Vector Machine

Multi-view Learning Overview: Recent Progress and New Challenges

Multiple view learning based on tabular data

Semantically consistent multi-view representation learning

Rank-consistency-based Multi-View Learning with Universum