Abstract:Many regression tasks encounter an asymmetric distribution of information between training and testing phases where the additional information available in training, the so-called privileged information (PI), is often inaccessible in testing. In practice, the privileged information in training data might be expressed in different formats, such as continuous, ordinal, or binary values. However, most the existing learning using privileged information (LUPI) paradigms primarily deal with the continuous form of PI, preventing them from managing variational PI, which motivates this research. Therefore, in this paper, we propose a unified framework to systematically address the aforementioned three forms of privileged information. The proposed V-SVR+ method integrates continuous, ordinal, and binary PI into the learning process of support vector regression (SVR) via three losses. For continuous privileged information, we define a linear correcting (slack) function in the privileged information space to estimate slack variables in the standard SVR method using privileged information. For the ordinal relations of privileged information, we first rank the privileged information and then, regard this ordinal privileged information as auxiliary information used in the learning process of the SVR model. For the binary or Boolean privileged information, we infer a probabilistic dependency between the privileged information and labels from the summarized privileged information knowledge. Then, we transfer the privileged information knowledge to constraints and form a constrained optimization problem. We evaluate the proposed method in three applications: music emotion recognition from songs with the help of implicit information about music elements judged by composers; multiple object recognition from images with the help of implicit information about the object's importance conveyed by the list of manually annotated image tags; and pho-o aesthetic assessment enhanced by high-level aesthetic attributes hidden in photos. Experiment results demonstrate that the proposed methods are superior to the classic learning paradigm when solving practical problems.

R-CTSVM+: Robust Capped L1-norm Twin Support Vector Machine with Privileged Information

Robust Learning with Imperfect Privileged Information.

CTSVM: A robust twin support vector machine with correntropy-induced loss function for binary classification problems

Simple and Efficient Learning using Privileged Information

A Multi-Class Large Margin Classifier

LSTSVR-PI: Least square twin support vector regression with privileged information

Learning Using Multiple-Type Privileged Information and SVM+ThinkTank.

M-estimator Based Support Vector Machine and Its Application

Efficient Learning of Pinball TWSVM using Privileged Information and its applications

V-SVR+: Support Vector Regression With Variational Privileged Information

Coarse-grained privileged learning for classification

A novel fuzzy twin support vector machine based on centered kernel alignment

GL-TSVM: A robust and smooth twin support vector machine with guardian loss function

Robust Twin Extreme Learning Machine Based on Soft Truncated Capped L1-Norm Loss Function

Unified Locally Linear Classifiers with Diversity-Promoting Anchor Points

Support Vector Ordinal Regression Using Privileged Information.

Symmetric LINEX loss twin support vector machine for robust classification and its fast iterative algorithm

Multiview learning with twin parametric margin SVM

Robust Capped lp-Norm Support Vector Ordinal Regression

A two-stage safe screening method for non-convex support vector machine with ramp loss

Twin SVM for conditional probability estimation in binary and multiclass classification