Abstract:Many regression tasks encounter an asymmetric distribution of information between training and testing phases where the additional information available in training, the so-called privileged information (PI), is often inaccessible in testing. In practice, the privileged information in training data might be expressed in different formats, such as continuous, ordinal, or binary values. However, most the existing learning using privileged information (LUPI) paradigms primarily deal with the continuous form of PI, preventing them from managing variational PI, which motivates this research. Therefore, in this paper, we propose a unified framework to systematically address the aforementioned three forms of privileged information. The proposed V-SVR+ method integrates continuous, ordinal, and binary PI into the learning process of support vector regression (SVR) via three losses. For continuous privileged information, we define a linear correcting (slack) function in the privileged information space to estimate slack variables in the standard SVR method using privileged information. For the ordinal relations of privileged information, we first rank the privileged information and then, regard this ordinal privileged information as auxiliary information used in the learning process of the SVR model. For the binary or Boolean privileged information, we infer a probabilistic dependency between the privileged information and labels from the summarized privileged information knowledge. Then, we transfer the privileged information knowledge to constraints and form a constrained optimization problem. We evaluate the proposed method in three applications: music emotion recognition from songs with the help of implicit information about music elements judged by composers; multiple object recognition from images with the help of implicit information about the object's importance conveyed by the list of manually annotated image tags; and pho-o aesthetic assessment enhanced by high-level aesthetic attributes hidden in photos. Experiment results demonstrate that the proposed methods are superior to the classic learning paradigm when solving practical problems.

Learning preference relations using Support Vector Regression.

Flatheaded support vector machine for regression

Fuzzy Support Vector Regression Based on Data Domain Description

An updating method for support vector learning

One Kind of Interval Support Vector Regression Algorithm and Its Application in Web Information Mining

Linear and Support Vector Regressions Based on Geometrical Correlation of Data

Optimization of Molecular Docking Scores with Support Vector Rank Regression

A support vector domain classification algorithm with gray information

L1-Norm Least Squares Support Vector Regression Via the Alternating Direction Method of Multipliers

Noise model based ν-support vector regression with its application to short-term wind speed forecasting

Learning to rank relational objects and its application to web search.

Learning to Rank Collections.

A New Svm-Rfe Approach Towards Ranking Problem

Support Vector Regression Machines

Rsvr Algorithm Based On Support In Association Rules

Parameter choosing method of support vector regression for time series prediction

Modeling Parameter Interactions in Ranking SVM

Modeling the Parameter Interactions in Ranking SVM with Low-Rank Approximation

Joint Ranking SVM and Binary Relevance with Robust Low-Rank Learning for Multi-Label Classification

V-SVR+: Support Vector Regression With Variational Privileged Information

e-Distance Weighted Support Vector Regression