Abstract:Multi-target regression has recently regained great popularity due to its capability of simultaneously learning multiple relevant regression tasks and its wide applications in data mining, computer vision and medical image analysis, while great challenges arise from jointly handling inter-target correlations and input-output relationships. In this paper, we propose Multi-layer Multi-target Regression (MMR) which enables simultaneously modeling intrinsic inter-target correlations and nonlinear input-output relationships in a general framework via robust low-rank learning. Specifically, the MMR can explicitly encode inter-target correlations in a structure matrix by matrix elastic nets (MEN); the MMR can work in conjunction with the kernel trick to effectively disentangle highly complex nonlinear input-output relationships; the MMR can be efficiently solved by a new alternating optimization algorithm with guaranteed convergence. The MMR leverages the strength of kernel methods for nonlinear feature learning and the structural advantage of multi-layer learning architectures for inter-target correlation modeling. More importantly, it offers a new multi-layer learning paradigm for multi-target regression which is endowed with high generality, flexibility and expressive ability. Extensive experimental evaluation on 18 diverse real-world datasets demonstrates that our MMR can achieve consistently high performance and outperforms representative state-of-the-art algorithms, which shows its great effectiveness and generality for multivariate prediction.

A Manifold Learning-Based Multi-Instance Regression Algorithm

Deep Manifold Transformation for Dimension Reduction

Instance-Ranking: A New Perspective to Consider the Instance Dependency for Classification

Multilabel Distribution Learning Based on Multioutput Regression and Manifold Learning

Solving the Multi-Instance Problem with Neural Networks

Nonparametric Discriminant Multi-Manifold Learning

Neural Networks for Multi-Instance Learning

A New Multiple Instance Algorithm Using Structural Information.

An algorithm for multi-instance learning based on Logistic regression model and aggregate function

Multi-Target Regression Via Robust Low-Rank Learning.

Nonparametric Discriminant Multi-Manifold Learning for Dimensionality Reduction

Online Multiple Instance Regression

Multi-Instance Causal Representation Learning for Instance Label Prediction and Out-of-Distribution Generalization

Multi-manifold learning based on kernel matrix learning

Ensembles Of Multi-Instance Learners

Adapting RBF Neural Networks to Multi-Instance Learning

Optimal Margin Distribution Machine for Multi-Instance Learning.

Multi-Instance Learning with Discriminative Bag Mapping

Robust and Discriminative Distance for Multi-Instance Learning

Manifold Learning Based on Sparse Bayesian Approach

A review of multi-instance learning research