Abstract:The state-of-the-art multi-task multi-view learning (MTMV) tackles the learning scenario where multiple tasks are associated with each other via multiple shared feature views. However, in online practical scenarios where the learning tasks have heterogeneous features collected from multiple views, e.g., multiple sources, the state-of-the-arts with single view cannot work well. To tackle this issue, in this paper, we propose a Robust Lifelong Multi-task Multi-view Representation Learning (rLM 2 L) model to accumulate the knowledge from online multi-view tasks. More specifically, we firstly design a set of view-specific libraries to maintain the intra-view correlation information of each view, and further impose an orthogonal promoting term to enforce libraries to be as independent as possible. When online new multi-view task is coming, rLM 2 L model decomposes all views of the new task into a common view-invariant space by transferring the knowledge of corresponding library. In this view-invariant space, capturing underlying inter-view correlation and identifying task-specific views for the new task are jointly employed via a robust multi-task learning formulation. Then the view-specific libraries can be refined over time to keep on improving across all tasks. For the model optimization, the proximal alternating linearized minimization algorithm is adopted to optimize our nonconvex model alternatively to achieve lifelong learning. Finally, extensive experiments on benchmark datasets shows that our proposed rLM 2 L model outperforms existing lifelong learning models, while it can discover task-specific views from sequential multi-view task with less computational burden.

Multi-Target Regression Via Robust Low-Rank Learning.

Multi-target Regression Via Target Specific Features

Multi-target Regression Via Self-Parameterized Lasso and Refactored Target Space

Learning local instance correlations for multi-target regression

Multi-target regression via stochastic configuration networks with modular stacked structure

Performing Multi-Target Regression via a Parameter Sharing-Based Deep Network

Robust Multi-View Learning Via Adaptive Regression

Robust Multi-Task Learning With Flexible Manifold Constraint

Robust Online Multi-Task Learning with Correlative and Personalized Structures

Robust Estimator Based Adaptive Multi-Task Learning

Robust Multi-Task Feature Learning

An Ensemble-Adaptive Tree-Based Chain Framework for Multi-Target Regression Problems

Multiple Robust Learning for Recommendation.

Multi-Target Feature Selection with Adaptive Graph Learning and Target Correlations

Learning Multiple Tasks with Multilinear Relationship Networks.

Robust Lifelong Multi-task Multi-view Representation Learning

Learning multiple tasks with multilinear relationship networks

Multilinear Multitask Learning by Rank-Product Regularization.

Robust Multi-View Learning Via M-estimator Joint Sparse Representation

Multi-task least-squares support vector machines

Feature ranking for multi-target regression