Abstract:We consider the problem of learning incoherent sparse and low-rank patterns from multiple tasks. Our approach is based on a linear multi-task learning formulation, in which the sparse and low-rank patterns are induced by a cardinality regularization term and a low-rank constraint, respectively. This formulation is non-convex; we convert it into its convex surrogate, which can be routinely solved via semidefinite programming for small-size problems. We propose to employ the general projected gradient scheme to efficiently solve such a convex surrogate; however, in the optimization formulation, the objective function is non-differentiable and the feasible domain is non-trivial. We present the procedures for computing the projected gradient and ensuring the global convergence of the projected gradient scheme. The computation of projected gradient involves a constrained optimization problem; we show that the optimal solution to such a problem can be obtained via solving an unconstrained optimization subproblem and an Euclidean projection subproblem. We also present two projected gradient algorithms and analyze their rates of convergence in details. In addition, we illustrate the use of the presented projected gradient algorithms for the proposed multi-task learning formulation using the least squares loss. Experimental results on a collection of real-world data sets demonstrate the effectiveness of the proposed multi-task learning formulation and the efficiency of the proposed projected gradient algorithms.

Calibrated Multi-Task Subspace Learning Via Binary Group Structure Constraint.

Elaborate Multi-Task Subspace Learning with Discrete Group Constraint

A Multi-Task Learning Strategy for Unsupervised Clustering Via Explicitly Separating the Commonality

Grouped Multi-Task Learning with Hidden Tasks Enhancement

Multi-task Sparse Structure Learning

Multi-Task Learning with Group-Specific Feature Space Sharing

Calibrated Multi-Task Learning

Latent Group Structured Multi-task Learning

Multiple Task Learning Using Iteratively Reweighted Least Square.

Multi-task Vector Field Learning.

Multiple Task Learning with Flexible Structure Regularization.

Low-Rank Multitask Learning based on Tensorized SVMs and LSSVMs

Multi-task Subspace Clustering

Multi-task learning for subspace segmentation

Learning Task Relational Structure for Multi-task Feature Learning

Flexible Multi-Task Learning with Latent Task Grouping.

Efficacy of Regularized Multitask Learning Based on SVM Models.

Towards Impartial Multi-task Learning.

Robust Estimator Based Adaptive Multi-Task Learning

Convex Multitask Learning with Flexible Task Clusters

Learning Incoherent Sparse and Low-Rank Patterns from Multiple Tasks