Abstract:Multi-task learning aims at learning multiple related but different tasks. In general, there are two ways for multi-task learning. One is to exploit the small set of labeled data from all tasks to learn a shared feature space for knowledge sharing. In this way, the focus is on the labeled training samples while the large amount of unlabeled data is not sufficiently considered. Another way has a focus on how to share model parameters among multiple tasks based on the original features space. Here, the question is whether it is possible to combine the advantages of both approaches and develop a method, which can simultaneously learn a shared subspace for multiple tasks and learn the prediction models in this subspace? To this end, in this paper, we propose a feature representation learning framework, which has the ability in combining the autoencoders, an effective way to learn good representation by using large amount of unlabeled data, and model parameter regularization methods into a unified model for multi-task learning. Specifically, all the tasks share the same encoding and decoding weights to find their latent feature representations, based on which a regularized multi-task softmax regression method is used to find a distinct prediction model for each task. Also, some commonalities are considered in the prediction models according to the relatedness of multiple tasks. There are several advantages of the proposed model: 1) it can make full use of large amount of unlabeled data from all the tasks to learn satisfying representations, 2) the learning of distinct prediction models can benefit from the success of autoencoder, 3) since we incorporate the labeled information into the softmax regression method, so the learning of feature representation is indeed in a semi-supervised manner. Therefore, our model is a semi-supervised autoencoder for multi-task learning (SAML for short). Finally, extensive experiments on three real-world data sets demonstrate the effectiveness of the proposed framework. Moreover, the feature representation obtained in this model can be used by other methods to obtain improved results.

Semi-supervised Feature Selection with Exploiting Shared Information among Multiple Tasks

Semi-supervised Feature Analysis by Mining Correlations among Multiple Tasks

Semisupervised Feature Analysis by Mining Correlations among Multiple Tasks.

Discriminative Multi-Task Feature Selection

Feature Selection for Multimedia Analysis by Sharing Information among Multiple Tasks

A-SFS: Semi-supervised Feature Selection based on Multi-task Self-supervision

Least-Squares Support Vector Machine for Semi-Supervised Multi-Tasking

Representation Learning Via Semi-Supervised Autoencoder for Multi-task Learning

Multi-task Semi-supervised Semantic Feature Learning for Classification

Adaptive Semi-Supervised Feature Selection for Cross-Modal Retrieval

Exploiting Task-Feature Co-Clusters In Multi-Task Learning

Multitask Feature Selection by Graph-Clustered Feature Sharing

On Better Exploring and Exploiting Task Relationships in Multitask Learning: Joint Model and Feature Learning.

Multi-task Model and Feature Joint Learning

Local Adaptive Learning for Semi-Supervised Feature Selection with Group Sparsity

Online Semi-Supervised Multi-task Distance Metric Learning

Online Weighted Multi-Task Feature Selection

Informative Relationship Multi-Task Learning: Exploring Pairwise Contribution Across Tasks' Sharing Knowledge

Efficient multi-view semi-supervised feature selection

Semi-supervised feature selection based on discernibility matrix and mutual information

Single-shot Feature Selection for Multi-task Recommendations