Abstract:The state-of-the-art multi-task multi-view learning (MTMV) tackles the learning scenario where multiple tasks are associated with each other via multiple shared feature views. However, in online practical scenarios where the learning tasks have heterogeneous features collected from multiple views, e.g., multiple sources, the state-of-the-arts with single view cannot work well. To tackle this issue, in this paper, we propose a Robust Lifelong Multi-task Multi-view Representation Learning (rLM 2 L) model to accumulate the knowledge from online multi-view tasks. More specifically, we firstly design a set of view-specific libraries to maintain the intra-view correlation information of each view, and further impose an orthogonal promoting term to enforce libraries to be as independent as possible. When online new multi-view task is coming, rLM 2 L model decomposes all views of the new task into a common view-invariant space by transferring the knowledge of corresponding library. In this view-invariant space, capturing underlying inter-view correlation and identifying task-specific views for the new task are jointly employed via a robust multi-task learning formulation. Then the view-specific libraries can be refined over time to keep on improving across all tasks. For the model optimization, the proximal alternating linearized minimization algorithm is adopted to optimize our nonconvex model alternatively to achieve lifelong learning. Finally, extensive experiments on benchmark datasets shows that our proposed rLM 2 L model outperforms existing lifelong learning models, while it can discover task-specific views from sequential multi-view task with less computational burden.

Multi-View Reinforcement Learning

Multi-view Reinforcement Learning for Sequential Decision-Making with Insufficient State Information

Attentive Multi-View Reinforcement Learning

Observer-Based Multiagent Deep Reinforcement Learning: A Fully Distributed Training Scheme

An Actor-Critic-Attention Mechanism for Deep Reinforcement Learning in Multi-view Environments

Multi-View Deep Attention Network for Reinforcement Learning (student Abstract).

Comprehensive Multi-view Representation Learning

Multi-view Disentanglement for Reinforcement Learning with Multiple Cameras

Multi-view class incremental learning

Towards a Simple Approach to Multi-step Model-based Reinforcement Learning

LMRL: a Multi-Agent Reinforcement Learning Model and Algorithm

MVSSC: Meta-reinforcement Learning Based Visual Indoor Navigation Using Multi-View Semantic Spatial Context

Multiview Concept Learning Via Deep Matrix Factorization

Tackling Visual Control via Multi-View Exploration Maximization

Multi-View Representation Learning Via View-Aware Modulation

Multiobjective Reinforcement Learning: A Comprehensive Overview

Robust Lifelong Multi-task Multi-view Representation Learning

A review on multi-view learning

A Two-Layered Multi-Agent Reinforcement Learning Model and Algorithm

Progressive Deep Multi-View Comprehensive Representation Learning.