Abstract:In recent years, reinforcement learning (RL) has been widely used in decision-making. However, it still faces challenges when it is applied to autonomous driving, especially in complex multi-task scenarios. This paper introduces an unsupervised reinforcement learning(URL), called an improved Contrastive Intrinsic Control (CIC), to address this problem. CIC generates skills as transferable factors between different tasks to enable multi-task expansion. By comparing skills as potential state transfers with real state transfers, the mutual information between the two serves as the curiosity that drives the agents to explore the environment and gather experience in advance. This helps the collection of valuable experiences and the acquisition of effective skills. In the multi-task expansion phase, the unified training skills are used as a prior to enabling rapid convergence in various environments. Unified training is performed without rewards, followed by repeated training on multiple downstream tasks. Experiments are conducted in a highway environment, where three different driving modes are differentiated as separate RL tasks through reward functions. The experimental results demonstrate that the proposed method possesses the ability of multi-task learning. Compared to the Deep Deterministic Policy Gradient (DDPG) baseline, it achieves a 30% to 50% improvement in convergence speed at the single-task level and a 20% to 40% improvement in the final learning performance. Furthermore, even in complex tasks, where other RL methods struggle to learn effectively, it still achieves an obvious learning ability. This approach realizes an effective combination of curiosity mechanism, and RL decision making in the multitasking domain.

Multi-Task Deep Reinforcement Learning for Continuous Action Control.

Hierarchical Deep Reinforcement Learning for Continuous Action Control

Multi-task Learning for Continuous Control

Multi-Task Reinforcement Learning in Continuous Control with Successor Feature-Based Concurrent Composition

Leveraging the Efficiency of Multi-Task Robot Manipulation Via Task-Evoked Planner and Reinforcement Learning

Multi-task learning with deep model based reinforcement learning

Deep Multi-Agent Reinforcement Learning with Discrete-Continuous Hybrid Action Spaces

Task-Oriented Deep Reinforcement Learning for Robotic Skill Acquisition and Control

Multi-Task Reinforcement Learning for Quadrotors

Using Deep Reinforcement Learning for the Continuous Control of Robotic Arms

Multirobot Coordination with Deep Reinforcement Learning in Complex Environments.

Multi-Robot Real-time Game Strategy Learning Based on Deep Reinforcement Learning.

Unsupervised Reinforcement Learning for Multi-Task Autonomous Driving: Expanding Skills and Cultivating Curiosity

Continuous control with deep reinforcement learning

Multi-Robot Coverage Path Planning Based on Deep Reinforcement Learning.

Task and Domain Adaptive Reinforcement Learning for Robot Control

DiGrad: Multi-Task Reinforcement Learning with Shared Actions

Multi-robot Target Encirclement Control with Collision Avoidance via Deep Reinforcement Learning

Continuous Multi-Target Approaching Control of Hyper-Redundant Manipulators Based on Reinforcement Learning

Self-attention-based multi-agent continuous control method in cooperative environments

Mastering the Complex Assembly Task with a Dual-Arm Robot: A Novel Reinforcement Learning Method