Abstract:Online model-free reinforcement learning (RL) approaches play a crucial role in coping with the real-world applications, such as the behavioral decision making in robotics. How to balance the exploration and exploitation processes is a central problem in RL. A balanced ratio of exploration/exploitation has a great influence on the total learning time and the quality of the learned strategy. Therefore, various action selection policies have been presented to obtain a balance between the exploration and exploitation procedures. However, these approaches are rarely, automatically, and dynamically regulated to the environment variations. One of the most amazing self-adaptation mechanisms in animals is their capacity to dynamically switch between exploration and exploitation strategies. This article proposes a novel neurophysiologically motivated model which simulates the role of medial prefrontal cortex (MPFC) and lateral prefrontal cortex (LPFC) in behavior decision. The sensory input is transmitted to the MPFC, then the ventral tegmental area (VTA) receives a reward and calculates a dopaminergic reinforcement signal, and the feedback categorization neurons in anterior cingulate cortex (ACC) calculate the vigilance according to the dopaminergic reinforcement signal. Then the vigilance is transformed to LPFC to regulate the exploration rate, finally the exploration rate is transmitted to thalamus to calculate the corresponding action probability. This action selection mechanism is introduced to the actor–critic model of the basal ganglia, combining with the cerebellum model based on the developmental network to construct a new hybrid neuromodulatory model to select the action of the agent. Both the simulation comparison with other four traditional action selection policies and the physical experiment results demonstrate the potential of the proposed neuromodulatory model in action selection.

An Agent Reinforcement Learning Model Based on Neural Networks

The Multi-Agent System Based on Reinforcement Learning

Optimal Exploration Algorithm of Multi-Agent Reinforcement Learning Methods (Student Abstract)

Cooperative Learning of Multi-Agent Systems Via Reinforcement Learning

LMRL: a Multi-Agent Reinforcement Learning Model and Algorithm

Multi-Agent Reinforcement Learning with Optimal Equivalent Action of Neighborhood

A Two-Layered Multi-Agent Reinforcement Learning Model and Algorithm

Behavior Decision of Mobile Robot With a Neurophysiologically Motivated Reinforcement Learning Model

Model-based Reinforcement Learning for Predictions and Control for Limit Order Books

A Novel Multi-Agent Reinforcement Learning Approach

A New Multi-Agent Reinforcement Learning Method Based on Evolving Dynamic Correlation Matrix

Mixed Deep Reinforcement Learning-behavior Tree for Intelligent Agents Design

A new multi-agent reinforcement learning approach

Multiagent-based deep reinforcement learning framework for multi-asset adaptive trading and portfolio management

Model-based Credit Assignment for Model-free Deep Reinforcement Learning

Graph Neural Networks with Model-based Reinforcement Learning for Multi-agent Systems

A LEARNING AGENT BASED ON REINFORCEMENT LEARNING

Hybrid Centralized Training and Decentralized Execution Reinforcement Learning in Multi-Agent Path-Finding Simulations

Agent Inspired Trading Using Recurrent Reinforcement Learning and LSTM Neural Networks

Deep reinforcement learning algorithm based on multi-agent parallelism and its application in game environment

A CBR-Based Multiagent Reinforcement Learning Approach