Reinforcement learning control with associative memory

Li Xu

1996-01-01

Abstract:The supervised learning local nets are employed in the ASE/ACE model as the associative memory to construct a novel reinforcement learning controller model called RELCAM. Simulation results show that the learning ability and control performance can be improved by using this model.

What problem does this paper attempt to address?

Model-Based Reinforcement Learning Via Imagination with Derived Memory.

Yao Mu,Yuzheng Zhuang,Bin Wang,Guangxiang Zhu,Wulong Liu,Jianyu Chen,Ping Luo,Shengbo Eben Li,Chongjie Zhang,Jianye Hao

2021-01-01

Abstract:Model-based reinforcement learning aims to improve the sample efficiency of policy learning by modelling the dynamics of the environment. Recently, the latent dynamics model has been further developed to enable fast planning in a compact space. It summarizes the high-dimensional experiences of an agent, which mimics the memory function of humans. Learning policies via imagination with the latent model shows great potential for solving complex tasks. However, only considering memories from the true experiences in the process of imagination could limit its advantages. Inspired by the memory prosthesis proposed by neuroscientists, we present a novel model-based reinforcement learning framework called Imagining with Derived Memory (IDM). It enables the agent to learn policy from enriched diverse imagination with prediction-reliability weight, thus improving sample efficiency and policy robustness. Experiments on various high-dimensional visual control tasks in the DMControl benchmark demonstrate that IDM outperforms previous state-of-the-art methods in terms of policy robustness and further improves the sample efficiency of the model-based method.
Episodic Reinforcement Learning with Associative Memory.

Guangxiang Zhu,Zichuan Lin,Guangwen Yang,Chongjie Zhang

2020-01-01

Abstract:Sample efficiency has been one of the major challenges for deep reinforcement learning. Non-parametric episodic control has been proposed to speed up parametric reinforcement learning by rapidly latching on previously successful policies. However, previous work on episodic reinforcement learning neglects the relationship between states and only stored the experiences as unrelated items. To improve sample efficiency of reinforcement learning, we propose a novel framework, called Episodic Reinforcement Learning with Associative Memory (ERLAM), which associates related experience trajectories to enable reasoning effective strategies. We build a graph on top of states in memory based on state transitions and develop an efficient reverse-trajectory propagation strategy to allow rapid value propagation through the graph. We use the non-parametric associative memory as early guidance for a parametric reinforcement learning model. Results on Atari games show that our framework has significantly higher sample efficiency and outperforms state-of-the-art episodic reinforcement learning models.
Learning Controllable Elements Oriented Representations for Reinforcement Learning

Qi Yi,Rui Zhang,Shaohui Peng,Jiaming Guo,Xing Hu,Zidong Du,Qi Guo,Ruizhi Chen,Ling Li,Yunji Chen

DOI: https://doi.org/10.1016/j.neucom.2023.126455

IF: 6

2023-06-16

Neurocomputing

Abstract:Deep Reinforcement Learning (deep RL) has been successfully applied to solve various decision-making problems in recent years. However, the observations in many real-world tasks are often high dimensional and include much task-irrelevant information, limiting the applications of RL algorithms. To tackle this problem, we propose LCER, a representation learning method that aims to provide RL algorithms with compact and sufficient descriptions of the original observations. Specifically, LCER trains representations to retain the controllable elements of the environment, which can reflect the action-related environment dynamics and thus are likely to be task-relevant. We demonstrate the strength of LCER on the DMControl Suite, proving that it can achieve state-of-the-art performance. LCER enables the pixel-based SAC to outperform state-based SAC on the DMControl 100K benchmark, showing that the obtained representations can match the oracle descriptions ( i.e . the physical states) of the environment. We also carry out experiments to show that LCER can efficiently filter out various distractions, especially when those distractions are not controllable.

computer science, artificial intelligence
Online Learning Control of an Intelligent Mobility Aid Using CMAC Neural Network

FENG Dong,ZHOU Wu-xiao,XU Li

DOI: https://doi.org/10.3969/j.issn.1671-7848.2013.02.024

2013-01-01

Abstract:A motorized intelligent mobility aid,named ZJU Walker,is developed to help the elderly walk easily,safely and independently in the outdoor environment.An online learning control approach to improve the interpretation of a user's walking intent is proposed.This is implemented by learning a user's operating habits in the associative memory of CMAC neural networks.Experimental results show that the CMAC-based learning controller can greatly increase the ease and comfort of the interaction between ZJU Walker and the user.
Multi-ASV Coordinated Tracking With Unknown Dynamics and Input Underactuation via Model-Reference Reinforcement Learning Control

Wenbo Hu,Fei Chen,Linying Xiang,Guanrong Chen

DOI: https://doi.org/10.1109/tcyb.2022.3203507

IF: 11.8

2022-01-01

IEEE Transactions on Cybernetics

Abstract:This article studies coordinated tracking of underactuated and uncertain autonomous surface vehicles (ASVs) via model-reference reinforcement learning control. It considered how model-reference control can be incorporated with reinforcement learning to address the challenges caused by model uncertainties and input underactuation, and how existing results may be employed to realize adaptive communication amongst ASVs. It is demonstrated that the proposed algorithm has a better performance over baseline control and effectively improves the training efficiency over reinforcement learning.

automation & control systems,computer science, cybernetics, artificial intelligence
Learning a World Model With Multitimescale Memory Augmentation

Wenzhe Cai,Teng Wang,Jiawei Wang,Changyin Sun

DOI: https://doi.org/10.1109/tnnls.2022.3151412

IF: 14.255

2022-01-01

IEEE Transactions on Neural Networks and Learning Systems

Abstract:Model-based reinforcement learning (RL) is regarded as a promising approach to tackle the challenges that hinder model-free RL. The success of model-based RL hinges critically on the quality of the predicted dynamic models. However, for many real-world tasks involving high-dimensional state spaces, current dynamics prediction models show poor performance in long-term prediction. To that end, we propose a novel two-branch neural network architecture with multi-timescale memory augmentation to handle long-term and short-term memory differently. Specifically, we follow previous works to introduce a recurrent neural network architecture to encode history observation sequences into latent space, characterizing the long-term memory of agents. Different from previous works, we view the most recent observations as the short-term memory of agents and employ them to directly reconstruct the next frame to avoid compounding error. This is achieved by introducing a self-supervised optical flow prediction structure to model the action-conditional feature transformation at pixel level. The reconstructed observation is finally augmented by the long-term memory to ensure semantic consistency. Experimental results show that our approach is able to generate visually-realistic long-term predictions in DeepMind maze navigation games, and outperforms the prevalent state-of-the-art methods in prediction accuracy by a large margin. Furthermore, we also evaluate the usefulness of our world model by using the predicted frames to drive an imagination-augmented exploration strategy to improve the model-free RL controller.

computer science, artificial intelligence, theory & methods,engineering, electrical & electronic, hardware & architecture
Augmented Replay Memory in Reinforcement Learning With Continuous Control

Mirza Ramicic,Andrea Bonarini

DOI: https://doi.org/10.1109/TCDS.2021.3050723

2019-12-30

Abstract:Online reinforcement learning agents are currently able to process an increasing amount of data by converting it into a higher order value functions. This expansion of the information collected from the environment increases the agent's state space enabling it to scale up to a more complex problems but also increases the risk of forgetting by learning on redundant or conflicting data. To improve the approximation of a large amount of data, a random mini-batch of the past experiences that are stored in the replay memory buffer is often replayed at each learning step. The proposed work takes inspiration from a biological mechanism which act as a protective layer of human brain higher cognitive functions: active memory consolidation mitigates the effect of forgetting of previous memories by dynamically processing the new ones. The similar dynamics are implemented by a proposed augmented memory replay AMR capable of optimizing the replay of the experiences from the agent's memory structure by altering or augmenting their relevance. Experimental results show that an evolved AMR augmentation function capable of increasing the significance of the specific memories is able to further increase the stability and convergence speed of the learning algorithms dealing with the complexity of continuous action domains.

Machine Learning,Artificial Intelligence,Neural and Evolutionary Computing
Attentive Relational State Representation in Decentralized Multiagent Reinforcement Learning.

Xiangyu Liu,Ying Tan

DOI: https://doi.org/10.1109/tcyb.2020.2979803

IF: 11.8

2022-01-01

IEEE Transactions on Cybernetics

Abstract:In multiagent reinforcement learning (MARL), it is crucial for each agent to model the relation with its neighbors. Existing approaches usually resort to concatenate the features of multiple neighbors, fixing the size and the identity of the inputs. But these settings are inflexible and unscalable. In this article, we propose an attentive relational encoder (ARE), which is a novel scalable feedforward neural module, to attentionally aggregate an arbitrary-sized neighboring feature set for state representation in the decentralized MARL. The ARE actively selects the relevant information from the neighboring agents and is permutation invariant, computationally efficient, and flexible to interactive multiagent systems. Our method consistently outperforms the latest competing decentralized MARL methods in several multiagent tasks. In particular, it shows strong cooperative performance in challenging StarCraft micromanagement tasks and achieves over a 96% winning rate against the most difficult noncheating built-in artificial intelligence bots.
Joint Optimization of Sensing, Decision-making and Motion-controlling for Autonomous Vehicles: A Deep Reinforcement Learning Approach

Longquan Chen,Ying He,Qiang Wang,Weike Pan,Zhong Ming

DOI: https://doi.org/10.1109/tvt.2022.3150793

IF: 6.8

2022-01-01

IEEE Transactions on Vehicular Technology

Abstract:The three main modules of autonomous vehicles, i.e., sensing, decision making, and motion controlling, have been studied separately in most existing works on autonomous driving, which overlook the correlations among these modules, leading to a result of unsatisfactory performance. In this paper, we propose a novel scheme that first tactfully processes the sensing data, then jointly learns and optimizes the decision-making and motion-controlling using reinforcement learning (RL). Specifically, the proposed scheme designs a novel state representation mechanism, where the sensing data goes through the attention layer and the convolutional neural network (CNN) layer sequentially. The attention layer focuses on extracting the most important local information and then CNN layer takes a broad view to comprehensively consider the global information for a better representation. Furthermore, the proposed scheme jointly learns decision-making and motion-controlling, therefore, the relevance of these two modules is implicitly considered, which helps to achieve a better autonomous driving policy. Extensive simulation results show that the proposed scheme is better than classic control methods and some RL methods in terms of safety, velocity, etc. We also demonstrate the respective functions of the attention layer and the CNN layer through ablation studies. Finally, we construct a traffic scene with a real autonomous vehicle, and verified the feasibility of the proposed scheme.

telecommunications,engineering, electrical & electronic,transportation science & technology
VMAV-C: A Deep Attention-based Reinforcement Learning Algorithm for Model-based Control

Xingxing Liang,Qi Wang,Yanghe Feng,Zhong Liu,Jincai Huang

DOI: https://doi.org/10.48550/arXiv.1812.09968

IF: 5.414

2018-12-24

Machine Learning

Abstract:Recent breakthroughs in Go play and strategic games have witnessed the great potential of reinforcement learning in intelligently scheduling in uncertain environment, but some bottlenecks are also encountered when we generalize this paradigm to universal complex tasks. Among them, the low efficiency of data utilization in model-free reinforcement algorithms is of great concern. In contrast, the model-based reinforcement learning algorithms can reveal underlying dynamics in learning environments and seldom suffer the data utilization problem. To address the problem, a model-based reinforcement learning algorithm with attention mechanism embedded is proposed as an extension of World Models in this paper. We learn the environment model through Mixture Density Network Recurrent Network(MDN-RNN) for agents to interact, with combinations of variational auto-encoder(VAE) and attention incorporated in state value estimates during the process of learning policy. In this way, agent can learn optimal policies through less interactions with actual environment, and final experiments demonstrate the effectiveness of our model in control problem.
Exploring unknown environments: motivated developmental learning for autonomous navigation of mobile robots

Yuyang Zhou,Dongshu Wang,Lei Liu

DOI: https://doi.org/10.1007/s11370-023-00504-3

2024-01-30

Intelligent Service Robotics

Abstract:How to realize flexible behavior decision making is an important prerequisite for mobile robots to perform various tasks. To solve the problems of poor real-time performance and adaptability of traditional methods, this paper proposes a method that simulates cerebellar function through developmental network, and simulates the function of "what" and "where" channels in the visual system as well as the neuromodulatory mechanisms of dopamine and serotonin, so as to improve the adaptability of cerebellar model to behavioral decision making under supervised learning strategies. At the same time, this paper pays special attention to the strategy of simulating cerebellar reinforcement learning. By simulating the sleep recall mechanism of hippocampus and the neuromodulatory mechanism of acetylcholine and norepinephrine, mobile robots can have continuous and stable learning ability in unfamiliar environment, and improve the real-time and adaptability of their behavioral decision making. Simulation results in both static and dynamic environments, as well as the results in the static physical environment, validate the potential of this model, indicating that the cerebellar model based on reinforcement learning plays an important role in the behavioral decision making of mobile robots.

robotics
Integrated model of cerebellal supervised learning and basal ganglia's reinforcement learning for mobile robot behavioral decision-making

Zhiqiang Wu,Dongshu Wang,Lei Liu

DOI: https://doi.org/10.1016/j.cogsys.2024.101302

IF: 4.541

2024-11-01

Cognitive Systems Research

Abstract:Behavioral decision-making in unknown environments of mobile robots is a crucial research topic in robotics. Inspired by the working mechanism of different brain regions in mammals, this paper designed a new hybrid model integrating the functions of cerebellum and basal ganglia by simulating the memory replay of hippocampus, so as to realize the autonomous behavioral decision-making of robot in unknown environments. A reinforcement learning module based on Actor-Critic framework and a developmental network module are used to simulate the functions of the basal ganglia and cerebellum, respectively. Considering the different functions of D1 and D2 dopamine receptors in basal ganglia, an Actor network module with separate learning of positive and negative rewards is designed for the basal ganglia to realize efficient exploration of the environments by the agent. According to the characteristics of biological memory, a physiological memory priority index is designed for hippocampus memory replay, which improves the offline learning efficiency of cerebellum. The integrated model enables dynamic switching between decisions made by cerebellum and basal ganglia based on the agent's cognitive level with respect to the environment. Finally, the effectiveness of the proposed model is verified through experiments on agent navigation in both simulation and real environments, as well as through performance comparison experiments with other learning algorithms.

psychology, experimental,neurosciences,computer science, artificial intelligence
Neural Episodic Control with State Abstraction

Zhuo Li,Derui Zhu,Yujing Hu,Xiaofei Xie,Lei Ma,Yan Zheng,Yan Song,Yingfeng Chen,Jianjun Zhao

DOI: https://doi.org/10.48550/arXiv.2301.11490

2023-02-20

Abstract:Existing Deep Reinforcement Learning (DRL) algorithms suffer from sample inefficiency. Generally, episodic control-based approaches are solutions that leverage highly-rewarded past experiences to improve sample efficiency of DRL algorithms. However, previous episodic control-based approaches fail to utilize the latent information from the historical behaviors (e.g., state transitions, topological similarities, etc.) and lack scalability during DRL training. This work introduces Neural Episodic Control with State Abstraction (NECSA), a simple but effective state abstraction-based episodic control containing a more comprehensive episodic memory, a novel state evaluation, and a multi-step state analysis. We evaluate our approach to the MuJoCo and Atari tasks in OpenAI gym domains. The experimental results indicate that NECSA achieves higher sample efficiency than the state-of-the-art episodic control-based approaches. Our data and code are available at the project website\footnote{\url{<a class="link-external link-https" href="https://sites.google.com/view/drl-necsa" rel="external noopener nofollow">this https URL</a>}}.

Machine Learning,Artificial Intelligence,Neural and Evolutionary Computing
Efficient Replay Memory Architectures in Multi-Agent Reinforcement Learning for Traffic Congestion Control

Mukul Chodhary,Kevin Octavian,SooJean Han

2024-07-23

Abstract:Episodic control, inspired by the role of episodic memory in the human brain, has been shown to improve the sample inefficiency of model-free reinforcement learning by reusing high-return past experiences. However, the memory growth of episodic control is undesirable in large-scale multi-agent problems such as vehicle traffic management. This paper proposes a novel replay memory architecture called Dual-Memory Integrated Learning, to augment to multi-agent reinforcement learning methods for congestion control via adaptive light signal scheduling. Our dual-memory architecture mimics two core capabilities of human decision-making. First, it relies on diverse types of memory--semantic and episodic, short-term and long-term--in order to remember high-return states that occur often in the network and filter out states that don't. Second, it employs equivalence classes to group together similar state-action pairs and that can be controlled using the same action (i.e., light signal sequence). Theoretical analyses establish memory growth bounds, and simulation experiments on several intersection networks showcase improved congestion performance (e.g., vehicle throughput) from our method.

Systems and Control
Real-Time Progressive Learning: Mutually Reinforcing Learning and Control with Neural-Network-Based Selective Memory

Yiming Fei,Jiangang Li,Yanan Li

DOI: https://doi.org/10.48550/arxiv.2308.04223

2023-01-01

Abstract: Memory, as the basis of learning, determines the storage, update and forgetting of the knowledge and further determines the efficiency of learning. Featured with a mechanism of memory, a radial basis function neural network (RBFNN) based learning control scheme named real-time progressive learning (RTPL) is proposed to learn the unknown dynamics of the system with guaranteed stability and closed-loop performance. Instead of the stochastic gradient descent (SGD) update law in adaptive neural control (ANC), RTPL adopts the selective memory recursive least squares (SMRLS) algorithm to update the weights of the RBFNN. Through SMRLS, the approximation capabilities of the RBFNN are uniformly distributed over the feature space and thus the passive knowledge forgetting phenomenon of SGD method is suppressed. Subsequently, RTPL achieves the following merits over the classical ANC: 1) guaranteed learning capability under low-level persistent excitation (PE), 2) improved learning performance (learning speed, accuracy and generalization capability), and 3) low gain requirement ensuring robustness of RTPL in practical applications. Moreover, the RTPL based learning and control will gradually reinforce each other during the task execution, making it appropriate for long-term learning control tasks. As an example, RTPL is used to address the tracking control problem of a class of nonlinear systems with RBFNN being an adaptive feedforward controller. Corresponding theoretical analysis and simulation studies demonstrate the effectiveness of RTPL.
Influence-aware Memory Architectures for Deep Reinforcement Learning

Miguel Suau,Jinke He,Elena Congeduti,Rolf A.N. Starre,Aleksander Czechowski,Frans A. Oliehoek

DOI: https://doi.org/10.48550/arXiv.1911.07643

2021-02-18

Abstract:Due to its perceptual limitations, an agent may have too little information about the state of the environment to act optimally. In such cases, it is important to keep track of the observation history to uncover hidden state. Recent deep reinforcement learning methods use recurrent neural networks (RNN) to memorize past observations. However, these models are expensive to train and have convergence difficulties, especially when dealing with high dimensional input spaces. In this paper, we propose influence-aware memory (IAM), a theoretically inspired memory architecture that tries to alleviate the training difficulties by restricting the input of the recurrent layers to those variables that influence the hidden state information. Moreover, as opposed to standard RNNs, in which every piece of information used for estimating Q values is inevitably fed back into the network for the next prediction, our model allows information to flow without being necessarily stored in the RNN's internal memory. Results indicate that, by letting the recurrent layers focus on a small fraction of the observation variables while processing the rest of the information with a feedforward neural network, we can outperform standard recurrent architectures both in training speed and policy performance. This approach also reduces runtime and obtains better scores than methods that stack multiple observations to remove partial observability.

Machine Learning
Learning autonomous race driving with action mapping reinforcement learning

Yuanda Wang,Xin Yuan,Changyin Sun

DOI: https://doi.org/10.1016/j.isatra.2024.05.010

IF: 7.3

2024-05-12

ISA Transactions

Abstract:Highlights • The AM mechanism is introduced to RL-based autonomous race driving control problem to address the state-dependent input constraints arising from limited tire-road friction. • The AM mechanism enables the RL-based controller to better utilize the maximum tire-road friction, addressing the conservatism often associated with conventional reward-shaping solutions. • The AM mechanism also allows the learned driving policy to be generalized to different friction conditions by adapting the friction constraint in the action mapping function. • A numerical approximation method is proposed to implement the AM mechanism, overcoming the challenges of dealing with complex nonlinear dynamics with constraints. Autonomous race driving poses a complex control challenge as vehicles must be operated at the edge of their handling limits to reduce lap times while respecting physical and safety constraints. This paper presents a novel reinforcement learning (RL)-based approach, incorporating the action mapping (AM) mechanism to manage state-dependent input constraints arising from limited tire-road friction. A numerical approximation method is proposed to implement AM, addressing the complex dynamics associated with the friction constraints. The AM mechanism also allows the learned driving policy to be generalized to different friction conditions. Experimental results in our developed race simulator demonstrate that the proposed AM-RL approach achieves superior lap times and better success rates compared to the conventional RL-based approaches. The generalization capability of driving policy with AM is also validated in the experiments.

automation & control systems,instruments & instrumentation,engineering, multidisciplinary
Continuous Episodic Control

Zhao Yang,Thomas M. Moerland,Mike Preuss,Aske Plaat

DOI: https://doi.org/10.48550/arXiv.2211.15183

2023-04-23

Abstract:Non-parametric episodic memory can be used to quickly latch onto high-rewarded experience in reinforcement learning tasks. In contrast to parametric deep reinforcement learning approaches in which reward signals need to be back-propagated slowly, these methods only need to discover the solution once, and may then repeatedly solve the task. However, episodic control solutions are stored in discrete tables, and this approach has so far only been applied to discrete action space problems. Therefore, this paper introduces Continuous Episodic Control (CEC), a novel non-parametric episodic memory algorithm for sequential decision making in problems with a continuous action space. Results on several sparse-reward continuous control environments show that our proposed method learns faster than state-of-the-art model-free RL and memory-augmented RL algorithms, while maintaining good long-run performance as well. In short, CEC can be a fast approach for learning in continuous control tasks.

Machine Learning,Artificial Intelligence,Robotics
Cognitive Radar Using Reinforcement Learning in Automotive Applications

Pengfei Liu,Yimin Liu,Tianyao Huang,Yuxiang Lu,Xiqin Wang

DOI: https://doi.org/10.1109/TAES.2020.3011869

2020-07-16

Abstract:The concept of cognitive radar (CR) enables radar systems to achieve intelligent adaption to a changeable environment with feedback facility from receiver to transmitter. However, the implementation of CR in a fast-changing environment usually requires a well-known environmental model. In our work, we stress the learning ability of CR in an unknown environment using a combination of CR and reinforcement learning (RL), called RL-CR. Less or no model of the environment is required. We also apply the general RL-CR to a specific problem of automotive radar spectrum allocation to mitigate mutual interference. Using RL-CR, each vehicle can autonomously choose a frequency subband according to its own observation of the environment. Since radar's single observation is quite limited compared to the overall information of the environment, a long short-term memory (LSTM) network is utilized so that radar can decide the next transmitted subband by aggregating its observations over time. Compared with centralized spectrum allocation approaches, our approach has the advantage of reducing communication between vehicles and the control center. It also outperforms some other distributive frequency subband selecting policies in reducing interference under certain circumstances.

Signal Processing
Reinforcement learning-based consensus control for MASs with intermittent constraints

Ao Luo,Qi Zhou,Hongru Ren,Hui Ma,Renquan Lu

DOI: https://doi.org/10.1016/j.neunet.2024.106105

IF: 7.8

2024-01-07

Neural Networks

Abstract:In this article, an adaptive optimal consensus control problem is studied for multiagent systems in the strict-feedback structure with intermittent constraints (the constraints appear intermittently). More specifically, by designing a novel switch-like function and an improved coordinate transformation, the constrained states are converted into unconstrained states, and the problem of intermittent constraints is resolved without requiring "feasibility conditions". In addition, using the composite learning algorithm and neural networks to construct the identifier, a simplified identifier-actor-critic-based reinforcement learning strategy is proposed to obtain the approximate optimal controller under the framework of backstepping. Meanwhile, with the aid of the nonlinear dynamic surface control technique, the issue of "explosion of complexity" in backstepping is removed, and the requirements for filter parameters are loosened. Based on Lyapunov stability theory, it is demonstrated that all signals in the closed-loop system are bounded. Finally, two simulation examples are used to verify the effectiveness of the proposed method.

computer science, artificial intelligence,neurosciences

Reinforcement learning control with associative memory

Model-Based Reinforcement Learning Via Imagination with Derived Memory.

Episodic Reinforcement Learning with Associative Memory.

Learning Controllable Elements Oriented Representations for Reinforcement Learning

Online Learning Control of an Intelligent Mobility Aid Using CMAC Neural Network

Multi-ASV Coordinated Tracking With Unknown Dynamics and Input Underactuation via Model-Reference Reinforcement Learning Control

Learning a World Model With Multitimescale Memory Augmentation

Augmented Replay Memory in Reinforcement Learning With Continuous Control

Attentive Relational State Representation in Decentralized Multiagent Reinforcement Learning.

Joint Optimization of Sensing, Decision-making and Motion-controlling for Autonomous Vehicles: A Deep Reinforcement Learning Approach

VMAV-C: A Deep Attention-based Reinforcement Learning Algorithm for Model-based Control

Exploring unknown environments: motivated developmental learning for autonomous navigation of mobile robots

Integrated model of cerebellal supervised learning and basal ganglia's reinforcement learning for mobile robot behavioral decision-making

Neural Episodic Control with State Abstraction

Efficient Replay Memory Architectures in Multi-Agent Reinforcement Learning for Traffic Congestion Control

Real-Time Progressive Learning: Mutually Reinforcing Learning and Control with Neural-Network-Based Selective Memory

Influence-aware Memory Architectures for Deep Reinforcement Learning

Learning autonomous race driving with action mapping reinforcement learning

Continuous Episodic Control

Cognitive Radar Using Reinforcement Learning in Automotive Applications

Reinforcement learning-based consensus control for MASs with intermittent constraints