Abstract:Hippocampal pyramidal cells and interneurons play a key role in spatial navigation. In goal-directed behavior associated with rewards, the spatial firing pattern of pyramidal cells is modulated by the animal's moving direction toward a reward, with a dependence on auditory, olfactory, and somatosensory stimuli for head orientation. Additionally, interneurons in the CA1 region of the hippocampus monosynaptically connected to CA1 pyramidal cells are modulated by a complex set of interacting brain regions related to reward and recall. The computational method of reinforcement learning (RL) has been widely used to investigate spatial navigation, which in turn has been increasingly used to study rodent learning associated with the reward. The rewards in RL are used for discovering a desired behavior through the integration of two streams of neural activity: trial-and-error interactions with the external environment to achieve a goal, and the intrinsic motivation primarily driven by brain reward system to accelerate learning. Recognizing the potential benefit of the neural representation of this reward design for novel RL architectures, we propose a RL algorithm based on [Formula: see text]-learning with a perspective on biomimetics (neuro-inspired RL) to decode rodent movement trajectories. The reward function, inspired by the neuronal information processing uncovered in the hippocampus, combines the preferred direction of pyramidal cell firing as the extrinsic reward signal with the coupling between pyramidal cell-interneuron pairs as the intrinsic reward signal. Our experimental results demonstrate that the neuro-inspired RL, with a combined use of extrinsic and intrinsic rewards, outperforms other spatial decoding algorithms, including RL methods that use a single reward function. The new RL algorithm could help accelerate learning convergence rates and improve the prediction accuracy for moving trajectories.

End-to-end Visual Navigation with Intrinsic Motivation in 3D Maze-like Environments

End-to-End Autonomous Exploration with Deep Reinforcement Learning and Intrinsic Motivation

A target-driven visual navigation method based on intrinsic motivation exploration and space topological cognition

Curiosity-driven Exploration for Mapless Navigation with Deep Reinforcement Learning

End-to-End Navigation Strategy with Deep Reinforcement Learning for Mobile Robots

Target-driven Indoor Visual Navigation Using Inverse Reinforcement Learning

A Curiosity-Based Autonomous Navigation Algorithm for Maze Robot

Bio-robots Automatic Navigation with Graded Electric Reward Stimulation Based on Reinforcement Learning

Efficient Reinforcement Learning for 3D LiDAR Navigation of Mobile Robot

Target-driven Visual Navigation in Indoor Scenes Using Reinforcement Learning and Imitation Learning

Multigoal Visual Navigation With Collision Avoidance via Deep Reinforcement Learning

Learning to Navigate in Complex Environments

Spiking Reinforcement Learning with Memory Ability for Mapless Navigation

Scheduled Intrinsic Drive: A Hierarchical Take on Intrinsically Motivated Exploration

Discovering Intrinsic Subgoals for Vision-and-Language Navigation via Hierarchical Reinforcement Learning

MGRL: Graph neural network based inference in a Markov network with reinforcement learning for visual navigation

Neuro-Inspired Reinforcement Learning to Improve Trajectory Prediction in Reward-Guided Behavior

Visual Navigation with Multiple Goals Based on Deep Reinforcement Learning

Learning Exploration Policies for Navigation

Image Augmentation Based Momentum Memory Intrinsic Reward for Sparse Reward Visual Scenes

Spatial Consciousness Model of Intrinsic Reward in Partially Observable Environments