Abstract:Reinforcement learning (RL) addresses complex sequential decision-making problems through interactive trial-and-error and the handling of delayed rewards. However, reinforcement learning typically starts from scratch, necessitating extensive exploration, which results in low learning efficiency. In contrast, humans often leverage prior knowledge to learn. Inspired by this, this paper proposes a semantic knowledge-guided reinforcement learning method (KFDQN), which fully utilizes knowledge to influence reinforcement learning, thereby improving learning efficiency, training stability, and performance. In terms of knowledge representation, considering the strong fuzziness of semantic knowledge, a fuzzy system is constructed to represent this knowledge. In terms of knowledge integration, a knowledge-guided framework that integrates a hybrid action selection strategy (HYAS), a hybrid learning method (HYL), and knowledge updating is constructed in conjunction with the existing reinforcement learning framework. The HYAS integrates knowledge into action selection, reducing the randomness of traditional exploration methods. The HYL incorporates knowledge into the learning target, thereby reducing uncertainty in the learning objective. Knowledge updating ensures that new data is utilized to update knowledge, avoiding the negative impact of knowledge limitations on the learning process. The algorithm is validated through numerical tasks in OpenAI Gym and real-world mobile robot Goal Reach and obstacle avoidance tasks. The results confirm that the algorithm effectively combines knowledge and reinforcement learning, resulting in a 28.6% improvement in learning efficiency, a 19.56% enhancement in performance, and increased training stability.

Playing a Strategy Game with Knowledge-Based Reinforcement Learning

Comparing Knowledge-based Reinforcement Learning to Neural Networks in a Strategy Game

KG-RL: A Knowledge-Guided Reinforcement Learning for Massive Battle Games

Multi-Robot Real-time Game Strategy Learning Based on Deep Reinforcement Learning.

Human-Level Reinforcement Learning through Theory-Based Modeling, Exploration, and Planning

Knowledge Guided Fuzzy Deep Reinforcement Learning

KSRL: Knowledge Selection Based Reinforcement Learning for Knowledge-Grounded Dialogue

Accelerating deep reinforcement learning via knowledge-guided policy network

Robot Representation and Reasoning with Knowledge from Reinforcement Learning

Survey of Reinforcement Learning Based on Human Prior Knowledge

Reinforcement Learning in Game Industry—Review, Prospects and Challenges

Reinforcement Learning with Knowledge Representation and Reasoning: A Brief Survey

An Adaptive Strategy Selection Method With Reinforcement Learning for Robotic Soccer Games.

Learning Macromanagement in Starcraft by Deep Reinforcement Learning

Grounded Reinforcement Learning: Learning to Win the Game under Human Commands

Reinforcement Learning Within the Classical Robotics Stack: A Case Study in Robot Soccer

Research on Action Strategies and Simulations of DRL and MCTS-based Intelligent Round Game

Research and Implementation of Intelligent Decision Based on a Priori Knowledge and DQN Algorithms in Wargame Environment

Exploring Dominant Strategies in Iterated and Evolutionary Games: a Multi-Agent Reinforcement Learning Approach

Reinforcement actor-critic learning as a rehearsal in MicroRTS

Knowledge Graph Reasoning with Self-supervised Reinforcement Learning