Abstract:Goal-oriented Learning path recommendation aims to recommend learning items (concepts or exercises) step-by-step to a learner to promote the mastery level of her specific learning goals. By formulating this task as a Markov decision process, reinforcement learning (RL) methods have demonstrated great power. Although extensive research efforts have been made, previous methods still fail to recommend effective goal-oriented paths due to the under-utilizing of goals. Specifically, it is mainly reflected in two aspects: (1)The lack of goal planning. When learners have multiple goals with different difficulties, the previous methods can't fully utilize the difficulties and dependencies between goal learning items to plan the sequence of achieving these goals, making the path chaotic and inefficient; (2)The lack of efficiency in goal achieving. When pursuing a single goal, the path may contain learning items unrelated to the goal, which makes realizing a certain goal inefficient. To address these challenges, we present a novel Graph Enhanced Hierarchical Reinforcement Learning (GEHRL) framework for goal-oriented learning path recommendation. The framework divides learning path recommendation into two parts: sub-goal selection(planning) and sub-goal achieving(learning item recommendation). Specifically, we employ a high-level agent as a sub-goal selector to select sub-goals for the low-level agent to achieve. The low-level agent in the framework is to recommend learning items to the learner. To make the path only contain goal-related learning items to improve the efficiency of achieving the goal, we develop a graph-based candidate selector to constrain the action space of the low-level agent based on the sub-goal and knowledge graph. We also develop test-based internal reward for low-level training so that the sparsity problem of external reward can be alleviated. Extensive experiments on three different simulators demonstrate our framework achieves state-of-the-art performance.

Learning Hierarchical Graph-Based Policy for Goal-Reaching in Unknown Environments

Predictive Hierarchical Reinforcement Learning for Path-Efficient Mapless Navigation with Moving Target.

RGBD-based Image Goal Navigation with Pose Drift: A Topo-metric Graph Based Approach

Goal-Reaching Policy Learning from Non-Expert Observations via Effective Subgoal Guidance

Robot Subgoal-guided Navigation in Dynamic Crowded Environments with Hierarchical Deep Reinforcement Learning

Hierarchical and Partially Observable Goal-driven Policy Learning with Goals Relational Graph

Hierarchical Reinforcement Learning Based on Continuous Subgoal Space

Hierarchical Representations and Explicit Memory: Learning Effective Navigation Policies on 3D Scene Graphs using Graph Neural Networks

Effective State Space Exploration with Phase State Graph Generation and Goal-based Path Planning

Autonomous Exploration Under Uncertainty via Deep Reinforcement Learning on Graphs

Multi-robot Navigation with Graph Attention Neural Network and Hierarchical Motion Planning

Hierarchical Relational Graph Learning for Autonomous Multirobot Cooperative Navigation in Dynamic Environments

Efficient Hierarchical Exploration with an Active Subgoal Generation Strategy.

Robot Navigation among External Autonomous Agents Through Deep Reinforcement Learning Using Graph Attention Network

An Enhanced Hierarchical Planning Framework for Multi-Robot Autonomous Exploration

Hierarchical path planner for unknown space exploration using reinforcement learning-based intelligent frontier selection

Hierarchical reinforcement learning for handling sparse rewards in multi-goal navigation

Learning Graph-Enhanced Commander-Executor for Multi-Agent Navigation

Combining Subgoal Graphs with Reinforcement Learning to Build a Rational Pathfinder

Graph Relational Reinforcement Learning for Mobile Robot Navigation in Large-Scale Crowded Environments

Graph Enhanced Hierarchical Reinforcement Learning for Goal-oriented Learning Path Recommendation