Abstract:Extensive research has been carried out on reinforcement learning methods. The core idea of reinforcement learning is to learn methods by means of trial and error, and it has been successfully applied to robotics, autonomous driving, gaming, healthcare, resource management, and other fields. However, when building reinforcement learning solutions at the edge, not only are there the challenges of data-hungry and insufficient computational resources but also there is the difficulty of a single reinforcement learning method to meet the requirements of the model in terms of efficiency, generalization, robustness, and so on. These solutions rely on expert knowledge for the design of edge-side integrated reinforcement learning methods, and they lack high-level system architecture design to support their wider generalization and application. Therefore, in this paper, instead of surveying reinforcement learning systems, we survey the most commonly used options for each part of the architecture from the point of view of integrated application. We present the characteristics of traditional reinforcement learning in several aspects and design a corresponding integration framework based on them. In this process, we show a complete primer on the design of reinforcement learning architectures while also demonstrating the flexibility of the various parts of the architecture to be adapted to the characteristics of different edge tasks. Overall, reinforcement learning has become an important tool in intelligent decision making, but it still faces many challenges in the practical application in edge computing. The aim of this paper is to provide researchers and practitioners with a new, integrated perspective to better understand and apply reinforcement learning in edge decision-making tasks.

Towards Efficient Long-Horizon Decision-Making Using Automated Structure Search Method of Hierarchical Reinforcement Learning for Edge Artificial Intelligence

Causality-driven Hierarchical Structure Discovery for Reinforcement Learning

How to Design Reinforcement Learning Methods for the Edge: An Integrated Approach toward Intelligent Decision Making

Mobile Robot Sequential Decision Making Using a Deep Reinforcement Learning Hyper-Heuristic Approach

Effective Reinforcement Learning Based on Structural Information Principles

Data-Efficient Hierarchical Reinforcement Learning for Robotic Assembly Control Applications

Hierarchical Reinforcement Learning from Demonstration via Reachability-Based Reward Shaping

Autonomous Decision-making of Searching and Rescue Robots Based on Off-policy Hierarchical Reinforcement Learning in a Complex Interactive Environment

Knowledge Distillation-Based Edge-Decision Hierarchies for Interactive Behavior-Aware Planning in Autonomous Driving System

Past Data-Driven Adaptation in Hierarchical Reinforcement Learning

Hierarchical Reinforcement Learning in Complex 3D Environments

Adaptive Decision Making at the Intersection for Autonomous Vehicles Based on Skill Discovery

Hierarchical Deep Reinforcement Learning for Computation Offloading in Autonomous Multi-Robot Systems

Deep Reinforcement Learning with Hierarchical Structures.

HDPlanner: Advancing Autonomous Deployments in Unknown Environments through Hierarchical Decision Networks

Advances in Hierarchical Reinforcement Learning

Fast Robot Hierarchical Exploration Based on Deep Reinforcement Learning

A Hierarchical Reinforcement Learning-Aware Hyper-Heuristic Algorithm with Fitness Landscape Analysis

Deep Reinforcement Learning for Online Resource Allocation in IoT Networks: Technology, Development, and Future Challenges

Incentive-Driven Long-term Optimization for Edge Learning by Hierarchical Reinforcement Mechanism