Abstract:The growing IoT landscape requires effective server deployment strategies to meet demands including real-time processing and energy efficiency. This is complicated by heterogeneous, dynamic applications and servers. To address these challenges, we propose ReinFog, a modular distributed software empowered with Deep Reinforcement Learning (DRL) for adaptive resource management across edge/fog and cloud environments. ReinFog enables the practical development/deployment of various centralized and distributed DRL techniques for resource management in edge/fog and cloud computing environments. It also supports integrating native and library-based DRL techniques for diverse IoT application scheduling objectives. Additionally, ReinFog allows for customizing deployment configurations for different DRL techniques, including the number and placement of DRL Learners and DRL Workers in large-scale distributed systems. Besides, we propose a novel Memetic Algorithm for DRL Component (e.g., DRL Learners and DRL Workers) Placement in ReinFog named MADCP, which combines the strengths of Genetic Algorithm, Firefly Algorithm, and Particle Swarm Optimization. Experiments reveal that the DRL mechanisms developed within ReinFog have significantly enhanced both centralized and distributed DRL techniques implementation. These advancements have resulted in notable improvements in IoT application performance, reducing response time by 45%, energy consumption by 39%, and weighted cost by 37%, while maintaining minimal scheduling overhead. Additionally, ReinFog exhibits remarkable scalability, with a rise in DRL Workers from 1 to 30 causing only a 0.3-second increase in startup time and around 2 MB more RAM per Worker. The proposed MADCP for DRL component placement further accelerates the convergence rate of DRL techniques by up to 38%.

Enhanced decision-making in healthcare cloud-edge networks using deep reinforcement and lion optimization algorithm

Efficient Ring-Topology Decentralized Federated Learning with Deep Generative Models for Medical Data in Ehealthcare Systems

Online Learning for Orchestration of Inference in Multi-User End-Edge-Cloud Networks

DRL-based dependent task offloading with delay-energy tradeoff in medical image edge computing

Scheduling of Low-Latency Medical Services in Healthcare Cloud with Deep Reinforcement Learning

An Advanced Deep Reinforcement Learning Algorithm for Three-layer D2D-Edge-Cloud Computing Architecture for Efficient Task Offloading in Internet of Things

A DRL-Driven Intelligent Optimization Strategy for Resource Allocation in Cloud-Edge-End Cooperation Environments

ReinFog: A DRL Empowered Framework for Resource Management in Edge and Cloud Computing Environments

Computation Offloading and Resource Allocation in F-RANs: A Federated Deep Reinforcement Learning Approach

Intelligent Decision-Making of Load Balancing Using Deep Reinforcement Learning and Parallel PSO in Cloud Environment

A Hybrid Task Offloading and Resource Allocation Approach For Digital Twin-Empowered UAV-Assisted MEC Network Using Federated Reinforcement Learning For Future Wireless Network

Cooperative DNN partitioning for accelerating DNN-empowered disease diagnosis via swarm reinforcement learning

A3C-DO: A Regional Resource Scheduling Framework Based on Deep Reinforcement Learning in Edge Scenario

DRL-Based Distributed Task Offloading Framework in Edge-Cloud Environment

Cloud-Edge–End Collaborative Task Offloading in Vehicular Edge Networks: A Multilayer Deep Reinforcement Learning Approach

DeepRLB: A deep reinforcement learning‐based load balancing in data center networks

An enhanced asynchronous advantage actor-critic-based algorithm for performance optimization in mobile edge computing -enabled internet of vehicles networks

Hybrid Learning for Orchestrating Deep Learning Inference in Multi-user Edge-cloud Networks

Optimal Flow Admission Control in Edge Computing via Safe Reinforcement Learning

Optimal Computation Resource Allocation in Energy-Efficient Edge IoT Systems with Deep Reinforcement Learning

A Safe Deep Reinforcement Learning Approach for Energy Efficient Federated Learning in Wireless Communication Networks