Abstract:With the advent of the 6 G era, addressing the increasing demand for mobile computing has become crucial. In the next-generation Internet of Vehicles (IoVs), widespread deployment of edge servers ensures low delay and high reliability for vehicular applications. However, densely deployed edge servers are designed to accommodate peak traffic. This results in unnecessary resource wastage, high maintenance costs, and energy consumption during off-peak hours. Enabling the sleep function of edge servers and dynamically controlling their operating mode is crucial for reducing energy consumption and enabling green IoVs. In this paper, we study the dynamic sleep problem of edge servers in the IoV network and propose traffic-aware intelligent sleep decision-making algorithms based on Deep Reinforcement Learning (DRL). We propose a Centralized DRL-based Dynamic Sleep (CDDS) algorithm, which leverages the deep deterministic policy gradient algorithm to learn the optimal decision policy through environmental interaction. To enhance the stability of agent learning and mitigate the impact of environmental changes, we propose a baseline transformation strategy based on the greedy algorithm. Additionally, to overcome the limitations of CDDS, we combine federated learning with DRL and propose a Federated DRL-based Dynamic Sleep (FDDS) algorithm. This approach speeds up model training and improves the model's generalization ability. Furthermore, we conduct extensive experimental verification using real-world datasets. The experimental results demonstrate that both CDDS and FDDS successfully learn the optimal sleep control policy, leading to system cost reduction of 11.06% to 45.36% and 8.71% to 43.77%, respectively, compared to the baselines.

Rethinking Low-Carbon Edge Computing System Design with Renewable Energy Sharing

Distributed Online Optimization of Edge Computing With Mixed Power Supply of Renewable Energy and Smart Grid

Online Learning for Offloading and Autoscaling in Renewable-Powered Mobile Edge Computing

Energy-effective IoT Services in Balanced Edge-Cloud Collaboration Systems

Cost-Effective Traffic Scheduling and Resource Allocation for Edge Service Provisioning

Energy Efficient Joint Computation Offloading and Service Caching for Mobile Edge Computing: A Deep Reinforcement Learning Approach

Deep reinforcement learning-based resource scheduling for energy optimization and load balancing in SDN-driven edge computing

MADDPG-based joint optimization of task partitioning and computation resource allocation in mobile edge computing

Multi-Agent Meta-Reinforcement Learning for Self-Powered and Sustainable Edge Computing Systems

Distributed Resource Allocation and Load Management for Smart Grid-Powered Edge Computing Systems

Intelligent Decision-Based Edge Server Sleep for Green Computing in MEC-Enabled IoV Networks

Multi-agent deep reinforcement learning based distributed control architecture for interconnected multi-energy microgrid energy management and optimization

Risk-Aware Energy Scheduling for Edge Computing With Microgrid: A Multi-Agent Deep Reinforcement Learning Approach

Towards Carbon-Neutral Edge Computing: Greening Edge AI by Harnessing Spot and Future Carbon Markets

Joint Computation Offloading and Demand Response Management in Mobile Edge Network With Renewable Energy Sources

Energy-Efficient Space–Air–Ground Integrated Edge Computing for Internet of Remote Things: A Federated DRL Approach

Hybrid Decision Based Deep Reinforcement Learning for Energy Harvesting Enabled Mobile Edge Computing.

Edge-cloud collaboration for low-latency, low-carbon, and cost-efficient operations

Real-time Energy Management of a Low-Carbon Micro-Grid Based on Deep Reinforcement Learning

Delay-aware and Energy-Efficient Computation Offloading in Mobile Edge Computing Using Deep Reinforcement Learning

Adaptive Resource Management for Edge Network Slicing using Incremental Multi-Agent Deep Reinforcement Learning