Abstract:The growing IoT landscape requires effective server deployment strategies to meet demands including real-time processing and energy efficiency. This is complicated by heterogeneous, dynamic applications and servers. To address these challenges, we propose ReinFog, a modular distributed software empowered with Deep Reinforcement Learning (DRL) for adaptive resource management across edge/fog and cloud environments. ReinFog enables the practical development/deployment of various centralized and distributed DRL techniques for resource management in edge/fog and cloud computing environments. It also supports integrating native and library-based DRL techniques for diverse IoT application scheduling objectives. Additionally, ReinFog allows for customizing deployment configurations for different DRL techniques, including the number and placement of DRL Learners and DRL Workers in large-scale distributed systems. Besides, we propose a novel Memetic Algorithm for DRL Component (e.g., DRL Learners and DRL Workers) Placement in ReinFog named MADCP, which combines the strengths of Genetic Algorithm, Firefly Algorithm, and Particle Swarm Optimization. Experiments reveal that the DRL mechanisms developed within ReinFog have significantly enhanced both centralized and distributed DRL techniques implementation. These advancements have resulted in notable improvements in IoT application performance, reducing response time by 45%, energy consumption by 39%, and weighted cost by 37%, while maintaining minimal scheduling overhead. Additionally, ReinFog exhibits remarkable scalability, with a rise in DRL Workers from 1 to 30 causing only a 0.3-second increase in startup time and around 2 MB more RAM per Worker. The proposed MADCP for DRL component placement further accelerates the convergence rate of DRL techniques by up to 38%.

REAM: A Framework for Resource Efficient Adaptive Monitoring of Community Spaces

RECL: Responsive Resource-Efficient Continuous Learning for Video Analytics

AyE-Edge: Automated Deployment Space Search Empowering Accuracy Yet Efficient Real-Time Object Detection on the Edge

ERAM-EE: Efficient resource allocation and management strategies with energy efficiency under fog–internet of things environments

R-ACP: Real-Time Adaptive Collaborative Perception Leveraging Robust Task-Oriented Communications

ACES -- Automatic Configuration of Energy Harvesting Sensors with Reinforcement Learning

Adaptive Sensor Placement Inspired by Bee Foraging: Towards Efficient Environment Monitoring

A survey on autonomous environmental monitoring approaches: towards unifying active sensing and reinforcement learning

ERSAM: Neural Architecture Search For Energy-Efficient and Real-Time Social Ambiance Measurement

IoT-based framework for optimizing energy efficiency and reliability in acoustic sensor networks using mobile sinks

Exploring Scalable, Distributed Real-Time Anomaly Detection for Bridge Health Monitoring

AMREF: an Adaptive MapReduce Framework for Real Time Applications

Optimized Edge-Cloud System for Activity Monitoring Using Knowledge Distillation

Resilient Monitoring in Heterogeneous Multi-Robot Systems Through Network Reconfiguration

AoI-Oriented Resource Allocation for NOMA-Based Wireless Powered Cognitive Radio Networks Based on Multi-Agent Deep Reinforcement Learning

Context-Aware Collaborative-Intelligence with Spatio-Temporal In-Sensor-Analytics in a Large-Area IoT Testbed

Iraf: A Deep Reinforcement Learning Approach for Collaborative Mobile Edge Computing IoT Networks.

Streaming Video Analytics On The Edge With Asynchronous Cloud Support

ReinFog: A DRL Empowered Framework for Resource Management in Edge and Cloud Computing Environments

Swarm Reinforcement Learning For Adaptive Mesh Refinement