Abstract:With the advent of the Internet of Things (IoT) paradigm and the prolific growth in technology, the volume of data generated by intelligent devices has increased tremendously. Cloud computing provides unlimited processing and storage capabilities to process and store the generated data. However, the cloud computing paradigm is associated with high transmission latency, high energy consumption, and a lack of location awareness. On the other hand, the data generated by the intelligent devices is delay-sensitive and needs to be processed on the fly. Thus, cloud computing isn't suitable for the execution of this delay-sensitive data. To curtail the issues associated with the cloud paradigm, the fog paradigm, which allows data to be processed at the proximity of IoT devices, was introduced. One common feature of the fog paradigm is its limitations in capabilities, which make it unsuitable for processing large volumes of data. To ensure the smooth execution of delay-sensitive application tasks and the large volume of data generated, there is a need for the fog paradigm to collaborate with the cloud paradigm to achieve a common goal. In this paper, an efficient resource allocation framework is proposed to efficiently and effectively utilise the fog and cloud resources for executing delay-sensitive tasks and the huge volume of data generated by end users. The allocation of resources to tasks is done in two stages. Firstly, the tasks in the arrival queue are classified based on the task guarantee ratio on the cloud and fog layers and allocated to suitable resources in the layers of their respective classes. Secondly, we apply Bayes' classifier to previous allocation history data to classify newly arrived tasks and allocate suitable resources to the tasks for execution in the layers of their respective classes. A Crayfish Optimization Algorithm (COA) is used to generate an optimal resource allocation in both the fog and cloud layers that reduces the delay and execution time of the system. The proposed method is implemented using the iFogSim simulator toolkit, and the execution results prove more promising in comparison with the state-of-the-art methods.

Reinforcement Learning-based Resource Allocation in Fog RAN for IoT with Heterogeneous Latency Requirements

Deep Reinforcement Learning Based Resource Allocation for Content Distribution in Fog Radio Access Networks

Resource Allocation in Uplink NOMA-IoT Networks: A Reinforcement-Learning Approach

Computation Offloading and Resource Allocation in F-RANs: A Federated Deep Reinforcement Learning Approach

Deep Reinforcement Learning Based Mode Selection and Resource Management for Green Fog Radio Access Networks

Online Reinforcement Learning of X-Haul Content Delivery Mode in Fog Radio Access Networks

Computational Resource Constrained Multi-Cell Joint Processing in Fog Radio Access Networks.

Deep Reinforcement Learning for Adaptive Network Slicing in 5G for Intelligent Vehicular Systems and Smart Cities

Multi-objective Resource Allocation for 5G Using Hierarchical Reinforcement Learning

Multi-agent Reinforcement Learning for Resource Allocation in IoT networks with Edge Computing

Deep Reinforcement Learning-Based Resource Allocation for Content Distribution in IoT-Edge-Cloud Computing Environments

Reinforcement learning based task offloading of IoT applications in fog computing: algorithms and optimization techniques

Fragmented Task Scheduling for Load-Balanced Fog Computing Based on Q-Learning

Two-Tier Resource Allocation for Multitenant Network Slicing: A Federated Deep Reinforcement Learning Approach

Joint Radio Resource Allocation and Beamforming Optimization for Industrial Internet of Things in Software-Defined Networking-Based Virtual Fog-Radio Access Network 5G-and-Beyond Wireless Environments

Deep Reinforcement Learning for Online Resource Allocation in IoT Networks: Technology, Development, and Future Challenges

An Efficient IoT-Fog-Cloud Resource Allocation Framework Based on Two-Stage Approach

Joint Allocation of Radio and Fronthaul Resources in Multi-Wavelength-Enabled C-RAN Based on Reinforcement Learning

Reinforcement Learning Based Resource Allocation for Network Slices in O-RAN Midhaul

Fully Distributed Fog Load Balancing with Multi-Agent Reinforcement Learning

ReinFog: A DRL Empowered Framework for Resource Management in Edge and Cloud Computing Environments