Nature of glaucoma in the pseudoexfoliation syndrome.

R. Smith

Abstract:

What problem does this paper attempt to address?

Energy-Aware and URLLC-Aware Task Offloading for Internet of Health Things

Zhao Wang,Zehan Jia,Haijun Liao,Zhenyu Zhou,Xiongwen Zhao,Lei Zhang,Shahid Mumtaz,Joel J. P. C. Rodrigues

DOI: https://doi.org/10.1109/globecom42002.2020.9348237

2020-01-01

Abstract:In the Internet of Health Things based e-Health paradigm, a large number of computational-intensive tasks have to be offloaded from resource-limited IoHT devices to proximal powerful edge servers to reduce latency and improve energy efficiency. However, the lack of global state information (GSI), the ultra-reliable and low-latency communication (URLLC) constraints, and the adversarial competition among IoHT devices have imposed new challenges for task offloading optimization. In this paper, we formulate the task offloading problem as an adversarial multi-armed bandit (MAB) problem. In addition to the average-based performance metrics, bound violation probability of queuing delays and statistical properties of excess values are employed to characterize URLLC constraints. Then, we propose an energy-aware and URLLC-aware Task Offloading scheme based on the exponential-weight algorithm for exploration and exploitation (EXP3) named UTO-EXP3. Guaranteed performance with a bounded deviation can be achieved by UTO-EXP3 based on only local information. The effectiveness and reliability of UTO-EXP3 are validated through simulation results.
Learning-Based URLLC-Aware Task Offloading for Internet of Health Things

Zhenyu Zhou,Zhao Wang,Haijun Yu,Haijun Liao,Shahid Mumtaz,Luís Oliveira,Valerio Frascolla,Luis Oliveira

DOI: https://doi.org/10.1109/jsac.2020.3020680

IF: 16.4

2021-02-01

IEEE Journal on Selected Areas in Communications

Abstract:In the Internet of Health Things (IoHT)-based e-Health paradigm, a large number of computational-intensive tasks have to be offloaded from resource-limited IoHT devices to proximal powerful edge servers to reduce latency and improve energy efficiency. However, the lack of global state information (GSI), the adversarial competition among multiple IoHT devices, and the ultra reliable and low latency communication (URLLC) constraints have imposed new challenges for task offloading optimization. In this article, we formulate the task offloading problem as an adversarial multi-armed bandit (MAB) problem. In addition to the average-based performance metrics, bound violation probability, occurrence probability of extreme events, and statistical properties of excess values are employed to characterize URLLC constraints. Then, we propose a URLLC-aware Task Offloading scheme based on the exponential-weight algorithm for exploration and exploitation (EXP3) named UTO-EXP3. URLLC awareness is achieved by dynamically balancing the URLLC constraint deficits and energy consumption through online learning. We provide a rigorous theoretical analysis to show that guaranteed performance with a bounded deviation can be achieved by UTO-EXP3 based on only local information. Finally, the effectiveness and reliability of UTO-EXP3 are validated through simulation results.

telecommunications,engineering, electrical & electronic
Associative tasks computing offloading scheme in Internet of medical things with deep reinforcement learning

Jiang Fan,Qin Junwei,Liu Lei,Tian Hui

DOI: https://doi.org/10.23919/jcc.fa.2023-0518.202404

2024-04-27

China Communications

Abstract:The Internet of Medical Things (IoMT) is regarded as a critical technology for intelligent healthcare in the foreseeable 6G era. Nevertheless, due to the limited computing power capability of edge devices and task-related coupling relationships, IoMT faces unprecedented challenges. Considering the associative connections among tasks, this paper proposes a computing offloading policy for multiple-user devices (UDs) considering device-to-device (D2D) communication and a multi-access edge computing (MEC) technique under the scenario of IoMT. Specifically, to minimize the total delay and energy consumption concerning the requirement of IoMT, we first analyze and model the detailed local execution, MEC execution, D2D execution, and associated tasks offloading exchange model. Consequently, the associated tasks' offloading scheme of multi-UDs is formulated as a mixed-integer nonconvex optimization problem. Considering the advantages of deep reinforcement learning (DRL) in processing tasks related to coupling relationships, a Double DQN based associative tasks computing offloading (DDATO) algorithm is then proposed to obtain the optimal solution, which can make the best offloading decision under the condition that tasks of UDs are associative. Furthermore, to reduce the complexity of the DDATO algorithm, the cache-aided procedure is intentionally introduced before the data training process. This avoids redundant offloading and computing procedures concerning tasks that previously have already been cached by other UDs. In addition, we use a dynamic ε — greedy strategy in the action selection section of the algorithm, thus preventing the algorithm from falling into a locally optimal solution. Simulation results demonstrate that compared with other existing methods for associative task models concerning different structures in the IoMT network, the proposed algorithm can lower the total cost more effectively and efficiently while also providing a tradeoff between delay and energy consumption tolerance.

telecommunications
Multi-Agent DRL-Based Task Offloading in Multiple RIS-Aided IoV Networks

Bishmita Hazarika,Keshav Singh,Sudip Biswas,Shahid Mumtaz,Chih-Peng Li

DOI: https://doi.org/10.1109/tvt.2023.3302010

IF: 6.8

2023-01-01

IEEE Transactions on Vehicular Technology

Abstract:This article considers an internet of vehicles (IoV) network, where multi-access edge computing (MAEC) servers are deployed at base stations (BSs) aided by multiple reconfigurable intelligent surfaces (RISs) for both uplink and downlink transmission. An intelligent task offloading methodology is designed to optimize the resource allocation scheme in the vehicular network which is based on the state of criticality of the network and the priority and size of tasks. We then develop a multi-agent deep reinforcement learning (MA-DRL) framework using the Markov game for optimizing the task offloading decision strategy. The proposed algorithm maximizes the mean utility of the IoV network and improves communication quality. Extensive numerical results were performed that demonstrate that the RIS-assisted IoV network using the proposed MA-DRL algorithm achieves higher utility than current state-of-the art networks (not aided by RISs) and other baseline DRL algorithms, namely soft actor-critic (SAC), deep deterministic policy gradient (DDPG), twin delayed DDPG (TD3). The proposed method improves the offloading data rate of the tasks, reduces the mean delay and ensures that a higher percentage of offloaded tasks are completed compared to that of other DRL-based and non-RIS-assisted IoV frameworks.

telecommunications,engineering, electrical & electronic,transportation science & technology
Energy-Efficient Space–Air–Ground Integrated Edge Computing for Internet of Remote Things: A Federated DRL Approach

Yi Liu,Li Jiang,Qi Qi,Shengli Xie

DOI: https://doi.org/10.1109/jiot.2022.3220677

IF: 10.6

2023-03-11

IEEE Internet of Things Journal

Abstract:Space–air–ground integrated edge computing is expecting to provide pervasive computation services for Internet of Things (IoT), especially in remote areas. However, the offloading process of power-limited IoT devices is a challenge issue due to unreliable communications in an aerial environment. In this article, we propose an energy-efficient space–air–ground integrated edge computing network architecture, in which the IoT devices choose the most appropriate LEO satellites or unmanned aerial vehicles (UAVs) for task offloading according to their energy level, communication conditions and computing capabilities. In order to providing efficient task offloading and energy-saving policy under an uncertainty aerial environment, a constrained Markov decision process is employed to formulate the task offloading decision problem and a deep reinforcement learning (DRL)-based algorithm is devised to solve the proposed problem. An adaptive federated DRL-based offloading method is further proposed to find suboptimal offloading decisions by considering the privacy protection and communication failure in the proposed network. Numerical results confirm the effectiveness of the proposed schemes on energy saving and computation efficiency.

computer science, information systems,telecommunications,engineering, electrical & electronic
Deep Reinforcement Learning Based Massive Access Management for Ultra-Reliable Low-Latency Communications

Helin Yang,Zehui Xiong,Jun Zhao,Dusit Niyato,Chau Yuen,Ruilong Deng

DOI: https://doi.org/10.1109/twc.2020.3046262

IF: 10.4

2021-01-01

IEEE Transactions on Wireless Communications

Abstract:With the rapid deployment of the Internet of Things (IoT), fifth-generation (5G) and beyond 5G networks are required to support massive access of a huge number of devices over limited radio spectrum radio. In wireless networks, different devices have various quality-of-service (QoS) requirements, ranging from ultra-reliable low latency communications (URLLC) to high transmission data rates. In this context, we present a joint energy-efficient subchannel assignment and power control approach to manage massive access requests while maximizing network energy efficiency (EE) and guaranteeing different QoS requirements. The latency constraint is transformed into a data rate constraint which makes the optimization problem tractable before modelling it as a multi-agent reinforcement learning problem. A distributed cooperative massive access approach based on deep reinforcement learning (DRL) is proposed to address the problem while meeting both reliability and latency constraints on URLLC services in massive access scenario. In addition, transfer learning and cooperative learning mechanisms are employed to enable communication links to work cooperatively in a distributed manner, which enhances the network performance and access success probability. Simulation results clearly show that the proposed distributed cooperative learning approach outperforms other existing approaches in terms of meeting EE and improving the transmission success probability in massive access scenario.
Multi-Agent Deep Reinforcement Learning Based Resource Allocation for Ultra-Reliable Low-Latency Internet of Controllable Things

Yang Xiao,Yuqian Song,Jun Liu

DOI: https://doi.org/10.1109/twc.2022.3233853

IF: 10.4

2023-01-01

IEEE Transactions on Wireless Communications

Abstract:As a promising technology in the 5G era, the artificial intelligence (AI) enabled Internet of controllable things (IoCT) is expected to be an integral part of heterogeneous networks (HetNets) in the future. However, the realization of ultra-reliable low-latency communications (URLLC) in IoCT communications underlaid HetNet has stringent quality of service (QoS) requirements, resulting in unprecedented challenges for existing wireless resource allocation methods. In this paper, we first describe a cellular HetNet model with uplink IoCT communications, then formulate a dynamic mixed-integer nonlinear programming (MINLP) resource allocation problem for maximizing the long-term average energy efficiency under URLLC requirements including reliability, latency, and transmission rate. To solve the problem, we propose a decentralized MADRL-based resource allocation algorithm with a decentralized partially observable Markov decision process (dec-POMDP) and a mixed-centralized-decentralized (MCD) framework to address the partial observability and the scalability issues, respectively. In addition, we design a reward function featuring the objective decomposition, baseline-guided scaling, and QoS violation penalty so that the agents are coordinated. Extensive experiments demonstrate the convergence, scalability, and robustness of the proposed algorithm. Besides, the proposed algorithm substantially outperforms conventional resource allocation methods and different agent communication mechanisms in terms of maximizing energy efficiency.

telecommunications,engineering, electrical & electronic
QDRL: Queue-Aware Online DRL for Computation Offloading in Industrial Internet of Things

Aikun Xu,Zhigang Hu,Xinyu Zhang,Hui Xiao,Hao Zheng,Bolei Chen,Meiguang Zheng,Ping Zhong,Yilin Kang,Keqin Li

DOI: https://doi.org/10.1109/jiot.2023.3316139

IF: 10.6

2023-01-01

IEEE Internet of Things Journal

Abstract:Recently, the Industrial Internet of Things (IIoT) has shown great application value in environmental monitoring. However, it suffers from serious bottlenecks in energy and computing capability. To address them, researchers have made lots of effort. Nevertheless, they neglect either the edge-end collaboration or the impact of task queue backlog, resulting in low system revenue. To this end, we design a Queue-aware computation offloading method based on DRL (QDRL). Specifically, we represent the long-term system operation as a Multi-stage Stochastic Mixed-Integer optimization Problem (M-SMIP), which is further converted into a deterministic problem using Lyapunov optimization. Given that the resource allocation and computation offloading in this deterministic problem are strongly coupled and difficult to solve, we decompose this problem into two subproblems. Subsequently, a reinforcement learning scheme with Actor-Critic architecture is designed to solve these subproblems. The Actor module is designed based on a deep learning model and quantization strategy for generating computation offloading actions. The mathematical reasoning and learning-based methods are integrated as the Critic module for achieving resource allocation. Extensive simulation results show that the performance of QDRL surpasses four baselines and approaches the approximate optimal algorithm in terms of average task queue length, normalized real computation rate, and computation time.

computer science, information systems,telecommunications,engineering, electrical & electronic
Multiagent RL Aided Task Offloading and Resource Management in Wi-Fi 6 and 5G Coexisting Industrial Wireless Environment

Fanqin Zhou,Lei Feng,Michel Kadoch,Peng Yu,Wenjing Li,Zhili Wang

DOI: https://doi.org/10.1109/tii.2021.3106973

IF: 12.3

2022-05-01

IEEE Transactions on Industrial Informatics

Abstract:With the emergence of industrial Internet of Things (IIoT), intensive computation workload will be imposed to industrial end units (IEUs). By leveraging mobile edge computing (MEC), the local computational tasks can be offloaded to servers deployed in mobile edge networks with low latency. This article proposes the intelligent cost-and-energy-effective task offloading in the 5G and Wi-Fi 6 coexisting heterogeneous IIoT networks. The novel joint task scheduling and resource allocation approach comprises the following two parts: a Lyapunov optimization-based component to decide local task scheduling and computing power and an online multiagent reinforcement learning component together with a game theory-based algorithm to select offloading link and decide transmit power, respectively. Simulation results demonstrate the proposed approach holds obvious advantage over the compared "intuition" and "cost optimal" approaches in the efficiency of making comprehensive decision that improves energy efficiency and cost while controlling task delay in the multi-IEU and multiaccess-node MEC systems.

automation & control systems,computer science, interdisciplinary applications,engineering, industrial
DRL-Based Distributed Task Offloading Framework in Edge-Cloud Environment

Heba Nashaat,Walaa Hashem,Rawya Rizk,Radwa Attia

DOI: https://doi.org/10.1109/access.2024.3371993

IF: 3.9

2024-03-09

IEEE Access

Abstract:The Internet of Things (IoT) and real-time media streaming have increased due to the rapid development of wireless communication technologies and the enormous growth of computation and data transmission tasks. Edge-Cloud Computing (ECC) combines the benefits of Mobile Cloud Computing (MCC) and Mobile Edge Computing (MEC) to meet energy consumption and delay requirements, and achieve more stable and affordable task execution. The most significant challenge in ECC is making real-time task offloading decisions. In order to generate offloading decisions in ECC environments in an efficient and near optimal manner, a Deep Reinforcement Learning (DRL)-based Distributed task Offloading (DRL-DO) framework is proposed. The Keras ML library is used to implement and evaluate the proposed DRL-DO and other offloading algorithms in Python experiments. Experimental results demonstrate the accuracy of the DRL-DO framework; it achieves a high Gain Ratio (GR) of about 22.3% and greatly reduces the energy consumption, response time, and system utility by about 7.6%, 43%, and 26.2%, respectively, while attaining moderate time cost compared with other offloading algorithms.

computer science, information systems,telecommunications,engineering, electrical & electronic
A Multi-Agent RL Algorithm for Dynamic Task Offloading in D2D-MEC Network with Energy Harvesting

Xin Mi,Huaiwen He,Hong Shen

DOI: https://doi.org/10.3390/s24092779

IF: 3.9

2024-04-27

Sensors

Abstract:Delay-sensitive task offloading in a device-to-device assisted mobile edge computing (D2D-MEC) system with energy harvesting devices is a critical challenge due to the dynamic load level at edge nodes and the variability in harvested energy. In this paper, we propose a joint dynamic task offloading and CPU frequency control scheme for delay-sensitive tasks in a D2D-MEC system, taking into account the intricacies of multi-slot tasks, characterized by diverse processing speeds and data transmission rates. Our methodology involves meticulous modeling of task arrival and service processes using queuing systems, coupled with the strategic utilization of D2D communication to alleviate edge server load and prevent network congestion effectively. Central to our solution is the formulation of average task delay optimization as a challenging nonlinear integer programming problem, requiring intelligent decision making regarding task offloading for each generated task at active mobile devices and CPU frequency adjustments at discrete time slots. To navigate the intricate landscape of the extensive discrete action space, we design an efficient multi-agent DRL learning algorithm named MAOC, which is based on MAPPO, to minimize the average task delay by dynamically determining task-offloading decisions and CPU frequencies. MAOC operates within a centralized training with decentralized execution (CTDE) framework, empowering individual mobile devices to make decisions autonomously based on their unique system states. Experimental results demonstrate its swift convergence and operational efficiency, and it outperforms other baseline algorithms.

engineering, electrical & electronic,chemistry, analytical,instruments & instrumentation
Deep reinforcement learning based computation offloading for xURLLC services with UAV-assisted IoT-based multi-access edge computing system

Nida Fatima,Paresh Saxena,Giovanni Giambene

DOI: https://doi.org/10.1007/s11276-023-03596-y

IF: 2.701

2023-12-25

Wireless Networks

Abstract:New Internet of Things (IoT) based applications with stricter key performance indicators (KPI) such as round-trip delay, network availability, energy efficiency, spectral efficiency, security, age of information, throughput, and jitter present unprecedented challenges in achieving next-generation ultra-reliable and low-latency communications (xURLLC) for sixth-generation (6 G) communication systems and beyond. In this paper, we aim to collaboratively utilize technologies such as deep reinforcement learning (DRL), unmanned aerial vehicle (UAV), and multi-access edge computing (MEC) to meet the aforementioned KPIs and support the xURLLC services. We present a DRL-empowered UAV-assisted IoT-based MEC system in which a UAV carries a MEC server and provides computation services to IoT devices. Specifically, we have employed twin delay deep deterministic policy gradient (TD3), a DRL algorithm, to find optimal computation offloading policies while simultaneously minimizing both the processing delay and the energy consumption of IoT devices, which inherently influence the KPI requirements. Numerical results illustrate the effectiveness of the proposed approach that can significantly reduce the processing delay and energy consumption, and converge quickly, outperforming the other state-of-the-art DRL-based computation offloading algorithms including Double Deep Q-Network(DDQN) and Deep Deterministic Policy Gradient (DDPG).

computer science, information systems,telecommunications,engineering, electrical & electronic
DRL-based resource optimization in 5G low carbon Power Internet of Things

Min Guo,Zehui Liu,Dongjuan Ma,Weizhe Jing,Wei Gao,Dongbin Li,Xiaojie Liu,Xueqin Zhang

DOI: https://doi.org/10.1093/ijlct/ctae092

IF: 2.3

2024-01-01

International Journal of Low-Carbon Technologies

Abstract:Abstract With 5G-powered Power Internet of Things growing rapidly, power terminal devices struggle with energy limitations in processing computation-intensive tasks, increasing carbon emissions. Task offloading faces spectrum constraints. To address this problem, a nonorthogonal multiple access-based edge computing model is proposed to reduce energy consumption and carbon footprint, in which some terminals act as cluster heads, optimizing energy usage by relaying tasks to base station. To achieve low-carbon development, we propose a joint offloading strategy, channel selection, and power control method to minimize energy consumption and latency. Experimental results show that our proposed method reduces computation and transmission burdens, proving cost superiority.

energy & fuels,thermodynamics
DRL-Based Partial Offloading for Maximizing Sum Computation Rate of Wireless Powered Mobile Edge Computing Network

Shubin Zhang,Hui Gu,Kaikai Chi,Liang Huang,Keping Yu,Shahid Mumtaz

DOI: https://doi.org/10.1109/twc.2022.3188302

IF: 10.4

2022-12-14

IEEE Transactions on Wireless Communications

Abstract:The advanced Internet of Things (IoT) enables more and more interactions between people and machines in the emerging applications, which rely on real-time communication and computing. However, the limited battery capacity and low computing capacity of IoT nodes can hardly support high-performance computing applications. The integration of wireless power transmission (WPT) and mobile edge computing (MEC) is a feasible and promising solution to address the energy shortage and computing capacity limitation of IoT nodes by harvesting radio frequency signal's energy and offloading the nodes' computation tasks to edge computing servers (ECSs). In this work, we focus on the wireless powered MEC network with an ECS and multiple edge devices (EDs), and study the joint optimization of WPT duration, transmission time allocation of each ED and partial offloading decision to maximize the sum computation rate. First, we formulate this as a non-convex problem which is hard to solve. Second, to conquer this problem, we decompose the original offloading problem into the sub-problem of optimizing the offloading time allocation among EDs and the proportion of harvested energy allocated for offloading at each ED under a given WPT duration and the top-problem of optimizing the WPT duration. Finally, we design an online DRL-based framework where one DNN together with its exploration strategy and training strategy is adopted to learn the near-optimal WPT duration and an efficient optimal algorithm is designed to solve the sub-problem. Numerical results show that the DRL-based offloading algorithm achieves the near-maximal sum computation rate while greatly reducing the processing time by at least three orders of magnitude compared with using the solver CVX for the sub-problem and the DNN for the top-problem.

telecommunications,engineering, electrical & electronic
Multi-agent DRL for joint completion delay and energy consumption with queuing theory in MEC-based IIoT

Guowen Wu,Zhiqi Xu,Hong Zhang,Shigen Shen,Shui Yu

DOI: https://doi.org/10.1016/j.jpdc.2023.02.008

IF: 4.542

2023-06-01

Journal of Parallel and Distributed Computing

Abstract:In the Industrial Internet of Things (IIoT), there exist numerous sensor devices with weak computing power and small energy storage. To meet the real-time and big data computing requirements of industrial production, EIIoT (Edge computing-based IIoT) that combines mobile edge computing with IIoT has emerged. It is necessary to offload computing tasks to nearby edge servers for data storage and processing in EIIoT, thus inevitably causing the edge servers to overload. To this end, we propose a jointly constrained optimization model of delay and energy consumption based on queuing theory; this model can effectively solve the task offloading problem in EIIoT. Subsequently, to satisfy the unique offloading requirements of EIIoT, we improve the MAPPO (multi agent proximal policy optimization) algorithm structure to form a lightweight optimal task offloading algorithm called Multi-Agent Deep Reinforcement Learning based on Queuing theory (MAQDRL), which is more suitable for EIIoT. In the algorithm, we systematically integrate queuing theory and use Multi-Agent Deep Reinforcement Learning (MADRL) to obtain the optimal offloading strategy in dynamic and random multiuser offloading environments. We also improve the structure of neural networks of MADRL by analyzing the structural characteristics of the input data. As a result, the algorithm that we proposed exhibits good convergence and exceptional performance in terms of the task arrival rate, bandwidth, energy consumption, latency and other indicators. The simulation results indicate that compared with other classical algorithms, MAQDRL is effective for solving the EIIoT offloading problem.

computer science, theory & methods
Computation Offloading with Multiple Agents in Edge-Computing-Supported IoT

Shihao Shen,Yiwen Han,Xiaofei Wang,Yan Wang

DOI: https://doi.org/10.1145/3372025

2023-08-01

Abstract:With the development of the Internet of Things (IoT) and the birth of various new IoT devices, the capacity of massive IoT devices is facing challenges. Fortunately, edge computing can optimize problems such as delay and connectivity by offloading part of the computational tasks to edge nodes close to the data source. Using this feature, IoT devices can save more resources while still maintaining the quality of service. However, since computation offloading decisions concern joint and complex resource management, we use multiple Deep Reinforcement Learning (DRL) agents deployed on IoT devices to guide their own decisions. Besides, Federated Learning (FL) is utilized to train DRL agents in a distributed fashion, aiming to make the DRL-based decision making practical and further decrease the transmission cost between IoT devices and Edge Nodes. In this article, we first study the problem of computation offloading optimization and prove the problem is an NP-hard problem. Then, based on DRL and FL, we propose an offloading algorithm that is different from the traditional method. Finally, we studied the effects of various parameters on the performance of the algorithm and verified the effectiveness of both the DRL and FL in the IoT system.

Distributed, Parallel, and Cluster Computing
Data-driven Task Offloading Method for Resource-constrained Terminals via Unified Resource Model

Xueshuo Chen,Yuxing Mao,Hongyu Wang,Yihang Xu,Danyang Li,Siyang Liu,Xianping Zhao

DOI: https://doi.org/10.1109/jiot.2023.3235065

IF: 10.6

2023-01-01

IEEE Internet of Things Journal

Abstract:In recent years, with an increasing number of Internet of Things (IoT) devices, general cloud computing mode is hard to process large amounts of data with high Quality of Service (QoS). Edge computing is put forward to relieve the pressure of cloud servers, but most of them only focused on allocating tasks depending on cloud servers or edge servers with the virtualization technology. Resource-constrained smart mobile terminals (RC-SMTs) produce most of the data to be processed but some of them are usually not able to support even Docker technology. The cooperative computation capacity of RC-SMTs is potential but is often neglected by most researchers. However, there is little research focus on edge computing only among RC-SMTs without computing ability supported by servers. For this reason, this article proposes a framework named data-drive task offloading with a unified resource model (DDTO-URM) to manage the limited resource of IoT which enables the allocation of tasks constantly generated from the edge of the network. Then, a meta-heuristic algorithm called grouped crossover genetic algorithm (GCGA) is designed to obtain task offloading strategy under a resource-constrained environment. As a result, the computation capacity of the system is enhanced to cover the requirement by improving the utilization of RC-SMTs. Through the analysis of simulation, the proposed approach can deal with the problem of DDTO-URM better than benchmark algorithms under constraints, ensuring the real time and ultralightweight of the collaborative edge-computing system.

computer science, information systems,telecommunications,engineering, electrical & electronic
An intelligent task offloading method based on multi-agent deep reinforcement learning in ultra-dense heterogeneous network with mobile edge computing

Shanchen Pang,Teng Wang,Haiyuan Gui,Xiao He,Lili Hou

DOI: https://doi.org/10.1016/j.comnet.2024.110555

IF: 5.493

2024-05-31

Computer Networks

Abstract:With the rapid development of IoT technology, various computation-intensive and latency-sensitive tasks have emerged in large numbers, which impose higher requirements on the processing efficiency of the tasks. In this paper, by fusing mobile edge computing (MEC) and ultra-dense heterogeneous network (UD-HetNet) technologies, we design the scenario of UD-HetNet with MEC to improve the efficiency of computation and communication during task processing. However, how to design a effective task offloading and resource management strategy is still a major challenge in this scenario. Therefore, in this paper, we propose a distributed task offloading and wireless resource management framework that optimizes task offloading, local computation frequency scaling, subchannel allocation, and transmit power regulation strategies to reduce system overhead (weighted sum of delay and energy consumption of task processing) effectively. First, we design a task offloading for multi-base station (BS) collaboration base on priority algorithm and optimize the local computation frequency using convex optimization theory. Following by, we introduce a multi-agent deep deterministic policy gradient (MADDPG) technology to optimize subchannel allocation and transmit power regulation during task offloading to accommodate the dynamic and variable nature of the channel. Finally, user equipment (UE)-edge server (ES), UE-subchannel, and subchannel-power matching are achieved. Simulation results show that our algorithm has significant advantages in balancing the ES load, improving channel utilization, and reducing system overhead.

computer science, information systems,telecommunications,engineering, electrical & electronic, hardware & architecture
An Advanced Deep Reinforcement Learning Algorithm for Three-layer D2D-Edge-Cloud Computing Architecture for Efficient Task Offloading in Internet of Things

Komeil Moghaddasi,Shakiba Rajabi,Farhad Soleimanian Gharehchopogh,Ali Ghaffari

DOI: https://doi.org/10.1016/j.suscom.2024.100992

2024-05-03

Sustainable Computing: Informatics and Systems

Abstract:The Internet of Things (IoT) has transformed the digital landscape by interconnecting billions of devices worldwide, paving the way for smart cities, homes, and industries. With the exponential growth of IoT devices and the vast amount of data they generate, concerns have arisen regarding efficient task-offloading strategies. Traditional cloud and edge computing methods, paired with basic Machine Learning (ML) algorithms, face several challenges in this regard. In this paper, we propose a novel approach to task offloading in a Device-to-Device (D2D)-Edge-Cloud computing using the Rainbow Deep Q-Network (DQN), an advanced Deep Reinforcement Learning (DRL) algorithm. This algorithm utilizes advanced neural networks to optimize task offloading in the three-tier framework. It balances the trade-offs among D2D, Device-to-Edge (D2E), and Device/Edge-to-Cloud (D2C/E2C) communications, benefiting both end users and servers. These networks leverage Deep Learning (DL) to discern patterns, evaluate potential offloading decisions, and adapt in real time to dynamic environments. We compared our proposed algorithm against other state-of-the-art methods. Through rigorous simulations, we achieved remarkable improvements across key metrics: an increase in energy efficiency by 29.8%, a 27.5% reduction in latency, and a 43.1% surge in utility.

computer science, information systems, hardware & architecture
Offloading Decision and Resource Allocation in Mobile Edge Computing for Cost and Latency Efficiencies in Real-Time IoT

Chanthol Eang,Seyha Ros,Seungwoo Kang,Inseok Song,Prohim Tam,Sa Math,Seokhoon Kim

DOI: https://doi.org/10.3390/electronics13071218

IF: 2.9

2024-03-27

Electronics

Abstract:Internet of Things (IoT) devices can integrate with applications requiring intensive contextual data processing, intelligent vehicle control, healthcare remote sensing, VR, data mining, traffic management, and interactive applications. However, there are computationally intensive tasks that need to be completed quickly within the time constraints of IoT devices. To address this challenge, researchers have proposed computation offloading, where computing tasks are sent to edge servers instead of being executed locally on user devices. This approach involves using edge servers located near users in cellular network base stations, and also known as Mobile Edge Computing (MEC). The goal is to offload tasks to edge servers, optimizing both latency and energy consumption. The main objective of this paper mentioned in the summary is to design an algorithm for time- and energy-optimized task offloading decision-making in MEC environments. Therefore, we developed a Lagrange Duality Resource Optimization Algorithm (LDROA) to optimize for both decision offloading and resource allocation for tasks, whether to locally execute or offload to an edge server. The LDROA technique produces superior simulation outcomes in terms of task offloading, with improved performance in computation latency and cost usage compared to conventional methods like Random Offloading, Load Balancing, and the Greedy Latency Offloading scheme.

engineering, electrical & electronic,computer science, information systems,physics, applied

Nature of glaucoma in the pseudoexfoliation syndrome.

Energy-Aware and URLLC-Aware Task Offloading for Internet of Health Things

Learning-Based URLLC-Aware Task Offloading for Internet of Health Things

Associative tasks computing offloading scheme in Internet of medical things with deep reinforcement learning

Multi-Agent DRL-Based Task Offloading in Multiple RIS-Aided IoV Networks

Energy-Efficient Space–Air–Ground Integrated Edge Computing for Internet of Remote Things: A Federated DRL Approach

Deep Reinforcement Learning Based Massive Access Management for Ultra-Reliable Low-Latency Communications

Multi-Agent Deep Reinforcement Learning Based Resource Allocation for Ultra-Reliable Low-Latency Internet of Controllable Things

QDRL: Queue-Aware Online DRL for Computation Offloading in Industrial Internet of Things

Multiagent RL Aided Task Offloading and Resource Management in Wi-Fi 6 and 5G Coexisting Industrial Wireless Environment

DRL-Based Distributed Task Offloading Framework in Edge-Cloud Environment

A Multi-Agent RL Algorithm for Dynamic Task Offloading in D2D-MEC Network with Energy Harvesting

Deep reinforcement learning based computation offloading for xURLLC services with UAV-assisted IoT-based multi-access edge computing system

DRL-based resource optimization in 5G low carbon Power Internet of Things

DRL-Based Partial Offloading for Maximizing Sum Computation Rate of Wireless Powered Mobile Edge Computing Network

Multi-agent DRL for joint completion delay and energy consumption with queuing theory in MEC-based IIoT

Computation Offloading with Multiple Agents in Edge-Computing-Supported IoT

Data-driven Task Offloading Method for Resource-constrained Terminals via Unified Resource Model

An intelligent task offloading method based on multi-agent deep reinforcement learning in ultra-dense heterogeneous network with mobile edge computing

An Advanced Deep Reinforcement Learning Algorithm for Three-layer D2D-Edge-Cloud Computing Architecture for Efficient Task Offloading in Internet of Things

Offloading Decision and Resource Allocation in Mobile Edge Computing for Cost and Latency Efficiencies in Real-Time IoT