Abstract:<p class="a-plus-plus">With the continuous development and maturity of the fifth-generation mobile network (5G) technology, the demand for multimedia service access is increasing, which poses huge challenges to the connectivity, caching capabilities, and computing capabilities of the Internet of Things (IoT) devices. Therefore, edge computing, as the key to achieving efficient edge data preprocessing and improving data access and response, is considered to be a hot technology for the next generation of mobile networks and future development. However, the current imbalance of computing resources on the edge, the lack of collaboration between nodes, and the lack of adaptability of optimization methods in a dynamic environment pose challenges to the development of edge computing. To strengthen the collaboration of nodes in the edge environment, we designed a collaborative task offloading and resource scheduling framework, including macro base station collaborative space (<span class="a-plus-plus inline-equation id-i-eq1"><span class="a-plus-plus equation-source format-t-e-x"><span class="mjpage"><svg xmlns:xlink="http://www.w3.org/1999/xlink" width="1.03ex" height="2.509ex" style="vertical-align: -0.671ex;" viewBox="0 -791.3 443.5 1080.4" role="img" focusable="false" xmlns="http://www.w3.org/2000/svg"><g stroke="currentColor" fill="currentColor" stroke-width="0" transform="matrix(1 0 0 -1 0 0)"> <use xlink:href="#MJMATHI-3BE" x="0" y="0"></use></g></svg></span></span></span>BSCS) and micro base station collaborative space (<span class="a-plus-plus inline-equation id-i-eq2"><span class="a-plus-plus equation-source format-t-e-x"><span class="mjpage"><svg xmlns:xlink="http://www.w3.org/1999/xlink" width="1.402ex" height="2.176ex" style="vertical-align: -0.838ex;" viewBox="0 -576.1 603.5 936.9" role="img" focusable="false" xmlns="http://www.w3.org/2000/svg"><g stroke="currentColor" fill="currentColor" stroke-width="0" transform="matrix(1 0 0 -1 0 0)"> <use xlink:href="#MJMATHI-3BC" x="0" y="0"></use></g></svg></span></span></span>BSCS) to balance computing and caching resources in heterogeneous wireless networks. In addition, we formulate the collaborative computing offloading problem as a Markov Decision Process (MDP), and deep reinforcement learning (DRL) agents are deployed to make task offloading and resource allocation decisions. The DRL agent is deployed in each base station (BS) in a decentralized manner, observing the available computing and caching resources on the edge side, and designing an optimal resource allocation strategy for task offloading to maximize the benefits of the long-term system. The data-driven simulation results verify that the proposed scheme is effective in reducing the overall consumption of the system, maximizing the long-term benefits of edge resource allocation, and improving the success rate of task completion.</p><svg xmlns="http://www.w3.org/2000/svg" style="display: none;"><defs id="MathJax_SVG_glyphs"><path stroke-width="1" id="MJMATHI-3BE" d="M268 632Q268 704 296 704Q314 704 314 687Q314 682 311 664T308 635T309 620V616H315Q342 619 360 619Q443 619 443 586Q439 548 358 546H344Q326 546 317 549T290 566Q257 550 226 505T195 405Q195 381 201 364T211 342T218 337Q266 347 298 347Q375 347 375 314Q374 297 359 288T327 277T280 275Q234 275 208 283L195 286Q149 260 119 214T88 130Q88 116 90 108Q101 79 129 63T229 20Q238 17 243 15Q337 -21 354 -33Q383 -53 383 -94Q383 -137 351 -171T273 -205Q240 -205 202 -190T158 -167Q156 -163 156 -159Q156 -151 161 -146T176 -140Q182 -140 189 -143Q232 -168 274 -168Q286 -168 292 -165Q313 -151 313 -129Q313 -112 301 -104T232 -75Q214 -68 204 -64Q198 -62 171 -52T136 -38T107 -24T78 -8T56 12T36 37T26 66T21 103Q21 149 55 206T145 301L154 307L148 313Q141 319 136 323T124 338T111 358T103 382T99 413Q99 471 143 524T259 602L271 607Q268 618 268 632Z"></path><path stroke-width="1" id="MJMATHI-3BC" d="M58 -216Q44 -216 34 -208T23 -186Q23 -176 96 116T173 414Q186 442 219 442Q231 441 239 435T249 423T251 413Q251 401 220 279T187 142Q185 131 185 107V99Q185 26 252 26Q261 26 270 27T287 31T302 38T315 45T327 55T338 65T348 77T356 88T365 100L372 110L408 253Q444 395 448 404Q461 431 491 431Q504 431 512 424T523 412T525 402L449 84Q448 79 448 68Q448 43 455 35T476 26Q485 27 496 35Q517 55 537 131Q543 151 547 152Q549 153 557 153H561Q580 153 580 144Q580 138 575 117T555 63T523 13Q510 0 491 -8Q483 -10 467 -10Q446 -10 429 -4T402 11T385 29T376 44T374 51L368 45Q362 39 350 30T324 12T288 -4T246 -11Q199 -11 153 12L129 -85Q108 -167 104 -180T92 -202Q76 -216 58 -216Z"></path></defs></svg>

HAT: Task Offloading and Resource Allocation in RIS-Assisted Collaborative Edge Computing

Joint Computation Offloading and Resource Allocation for D2D-Assisted Mobile Edge Computing

Deep reinforcement learning‐based multitask hybrid computing offloading for multiaccess edge computing

HCOME: Research on Hybrid Computation Offloading Strategy for MEC Based on DDPG

Edge Computing Empowered Digital Twin: an End-to-End Computing Task Scheduling Approach

Offloading Decision Methods for Multiple Users with Structured Tasks in Edge Computing for Smart Cities

Task Offloading And Resource Scheduling In Hybrid Edge-Cloud Networks

Collaborative task offloading and resource scheduling framework for heterogeneous edge computing

Joint Task Offloading and Resource Allocation in Heterogeneous Edge Environments

Federated deep reinforcement learning-based online task offloading and resource allocation in harsh mobile edge computing environment

Energy-Efficient Collaborative Multi-Access Edge Computing Via Deep Reinforcement Learning

Computing Offloading for RIS-Aided Internet of Everything: A Cybertwin Version

Deep Reinforcement Learning-Based Task Offloading for Vehicular Edge Computing With Flexible RSU-RSU Cooperation

Deep Reinforcement Learning for Energy Minimization in Multi-RIS-Aided Cell-Free MEC Networks

Efficient Resource Allocation for Relay-Assisted Computation Offloading in Mobile Edge Computing

Joint DNN Partition and Resource Allocation for Task Offloading in Edge-Cloud-Assisted IoT Environments

Distributed Dependent Task Offloading in CPU-GPU Heterogenous MEC: A Federated Reinforcement Learning Approach

Optimization Search Strategy for Task Offloading from Collaborative Edge Computing

Joint Task Offloading and Resource Allocation for Intelligent Reflecting Surface-Aided Integrated Sensing and Communication Systems Using Deep Reinforcement Learning Algorithm

Decentralized and Fault-Tolerant Task Offloading for Enabling Network Edge Intelligence

Dependent Task Offloading for Edge Computing based on Deep Reinforcement Learning