Collaborative task offloading and resource scheduling framework for heterogeneous edge computing
Jianji Ren,Tingting Hou,Haichao Wang,Huanhuan Tian,Huihui Wei,Hongxiao Zheng,Xiaohong Zhang
DOI: https://doi.org/10.1007/s11276-021-02768-y
IF: 2.701
2021-09-22
Wireless Networks
Abstract:<p class="a-plus-plus">With the continuous development and maturity of the fifth-generation mobile network (5G) technology, the demand for multimedia service access is increasing, which poses huge challenges to the connectivity, caching capabilities, and computing capabilities of the Internet of Things (IoT) devices. Therefore, edge computing, as the key to achieving efficient edge data preprocessing and improving data access and response, is considered to be a hot technology for the next generation of mobile networks and future development. However, the current imbalance of computing resources on the edge, the lack of collaboration between nodes, and the lack of adaptability of optimization methods in a dynamic environment pose challenges to the development of edge computing. To strengthen the collaboration of nodes in the edge environment, we designed a collaborative task offloading and resource scheduling framework, including macro base station collaborative space (<span class="a-plus-plus inline-equation id-i-eq1"><span class="a-plus-plus equation-source format-t-e-x"><span class="mjpage"><svg xmlns:xlink="http://www.w3.org/1999/xlink" width="1.03ex" height="2.509ex" style="vertical-align: -0.671ex;" viewBox="0 -791.3 443.5 1080.4" role="img" focusable="false" xmlns="http://www.w3.org/2000/svg"><g stroke="currentColor" fill="currentColor" stroke-width="0" transform="matrix(1 0 0 -1 0 0)"> <use xlink:href="#MJMATHI-3BE" x="0" y="0"></use></g></svg></span></span></span>BSCS) and micro base station collaborative space (<span class="a-plus-plus inline-equation id-i-eq2"><span class="a-plus-plus equation-source format-t-e-x"><span class="mjpage"><svg xmlns:xlink="http://www.w3.org/1999/xlink" width="1.402ex" height="2.176ex" style="vertical-align: -0.838ex;" viewBox="0 -576.1 603.5 936.9" role="img" focusable="false" xmlns="http://www.w3.org/2000/svg"><g stroke="currentColor" fill="currentColor" stroke-width="0" transform="matrix(1 0 0 -1 0 0)"> <use xlink:href="#MJMATHI-3BC" x="0" y="0"></use></g></svg></span></span></span>BSCS) to balance computing and caching resources in heterogeneous wireless networks. In addition, we formulate the collaborative computing offloading problem as a Markov Decision Process (MDP), and deep reinforcement learning (DRL) agents are deployed to make task offloading and resource allocation decisions. The DRL agent is deployed in each base station (BS) in a decentralized manner, observing the available computing and caching resources on the edge side, and designing an optimal resource allocation strategy for task offloading to maximize the benefits of the long-term system. The data-driven simulation results verify that the proposed scheme is effective in reducing the overall consumption of the system, maximizing the long-term benefits of edge resource allocation, and improving the success rate of task completion.</p><svg xmlns="http://www.w3.org/2000/svg" style="display: none;"><defs id="MathJax_SVG_glyphs"><path stroke-width="1" id="MJMATHI-3BE" d="M268 632Q268 704 296 704Q314 704 314 687Q314 682 311 664T308 635T309 620V616H315Q342 619 360 619Q443 619 443 586Q439 548 358 546H344Q326 546 317 549T290 566Q257 550 226 505T195 405Q195 381 201 364T211 342T218 337Q266 347 298 347Q375 347 375 314Q374 297 359 288T327 277T280 275Q234 275 208 283L195 286Q149 260 119 214T88 130Q88 116 90 108Q101 79 129 63T229 20Q238 17 243 15Q337 -21 354 -33Q383 -53 383 -94Q383 -137 351 -171T273 -205Q240 -205 202 -190T158 -167Q156 -163 156 -159Q156 -151 161 -146T176 -140Q182 -140 189 -143Q232 -168 274 -168Q286 -168 292 -165Q313 -151 313 -129Q313 -112 301 -104T232 -75Q214 -68 204 -64Q198 -62 171 -52T136 -38T107 -24T78 -8T56 12T36 37T26 66T21 103Q21 149 55 206T145 301L154 307L148 313Q141 319 136 323T124 338T111 358T103 382T99 413Q99 471 143 524T259 602L271 607Q268 618 268 632Z"></path><path stroke-width="1" id="MJMATHI-3BC" d="M58 -216Q44 -216 34 -208T23 -186Q23 -176 96 116T173 414Q186 442 219 442Q231 441 239 435T249 423T251 413Q251 401 220 279T187 142Q185 131 185 107V99Q185 26 252 26Q261 26 270 27T287 31T302 38T315 45T327 55T338 65T348 77T356 88T365 100L372 110L408 253Q444 395 448 404Q461 431 491 431Q504 431 512 424T523 412T525 402L449 84Q448 79 448 68Q448 43 455 35T476 26Q485 27 496 35Q517 55 537 131Q543 151 547 152Q549 153 557 153H561Q580 153 580 144Q580 138 575 117T555 63T523 13Q510 0 491 -8Q483 -10 467 -10Q446 -10 429 -4T402 11T385 29T376 44T374 51L368 45Q362 39 350 30T324 12T288 -4T246 -11Q199 -11 153 12L129 -85Q108 -167 104 -180T92 -202Q76 -216 58 -216Z"></path></defs></svg>
computer science, information systems,telecommunications,engineering, electrical & electronic