Abstract:The cybertwin and 6G-enabled Industrial Internet of Things (6G-IIoT) are the critical technologies that create the digital counterparts for physical systems and enable the near-instant interconnectivity in the industrial domain. It is in demand but challenging to conduct the integrated design for 6G-IIoT, which intertwines the cyber subsystems, such as control, communication, computing (3C), and the physical industrial factories and plants. Therefore, the cybertwin, which synchronizes between the digital counterparts and its physical entities during the system runtime, is the ideal proving ground for conducting the integrated design on the highly intertwined 3C of 6G-IIoT. However, the cybertwin lacks artificial intelligence to capacitate the automated integrated design for the 6G-IIoT. In this article, we first demonstrate the architecture of the machine-learning-based cybertwin for 6G-IIoT. Then, we leverage deep reinforcement learning (DRL) to conduct the integrated design via systematic trial and error in the cybertwin model, which is otherwise costly and dangerous in real industrial systems. Moreover, we invent the adaptive observation window for deep <span class="mjpage"><svg xmlns:xlink="http://www.w3.org/1999/xlink" width="1.838ex" height="2.509ex" style="vertical-align: -0.671ex;" viewBox="0 -791.3 791.5 1080.4" role="img" focusable="false" xmlns="http://www.w3.org/2000/svg"><g stroke="currentColor" fill="currentColor" stroke-width="0" transform="matrix(1 0 0 -1 0 0)"> <use xlink:href="#MJMATHI-51" x="0" y="0"></use></g></svg></span> -network (AOW-DQN), which generates system states adaptive to the control system's physical dynamics. Finally, the experimental results demonstrate the effectiveness and efficiency of our approach. To the best of our knowledge, we are the first to present the machine-learning-based cybertwin for carrying out the integrated design on the 3C for 6G-IIoT.<svg xmlns="http://www.w3.org/2000/svg" style="display: none;"><defs id="MathJax_SVG_glyphs"><path stroke-width="1" id="MJMATHI-51" d="M399 -80Q399 -47 400 -30T402 -11V-7L387 -11Q341 -22 303 -22Q208 -22 138 35T51 201Q50 209 50 244Q50 346 98 438T227 601Q351 704 476 704Q514 704 524 703Q621 689 680 617T740 435Q740 255 592 107Q529 47 461 16L444 8V3Q444 2 449 -24T470 -66T516 -82Q551 -82 583 -60T625 -3Q631 11 638 11Q647 11 649 2Q649 -6 639 -34T611 -100T557 -165T481 -194Q399 -194 399 -87V-80ZM636 468Q636 523 621 564T580 625T530 655T477 665Q429 665 379 640Q277 591 215 464T153 216Q153 110 207 59Q231 38 236 38V46Q236 86 269 120T347 155Q372 155 390 144T417 114T429 82T435 55L448 64Q512 108 557 185T619 334T636 468ZM314 18Q362 18 404 39L403 49Q399 104 366 115Q354 117 347 117Q344 117 341 117T337 118Q317 118 296 98T274 52Q274 18 314 18Z"></path></defs></svg>

Deep-Reinforcement-Learning-Based Cybertwin Architecture for 6G IIoT: An Integrated Design of Control, Communication, and Computing

Multi‐dimensional resource management with deep deterministic policy gradient for digital twin‐enabled Industrial Internet of Things in 6 generation

Reinforcement Learning-Based Control and Networking Co-Design for Industrial Internet of Things

Adaptive Artificial Intelligence for Resource-Constrained Connected Vehicles in Cybertwin-Driven 6G Network

Pervasive Machine Learning for Smart Radio Environments Enabled by Reconfigurable Intelligent Surfaces

DRESIA: Deep Reinforcement Learning-Enabled Gray Box Approach for Large-Scale Dynamic Cyber-Twin System Simulation

A digital twin to train deep reinforcement learning agent for smart manufacturing plants: Environment, interfaces and intelligence

Joint Vehicle Connection and Beamforming Optimziation in Digital Twin Assisted Integrated Sensing and Communication Vehicular Networks

6G Network Dynamics and Complexity Metrics Evaluation Within Artificially Intelligent Digital Twin Cyber-Physical Systems for Enhanced Industry 4.0 Performance

Federated Reinforcement Learning-Based Resource Allocation for D2D-Aided Digital Twin Edge Networks in 6G Industrial IoT

Dynamic Network Slicing Orchestration for Remote Adaptation and Configuration in Industrial IoT

A hybrid evolutionary and machine learning approach for smart city planning: Digital twin approach

Collective reinforcement learning based resource allocation for digital twin service in 6G networks

Digital Twin and Meta RL Empowered Fast-Adaptation of Joint User Scheduling and Task Offloading for Mobile Industrial IoT

A Functional Architecture for 6G Special Purpose Industrial IoT Networks

Deep Reinforcement Learning-Based SFC Deployment Scheme for 6G IoT Scenario.

Edge Intelligence-driven Joint Offloading and Resource Allocation for Future 6G Industrial Internet of Things

Integration of digital twin and deep learning in cyber‐physical systems: towards smart manufacturing

Learning-to-Adaptation for Security Service in Industrial IoT: an AI-Enabled Slice-Specific Solution

Digital Twin in 6G: Embracing Comprehensive Network Intelligence

AI-Driven Collaborative Resource Allocation for Task Execution in 6G-Enabled Massive IoT