Abstract:<p>The Industrial Internet of Things (IIoT), also known as Industry 4.0, empowers manufacturing and production processes by leveraging automation and Internet of Things (IoT) technologies. In IIoT, the information communication technologies enabled by IoT could greatly improve the efficiency and timeliness of information exchanges between both vertical and horizontal system integrations. Likewise, machine learning algorithms, particularly Deep Reinforcement Learning (DRL), are viable for assisting in automated control of complex IIoT systems, with the support of distributed edge computing infrastructure. Despite noticeable performance improvements, the security threats brought by massive interconnections in IoT and the vulnerabilities of deep neural networks used in DRL must be thoroughly investigated and mitigated before widespread deployment. Thus, in this paper we first design a DRL-based controller that could be deployed at edge computing server to enable automated control in an IIoT context. We then investigate malicious behaviors of adversaries with two attacks: (i) function-based attacks that can be launched during training phase and (ii) performance-based attacks that can be launched after training phase, to study the security impacts of vulnerable DRL-based controllers. From the adversary's perspective, maximum entropy Inverse Reinforcement Learning (IRL) is used to approximate a reward function through observation of system trajectories under the control of trained DRL-based controllers. The approximated reward function is then used to launch attacks by the adversary against the Deep Q Network (DQN)-based controller. Via simulation, we evaluate the impacts of our two investigated attacks, finding that attacks are increasingly successful with increasing accuracy of the control model. Furthermore, we discuss some tradeoffs between control performance and security performance of DRL-based IIoT controllers, and outline several future research directions to secure machine learning use in IIoT systems.</p>

An Evolutionary Reinforcement Learning Scheme for IoT Robustness.

Intelligent Orchestrating of IoT Microservices Based on Reinforcement Learning

ROG: A High Performance and Robust Distributed Training System for Robotic IoT

Safe Exploration in Wireless Security: A Safe Reinforcement Learning Algorithm With Hierarchical Structure

Multi-agent Reinforcement Learning Approach to Enhance Proactive and Resilience System based IoT

Deep Reinforcement Learning for Online Resource Allocation in IoT Networks: Technology, Development, and Future Challenges

A Multi-Agents Deep Reinforcement Learning Autonomous Security Management Approach for Internet of Things

Deep Reinforcement Learning Based Massive Access Management for Ultra-Reliable Low-Latency Communications

Broad Reinforcement Learning for Supporting Fast Autonomous IoT

A Deep Reinforcement Learning Approach for Improving Age of Information in Mission-Critical IoT

Deep Reinforcement Learning for Internet of Things: A Comprehensive Survey

Pioneering advanced security solutions for reinforcement learning-based adaptive key rotation in Zigbee networks

Intelligent Communication Planning for Constrained Environmental IoT Sensing with Reinforcement Learning

IoT-Based Reinforcement Learning Using Probabilistic Model for Determining Extensive Exploration through Computational Intelligence for Next-Generation Techniques

Enhancing IoT Intelligence: A Transformer-based Reinforcement Learning Methodology

Deep Reinforcement Learning Enables Joint Trajectory and Communication in Internet of Robotic Things

A deep reinforcement learning-based multi-optimality routing scheme for dynamic IoT networks

On deep reinforcement learning security for Industrial Internet of Things

Deep Reinforcement Learning for Autonomous Internet of Things: Model, Applications and Challenges

Multi-user Resource Control with Deep Reinforcement Learning in IoT Edge Computing

Multiagent Reinforcement Learning Meets Random Access in Massive Cellular Internet of Things