Abstract:<p>The Industrial Internet of Things (IIoT), also known as Industry 4.0, empowers manufacturing and production processes by leveraging automation and Internet of Things (IoT) technologies. In IIoT, the information communication technologies enabled by IoT could greatly improve the efficiency and timeliness of information exchanges between both vertical and horizontal system integrations. Likewise, machine learning algorithms, particularly Deep Reinforcement Learning (DRL), are viable for assisting in automated control of complex IIoT systems, with the support of distributed edge computing infrastructure. Despite noticeable performance improvements, the security threats brought by massive interconnections in IoT and the vulnerabilities of deep neural networks used in DRL must be thoroughly investigated and mitigated before widespread deployment. Thus, in this paper we first design a DRL-based controller that could be deployed at edge computing server to enable automated control in an IIoT context. We then investigate malicious behaviors of adversaries with two attacks: (i) function-based attacks that can be launched during training phase and (ii) performance-based attacks that can be launched after training phase, to study the security impacts of vulnerable DRL-based controllers. From the adversary's perspective, maximum entropy Inverse Reinforcement Learning (IRL) is used to approximate a reward function through observation of system trajectories under the control of trained DRL-based controllers. The approximated reward function is then used to launch attacks by the adversary against the Deep Q Network (DQN)-based controller. Via simulation, we evaluate the impacts of our two investigated attacks, finding that attacks are increasingly successful with increasing accuracy of the control model. Furthermore, we discuss some tradeoffs between control performance and security performance of DRL-based IIoT controllers, and outline several future research directions to secure machine learning use in IIoT systems.</p>

Trustworthy Target Tracking With Collaborative Deep Reinforcement Learning in EdgeAI-Aided IoT

Deep Reinforcement Learning Enables Joint Trajectory and Communication in Internet of Robotic Things

Collaborative Deep Reinforcement Learning for Multi-object Tracking

Dynamical Resource Allocation in Edge for Trustable Internet-of-Things Systems: A Reinforcement Learning Method

Standoff Target Tracking for Networked UAVs with Specified Performance Via Deep Reinforcement Learning

Edge Collaborative Online Task Offloading Method Based on Reinforcement Learning

Energy Conservation for Internet of Things Tracking Applications Using Deep Reinforcement Learning

Deep Reinforcement Learning Multi-UAV Trajectory Control for Target Tracking

On deep reinforcement learning security for Industrial Internet of Things

Trustworthy decentralized collaborative learning for edge intelligence: A survey

Accuracy-Guaranteed Collaborative DNN Inference in Industrial IoT via Deep Reinforcement Learning

DRL-Based Trajectory Tracking for Motion-Related Modules in Autonomous Driving

Optimization of trusted wireless sensing models based on deep reinforcement learning for ISAC systems

Attacking Deep Reinforcement Learning-Based Traffic Signal Control Systems with Colluding Vehicles

DeepEdge: A New QoE-Based Resource Allocation Framework Using Deep Reinforcement Learning for Future Heterogeneous Edge-IoT Applications

Learner's Dilemma: IoT Devices Training Strategies in Collaborative Deep Learning

Comprehensive Training and Evaluation on Deep Reinforcement Learning for Automated Driving in Various Simulated Driving Maneuvers

Autonomous Navigation via Deep Reinforcement Learning for Resource Constraint Edge Nodes Using Transfer Learning

Deep Reinforcement Learning for Online Resource Allocation in IoT Networks: Technology, Development, and Future Challenges

Vehicle Tracking in Wireless Sensor Networks via Deep Reinforcement Learning

Trajectory tracking control based on deep reinforcement learning and ensemble random network distillation for robotic manipulator