Abstract:In this paper, we present an innovative method for replacing wired communication within an operational agile production cell with wireless communication, using a minimal number of access points. Our approach utilizes Reinforcement Learning (RL) to optimize the layout and minimize the required number of access points. We introduce an Artificial Intelligence (AI) agent that facilitates cooperative interaction between cameras and access points, optimizing camera stream utilization and radio coverage. This solution benefits from the recent standardization of The fifth generation of mobile communications (5G) Network Resource Management (NRM) features of the User Equipment (UE) attached to the cameras. To accommodate the dynamic nature of the production cell, our optimization algorithms run during cell operation, necessitating extended training times. Our contributions extend beyond the state-of-the-art by offering a Digital Twin (DT) environment equipped with physics and radio propagation capabilities, fast raytracing for radio propagation modeling, curriculum-learning-based reinforcement learning, and a Physical Twin (PT) of the radio-connected camera with self-adjusting scene setup capabilities. This comprehensive proposal combines the efficiency of 5G radio utilization with precise modeling and high-resolution simulations, while also significantly improving training speed. In the Agile Robotics for Industrial Automation Competition (ARIAC) 2020 environment, our methods showed compelling results, with curriculum learning achieving a remarkable 3x speed-up compared to non-curriculum approaches. We also demonstrated that high Quality of Service (QoS) demands can be reduced to just 2% of total time while maintaining consistent productivity Key Performance Indicators (KPIs). Furthermore, we explored the integration of these methods into Internet of Things (IoT) devices with limited performance capabilities. In conclusion, our approach offers significant benefits and savings for IoT devices, networks, edge clouds, and industry players.

Network Resource Management For Cyber-Physical Production Systems Based On Quality of Experience

Achieving Real-Time Quality of Service with Software Defined Networking

Joint Optimization of QoS and Security for Differentiated Applications in Heterogeneous Networks

Network QoS Management in Cyber-Physical Systems

Controller-Aware Dynamic Network Management for Industry 4.0

Quality of Control based Resource Dimensioning for Collaborative Edge Robotics

Real-time QoS Routing Scheme in SDN-based Robotic Cyber-Physical Systems

Dynamic Network Slicing Orchestration for Remote Adaptation and Configuration in Industrial IoT

Intelligent wireless resource management in industrial camera systems: Reinforcement Learning-based AI-extension for efficient network utilization

Smart Resource Allocation Using Reinforcement Learning in Content-Centric Cyber-Physical Systems.

Mobile Secured IoT Sensors-Driven Network Using Efficient QoS Management

Dynamic QoS Management for a Flexible 5G/6G Network Core: A Step toward a Higher Programmability

Environmental Awareness Dynamic 5G QoS for Retaining Real Time Constraints in Robotic Applications

Presentation of a novel real-time production supply concept with cyber-physical systems and efficiency validation by process status indicators

Quality of Experience Experimentation Prediction Framework through Programmable Network Management

Cyber-Physical Electronics Production

Deployment options of AI components for network resource management in 5G‐enabled agile industrial production cell

A Novel Cognitive Management Scheme for the Virtual Network Resources

Multiple QoS Enabled Intelligent Resource Management in Vehicle-to-Vehicle Communication

CollOR: Distributed collaborative offloading and routing for tasks with QoS demands in multi-robot system

Resilient Cyber-Physical Systems: Using NFV Orchestration