Abstract:Flexible job shop scheduling (FJSP) has garnered enormous attention within the realm of smart manufacturing, where, beyond job sequencing, the selection of machines holds considerable importance. As smart factories progress with the Internet of things (IoT) and cyber-physical systems (CPS), scheduling methodologies are advancing towards intelligent decentralization. However, with the expansion of factories, conventional cloud computing struggles to manage the substantial influx of data. To tackle this issue, this work incorporates a fog computing and edge computing framework into the distributed FJSP workstations. In this framework, the workstations each of which consists of multiple machines are categorized based on the different nature of the accommodated machines, and operate independently to reduce unnecessary information transmission, in which each machine is equipped with edge computing capacity. The fusion of fog computing and edge computing allows for the offloading of computational tasks from cloud computing, effectively reducing latency. While previous solutions for FJSP have predominantly relied on linear programming or metaheuristic algorithms, this work proposed a novel distributed approach based on a dual deep Q networks (dual DQN) architecture, integrating deep learning (DL) with reinforcement learning (RL). Within the cloud center, the initial neural network determines the machine selection rules for fog computing, while the secondary neural network decides the job dispatching rules for edge computing devices. Edge computing devices execute the schedule and provide feedback to the cloud, which refines the results through an iterative training process, so that to minimize the makespan. The experimental findings indicate that employing dual DQNs outperforms the methods of utilizing only one single machine selection rule.

Distributed Orchestration of Service Function Chains for Edge Intelligence in the Industrial Internet of Things

An online service function chain orchestration method for profit maximization in edge computing networks

Scheduling Reconfigurable Service Function Chain

Dynamic Network Slicing Orchestration for Remote Adaptation and Configuration in Industrial IoT

Delay Constrained SFC Orchestration for Edge Intelligence-Enabled IIoT: A DRL Approach

Hybrid Service Function Chains Dynamic Deployment in Multi-Domain Edge Cloud Networks

Dynamic Service Function Chaining Orchestration in a Multi-Domain: A Heuristic Approach Based on SRv6

Optimal Placement of Recurrent Service Chains on Distributed Edge-Cloud Infrastructures

Resource-Aware Service Function Chain Deployment in Cloud-Edge Environment

A Practical Near Optimal Deployment of Service Function Chains in Edge-to-Cloud Networks

On Dynamic Service Function Chain Deployment and Readjustment

Efficient Dynamic Service Function Chain Combination of Network Function Virtualization

Dynamic service function chain placement in mobile computing: An asynchronous advantage actor‐critic based approach

Decentralized Edge Intelligence-Driven Network Resource Orchestration Mechanism

Efficient instance reuse approach for service function chain placement in mobile edge computing

Edge-edge Collaboration Based Micro-service Deployment in Edge Computing Networks

Adaptive Services Function Chain Orchestration For Digital Health Twin Use Cases: Heuristic-boosted Q-Learning Approach

An Efficient Approximation Algorithm for Service Function Chaining Placement in Edge–Cloud Computing Industrial Internet of Things

Service Function Chain Embedding Framework for NFV-Enabled IoT Application

Optimized Composition for Multiple User Service Requests Based on Edge-Cloud Collaboration

Distributed Flexible Job Shop Scheduling through Deploying Fog and Edge Computing in Smart Factories Using Dual Deep Q Networks