Abstract:With high efficiency and low energy loss, high-temperature superconductors (HTS) have demonstrated their profound applications in various fields, such as medical imaging, transportation, accelerators, microwave devices, and power systems. The high-field applications of HTS tapes have raised the demand for producing cost-effective tapes with long lengths in superconductor manufacturing. However, achieving the uniform and enhanced performance of a long HTS tape is challenging due to the unstable growth conditions in the manufacturing process. Although it is confirmed that the process parameters during the advanced metal organic chemical vapor deposition (A-MOCVD) process influence the uniformity of the produced HTS tapes, the high-dimensional process parameter signals and their complicated interactions make it difficult to develop an effective control policy. In this paper, we propose a local measure for the uniformity of HTS tapes to provide instant feedback for our control policy. Then, we model the manufacturing of HTS tapes as a Markov decision process (MDP) with continuous state and action spaces to assess the instant reward in real time in our feedback control model. As our MDP involves continuous and high-dimensional state and action spaces, a neural fitted Q-iteration (NFQ) algorithm is adopted to solve the MDP with artificial neural network (ANN) function approximation. The collinearity of process parameters can restrict our capability of adjusting the process parameters, which is addressed by the principal component analysis (PCA) in our method. The control policy adjusts the PCA of process parameters using the NFQ algorithm. Based on our case studies on real A-MOCVD dataset, the obtained control policy increases the average uniformity of tapes by 5.6% and performs especially well on sample HTS tapes with a low uniformity.

A Reinforcement Learning Control in Hot Stamping for Cycle Time Optimization

A scalable Deep Q-Learning approach for hot stamping process under dynamic control environment

Improving the Quality of Hot Stamping Parts with Innovative Press Technology and Inline Process Control

Towards microstructure control in forging and rolling: combining AI with process models for closed-loop property control

An Adaptive Design Method for Understanding Tolerance in the Precision Stamping Process

Combining physics-based and data-driven methods in metal stamping

Coupling of an analytical rolling model and reinforcement learning to design pass schedules: towards properties controlled hot rolling

Temperature Control Optimization in a Steel‐Making Continuous Casting Process Using a Multimodal Deep Learning Approach

Reinforcement-Learning-Based Composite Optimal Control for Looper Hydraulic Servo Systems in Hot Strip Rolling

Control System for Automated Technological Process of Hot Stamping—A Case Study

Case Study: Modeling of the cycle time reduction in a B-Pillar hot stamping operation using conformal cooling

Thermo-mechanical coupled simulation of hot stamping components for process design

Model-free Adaptive Optimal Control of Episodic Fixed-horizon Manufacturing Processes Using Reinforcement Learning

Adaptive neural network controller for the molten steel level control of strip casting processes

Using Deep Reinforcement Learning for Zero Defect Smart Forging

A Deep Reinforcement Learning Approach to Injection Speed Control in Injection Molding Machines with Servomotor-Driven Constant Pump Hydraulic System

Optimization of stamping process parameters based on an improved particle swarm optimization–genetic algorithm and sparse auto-encoder–back-propagation neural network model

Reinforcement learning for real-time process control in high-temperature superconductor manufacturing

DeepForge: Leveraging AI for Microstructural Control in Metal Forming via Model Predictive Control

Multi-Objective Optimization of the Hot Rolling Scheduling of Steel Using a Genetic Algorithm

Experimental analysis of electro-pneumatic optimization of hot stamping machine control systems with on-delay timer