Abstract:The integrated multi-objective optimization of machining parameters for improved machining quality and efficiency is important in batch milling systems. Due to the change of the batch milling system state, the continuous use of the same machining parameters may lead to degradation in quality and efficiency for workpieces in batches. Machining parameter optimization is usually determined by manual experience or trial-and-error methods, making it difficult to achieve a synergistic consideration of both quality and efficiency. To address this issue, a novel multi-task deep reinforcement learning method for machining parameter optimization in a batch machining system is proposed. Firstly, a reliable parallel joint estimation model of multiple machining quality and efficiency indicators is established using a multi-task time series estimation method, which can learn the correlation of these indicators to improve estimation accuracy. Then, the parameter optimization problem is formalized as a Markov decision process supported by a reinforcement learning virtual environment and an agent. The reinforcement learning virtual environment with the joint estimation model is constructed to improve the accuracy of optimized machining parameters for the collaborative optimization of quality and efficiency indicators. Within the virtual environment, time series sequential state, sequential action, multi-objective reward function, and constraint conditions adapted to the joint estimation model are defined to repeatedly evaluate different machining parameters. The agent with a multi-head attention and a dynamic weight adjustment mechanism is designed to improve the stability of the optimization process. Finally, experiments on a real machining dataset of thin-walled parts show that compared with the traditional deep reinforcement learning algorithm, the optimization effect of the proposed framework is improved by 9 %−12 %, and the standard deviation is decreased by 9 % −18 %.

Ensemble Modeling Based on 0–1 Programming in Micro-Manufacturing Process

Multiobjective Optimization of Injection Molding Parameters Based on Soft Computing and Variable Complexity Method

Ensemble Modeling of in Situ Features for Printed Electronics Manufacturing with in Situ Process Control Potential

Modeling and Optimization Methods of Integrated Production Planning for Steel Plate Mill with Flexible Customization

A Modeling Method of Complex Assembly Based on Digital Twin

Digital twin-driven multi-dimensional assembly error modeling and control for complex assembly process in Industry 4.0

Economic quality design under model uncertainty in micro-drilling manufacturing process

Multi-Objective Optimization for the Micro-Milling Process With Adaptive Data Modeling

Uncertainty-aware error modeling and hierarchical redundancy optimization for robotic surface machining

Concept for Individual and Lifetime-Adaptive Modeling of the Dynamic Behavior of Machine Tools

A Novel Two-Stage Optimization Approach to Machining Process Selection Using Error Equivalence Method

Machining parameter optimization for a batch milling system using multi-task deep reinforcement learning

Research on Parametric Modeling and Simulation of Mechanical Products Based on Multi-Objective Genetic Algorithm

Reliability-based NC milling parameters optimization using ensemble metamodel

Multi-models associated with process information-driven process autonomous digital twin for multi-variety production of intelligent machines

Modeling and compensation of comprehensive errors for thin-walled parts machining based on on-machine measurement

A Least Squares Ensemble Model Based on Regularization and Augmentation Strategy

Modeling for Non-exponential Production Systems Using Parts Flow Data: Model Parameter Estimation and Performance Analysis

Multidisciplinary Collaborative Design Optimization Modeling Method of Complex Product

Research on Intelligent Optimization Method of Multidimensional Process Quality Parameters

Manufacturing Process Modeling and Optimization Based on Multi-Layer Perceptron Network