Abstract:The integrated multi-objective optimization of machining parameters for improved machining quality and efficiency is important in batch milling systems. Due to the change of the batch milling system state, the continuous use of the same machining parameters may lead to degradation in quality and efficiency for workpieces in batches. Machining parameter optimization is usually determined by manual experience or trial-and-error methods, making it difficult to achieve a synergistic consideration of both quality and efficiency. To address this issue, a novel multi-task deep reinforcement learning method for machining parameter optimization in a batch machining system is proposed. Firstly, a reliable parallel joint estimation model of multiple machining quality and efficiency indicators is established using a multi-task time series estimation method, which can learn the correlation of these indicators to improve estimation accuracy. Then, the parameter optimization problem is formalized as a Markov decision process supported by a reinforcement learning virtual environment and an agent. The reinforcement learning virtual environment with the joint estimation model is constructed to improve the accuracy of optimized machining parameters for the collaborative optimization of quality and efficiency indicators. Within the virtual environment, time series sequential state, sequential action, multi-objective reward function, and constraint conditions adapted to the joint estimation model are defined to repeatedly evaluate different machining parameters. The agent with a multi-head attention and a dynamic weight adjustment mechanism is designed to improve the stability of the optimization process. Finally, experiments on a real machining dataset of thin-walled parts show that compared with the traditional deep reinforcement learning algorithm, the optimization effect of the proposed framework is improved by 9 %−12 %, and the standard deviation is decreased by 9 % −18 %.

Investigating the Multi-Objective Optimization of Quality and Efficiency Using Deep Reinforcement Learning

Machining parameter optimization for a batch milling system using multi-task deep reinforcement learning

Efficient Multi-Objective Optimization on Dynamic Flexible Job Shop Scheduling Using Deep Reinforcement Learning Approach

Joint optimization of maintenance and quality inspection for manufacturing networks based on deep reinforcement learning

A deep reinforcement learning-driven multi-objective optimization and its applications on aero-engine maintenance strategy

Deep Reinforcement Learning for Multiobjective Optimization

Multi-Objective Optimization of AGV Real-Time Scheduling Based on Deep Reinforcement Learning

Deep Reinforcement Learning for Maintenance Optimization of Multi-Component Production Systems Considering Quality and Production Plan

Dynamic Multi-Objective Scheduling for Flexible Job Shop by Deep Reinforcement Learning.

Multi-objective optimization of the textile manufacturing process using deep-Q-network based multi-agent reinforcement learning

A novel method based on deep reinforcement learning for machining process route planning

Hierarchical Reinforcement Learning for Multi-Objective Real-Time Flexible Scheduling in a Smart Shop Floor

A Deep Multi-Agent Reinforcement Learning Approach to Solve Dynamic Job Shop Scheduling Problem

A multi-objective reinforcement learning approach for resequencing scheduling problems in automotive manufacturing systems

Logistics-involved QoS-aware service composition in cloud manufacturing with deep reinforcement learning

A reinforcement learning approach for dynamic multi-objective optimization

Probabilistic Automata-Based Method for Enhancing Performance of Deep Reinforcement Learning Systems

A Dual-System Reinforcement Learning Method for Flexible Job Shop Dynamic Scheduling

Workshop Facility Layout Optimization Based on Deep Reinforcement Learning

Multi-objective optimization framework for deepwater riser jetting installation parameters using deep reinforcement learning

A deep reinforcement learning method for replacement optimization of aero-engine