Energy-efficient tool path generation and expansion optimisation for five-axis flank milling with meta-reinforcement learning

Liu, Yang

DOI: https://doi.org/10.1007/s10845-024-02412-4

IF: 8.3

2024-06-08

Journal of Intelligent Manufacturing

Abstract:Five-axis flank milling is prevalent in complex surfaces manufacturing, and it typically consumes high electricity energy. To save energy and improve energy efficiency, this paper proposes a tool path optimisation of five-axis flank milling by meta-reinforcement learning. Firstly, considering flank milling features, a feed angle is defined that guides tool spatial motion and identifies an ideal principal path. Then, machining energy consumption and time are modelled by tool path variables, i.e., feed angle, cutting strip width and path length. Secondly, an energy-efficient tool path dynamic optimisation model is constructed, which is then described by multiple Markov Decision Processes (MDPs). Thirdly, meta-learning integrating with the Soft Actor-Critic (MSAC) framework is utilised to address the MDPs. In an MDP with one principal path randomly generated by a feed angle, cutting strip width is dynamically optimised under a maximum scallop height limit to realise energy-efficient multi-expansions. By quick traversal of MDPs with various feed angles, MSAC enables an energy-efficient path generation and expansion integrated scheme. Experiments show that, regarding machining energy consumption and time, the proposed method achieves a reduction of 69.96% and 68.44% over the end milling with an iso-scallop height, and of 41.50% and 39.80% over the flank milling with an iso-scallop height, with a minimum amount of machining carbon emission, which highlights its contribution to the arena of energy-oriented and sustainable intelligent manufacturing.

engineering, manufacturing,computer science, artificial intelligence

What problem does this paper attempt to address?

The problem that this paper attempts to solve is to achieve high - efficiency and energy - saving tool path generation and extended optimization in 5 - axis flank milling. Specifically, the research aims to optimize the tool path in 5 - axis flank milling through the meta - reinforcement learning method to reduce energy consumption and time during the machining process while maintaining surface quality. This involves the following aspects:

1. **Define the feed angle**: Considering the characteristics of flank milling, the paper defines a feed angle to guide the spatial movement of the tool and determine the ideal main path.
2. **Establish an energy consumption model**: Model machining energy consumption and time through tool path variables (such as feed angle, cutting strip width and path length).
3. **Construct a dynamic optimization model**: Propose a dynamic optimization model to minimize machining energy consumption and time, and include the maximum peak - to - valley height constraint to ensure machining quality.
4. **Apply meta - reinforcement learning**: Utilize meta - reinforcement learning combined with the Soft Actor - Critic (SAC) framework to solve multiple Markov decision processes (MDPs) and find the optimal tool path generation and expansion scheme.

Through these methods, the paper demonstrates the significant effect of the proposed optimization method in reducing machining energy consumption and time. Compared with traditional end - milling and flank - milling methods, it reduces energy consumption by 69.96% and 68.44% respectively, and time consumption by 41.50% and 39.80% respectively, while achieving the lowest machining carbon emissions, making an important contribution to the energy - oriented and sustainable intelligent manufacturing field.