Abstract:Abstract Efficient exploration of design spaces is highly sought after in engineering applications. A spectrum of tools has been proposed to deal with the computational difficulties associated with such problems. In the context of our case study, these tools can be broadly classified into optimization and supervised learning approaches. Optimization approaches, while successful, are inherently data inefficient, with evolutionary optimization-based methods being a good example. This inefficiency stems from data not being reused from previous design explorations. Alternately, supervised learning-based design paradigms are data efficient. However, the quality of ensuing solutions depends heavily on the quality of data available. Furthermore, it is difficult to incorporate physics models and domain knowledge aspects of design exploration into pure-learning-based methods. In this work, we formulate a reinforcement learning (RL)-based design framework that mitigates disadvantages of both approaches. Our framework simultaneously finds solutions that are more efficient compared with supervised learning approaches while using data more efficiently compared with genetic algorithm (GA)-based optimization approaches. We illustrate our framework on a problem of microfluidic device design for flow sculpting, and our results show that a single generic RL agent is capable of exploring the solution space to achieve multiple design objectives. Additionally, we demonstrate that the RL agent can be used to solve more complex problems using a targeted refinement step. Thus, we address the data efficiency limitation of optimization-based methods and the limited data problem of supervised learning-based methods. The versatility of our framework is illustrated by utilizing it to gain domain insights and to incorporate domain knowledge. We envision such RL frameworks to have an impact on design science.

Deep reinforcement learning framework for end-to-end semiconductor process control

Reinforcement Learning for Process Control with Application in Semiconductor Manufacturing

Deep reinforcement learning-assisted extended state observer for run-to-run control in the semiconductor manufacturing process

Semiconductor Fab Scheduling with Self-Supervised and Reinforcement Learning

Using intelligent technology and real-time feedback algorithm to improve manufacturing process in IoT semiconductor industry

Optimal data-driven control of manufacturing processes using reinforcement learning: an application to wire arc additive manufacturing

A digital twin to train deep reinforcement learning agent for smart manufacturing plants: Environment, interfaces and intelligence

Deep reinforcement learning for process design: Review and perspective

AI-based Modeling and Data-driven Evaluation for Smart Manufacturing Processes

An Efficient and Flexible Learning Framework for Dynamic Power and Thermal Co-Management

Ai-based optimal control of fed-batch biopharmaceutical process leveraging deep reinforcement learning

Unsupervised reward engineering for reinforcement learning controlled manufacturing

Development of AI-based process controller of sour water treatment unit using deep reinforcement learning

Human–machine collaboration for improving semiconductor process development

Deep reinforcement learning in smart manufacturing: A review and prospects

Reinforcement Learning with Composite Rewards for Production Scheduling in a Smart Factory.

A MULTI-AGENT REINFORCEMENT LEARNING FRAMEWORK FOR INTELLIGENT MANUFACTURING WITH AUTONOMOUS MOBILE ROBOTS

Towards a General Framework to Embed Advanced Machine Learning in Process Control Systems

Integration of AI and Machine Learning in Semiconductor Manufacturing for Defect Detection and Yield Improvement

Progressive hierarchical deep reinforcement learning for defect wafer test

A Case Study of Deep Reinforcement Learning for Engineering Design: Application to Microfluidic Devices for Flow Sculpting