Abstract:Abstract Efficient exploration of design spaces is highly sought after in engineering applications. A spectrum of tools has been proposed to deal with the computational difficulties associated with such problems. In the context of our case study, these tools can be broadly classified into optimization and supervised learning approaches. Optimization approaches, while successful, are inherently data inefficient, with evolutionary optimization-based methods being a good example. This inefficiency stems from data not being reused from previous design explorations. Alternately, supervised learning-based design paradigms are data efficient. However, the quality of ensuing solutions depends heavily on the quality of data available. Furthermore, it is difficult to incorporate physics models and domain knowledge aspects of design exploration into pure-learning-based methods. In this work, we formulate a reinforcement learning (RL)-based design framework that mitigates disadvantages of both approaches. Our framework simultaneously finds solutions that are more efficient compared with supervised learning approaches while using data more efficiently compared with genetic algorithm (GA)-based optimization approaches. We illustrate our framework on a problem of microfluidic device design for flow sculpting, and our results show that a single generic RL agent is capable of exploring the solution space to achieve multiple design objectives. Additionally, we demonstrate that the RL agent can be used to solve more complex problems using a targeted refinement step. Thus, we address the data efficiency limitation of optimization-based methods and the limited data problem of supervised learning-based methods. The versatility of our framework is illustrated by utilizing it to gain domain insights and to incorporate domain knowledge. We envision such RL frameworks to have an impact on design science.

Innovation Design Oriented Functional Knowledge Integration Framework Based on Reinforcement Learning.

Study on knowledge integration system oriented to product design

GoodFloorplan: Graph Convolutional Network and Reinforcement Learning-Based Floorplanning

An Integration Technology of One Domain and Cross Domain Evolution of Industrial Design Knowledge

A case-based knowledge graph with reinforcement learning for intelligent design approach of complex product

Research on knowledge navigation supporting rapid design of complex product

Functional Knowledge Integration of the Design Process

Research on Knowledge Support Technology for Product Innovation Design Based on Quality Function Knowledge Deployment

A Conceptual Design Method Based on C-K Theory and Large Language Models

A Case Study of Deep Reinforcement Learning for Engineering Design: Application to Microfluidic Devices for Flow Sculpting

An Integrated Rfbse Model for Managing and Reusing Engineering Design Knowledge

A C-RFBS Model for the Efficient Construction and Reuse of Interpretable Design Knowledge Records Across Knowledge Networks

A closed-loop human-computer interactive design method based on sequential human intention prediction and knowledge recommendation

Novel Frame System of Knowledge Service Platform for Modern Design and Its Knowledge Flow Rules

Integration of Knowledge Management in Product Design Process.

The Knowledge Representation and Reuse in Product Design

"Deep Reinforcement Learning for Engineering Design Through Topology Optimization of Elementally Discretized Design Domains"

A knowledge-guided process planning approach with reinforcement learning

Knowledge-Driven Product Innovation Design

On Knowledge Integration in the Context of Virtual Product Development

Study on Modelling of the Product Design Knowledge Based on Functional Feature Partition