Abstract:Abstract Efficient exploration of design spaces is highly sought after in engineering applications. A spectrum of tools has been proposed to deal with the computational difficulties associated with such problems. In the context of our case study, these tools can be broadly classified into optimization and supervised learning approaches. Optimization approaches, while successful, are inherently data inefficient, with evolutionary optimization-based methods being a good example. This inefficiency stems from data not being reused from previous design explorations. Alternately, supervised learning-based design paradigms are data efficient. However, the quality of ensuing solutions depends heavily on the quality of data available. Furthermore, it is difficult to incorporate physics models and domain knowledge aspects of design exploration into pure-learning-based methods. In this work, we formulate a reinforcement learning (RL)-based design framework that mitigates disadvantages of both approaches. Our framework simultaneously finds solutions that are more efficient compared with supervised learning approaches while using data more efficiently compared with genetic algorithm (GA)-based optimization approaches. We illustrate our framework on a problem of microfluidic device design for flow sculpting, and our results show that a single generic RL agent is capable of exploring the solution space to achieve multiple design objectives. Additionally, we demonstrate that the RL agent can be used to solve more complex problems using a targeted refinement step. Thus, we address the data efficiency limitation of optimization-based methods and the limited data problem of supervised learning-based methods. The versatility of our framework is illustrated by utilizing it to gain domain insights and to incorporate domain knowledge. We envision such RL frameworks to have an impact on design science.

Trial-and-Error Learning for MEMS Structural Design Enabled by Deep Reinforcement Learning

Deep learning for non-parameterized MEMS structural design

A Mems Electro-Mechanical Co-Optimization Platform Featuring Freeform Geometry Optimization Based on a Genetic Algorithm

Design of Freeform Geometries in a MEMS Accelerometer with a Mechanical Motion Preamplifier Based on a Genetic Algorithm

GENETIC ALGORITHM FOR THE DESIGN OF FREEFORM GEOMETRIES IN A MEMS ACCELEROMETER COMPRISING A MECHANICAL MOTION PRE-AMPLIFIER

Optimal Design of Planar Microwave Microfluidic Sensors Based on Deep Reinforcement Learning

Accelerating Multilayer Frequency Selective Surface Absorber Design by Combining Equivalent Circuit Models with Machine Learning

Machine learning guided design of mechanically efficient metamaterials with auxeticity

A Case Study of Deep Reinforcement Learning for Engineering Design: Application to Microfluidic Devices for Flow Sculpting

Deep Reinforcement Learning for the Design of Metamaterial Mechanisms with Functional Compliance Control

Systematic Direct Solid Modeling Approach for Surface Micromachined Mems

Acoustic Structure Inverse Design and Optimization Using Deep Learning

Interactive Inverse Design of Layered Phononic Crystals Based on Reinforcement Learning

Deep reinforcement learning for the design of mechanical metamaterials with tunable deformation and hysteretic characteristics

Self-supervised feature distillation and design of experiments for efficient training of micromechanical deep learning surrogates

A novel evolutionary method for parameter-free MEMS structural design and its application in piezoresistive pressure sensors

A System-Level Simulation Approach for Analyzing MEMS Gyroscope Manufacture Error

Nonlinear dynamical behavior and energy harvesting analyses of flexoelectric MEMS under residual stresses: Application of machine learning for simulating the system

Machine Learning-Based Modeling and Generic Design Optimization Methodology for Radio-Frequency Microelectromechanical Devices

Deep Learning in Mechanical Metamaterials: From Prediction and Generation to Inverse Design

Deep reinforcement learning for tuning active vibration control on a smart piezoelectric beam