ML4PhySim : Machine Learning for Physical Simulations Challenge (The airfoil design)

Mouadh Yagoubi,Milad Leyli-Abadi,David Danan,Jean-Patrick Brunet,Jocelyn Ahmed Mazari,Florent Bonnet,Asma Farjallah,Marc Schoenauer,Patrick Gallinari
2024-03-04
Abstract:The use of machine learning (ML) techniques to solve complex physical problems has been considered recently as a promising approach. However, the evaluation of such learned physical models remains an important issue for industrial use. The aim of this competition is to encourage the development of new ML techniques to solve physical problems using a unified evaluation framework proposed recently, called Learning Industrial Physical Simulations (LIPS). We propose learning a task representing a well-known physical use case: the airfoil design simulation, using a dataset called AirfRANS. The global score calculated for each submitted solution is based on three main categories of criteria covering different aspects, namely: ML-related, Out-Of-Distribution, and physical compliance criteria. To the best of our knowledge, this is the first competition addressing the use of ML-based surrogate approaches to improve the trade-off computational cost/accuracy of physical simulation.The competition is hosted by the Codabench platform with online training and evaluation of all submitted solutions.
Machine Learning,Computational Engineering, Finance, and Science
What problem does this paper attempt to address?
The paper aims to address the use of machine learning (ML) techniques in physical simulations, particularly in the design of wings in aerodynamics. Specifically, the goals of the paper are as follows: 1. **Promote the application of machine learning models in solving physical problems**: By exploring various hybrid strategies to improve the performance of machine learning models in physical simulations. 2. **Enhance transparency and industrial relevance**: Require participants to submit untrained models to be retrained and evaluated on the server, ensuring models are reproducible and independently tested, thereby increasing the transparency of the entire process. 3. **Encourage collaboration between artificial intelligence and physical sciences**: Design new machine learning methods (algorithms, architectures) to solve physical problems. 4. **Ensure meaningful evaluation of submitted machine learning agent models**: Achieve homogeneous comparison of different physical tasks through the multi-criteria evaluation method proposed by the LIPS framework. 5. **Benchmark all submissions in the same environment**: Especially to fairly compare acceleration effects. 6. **Promote collaboration and knowledge sharing among participants from different communities (machine learning and physical sciences)**. 7. **The ultimate goal is to develop more efficient, reliable, and cost-effective solutions** to benefit industry and society as a whole. The paper achieves the above goals by organizing a competition called ML4PhySim. The competition focuses on the problem of wing design in computational fluid dynamics (CFD) and uses the LIPS framework to evaluate and rank the solutions submitted by participants. The core purpose of the competition is to optimize the trade-off between solution accuracy and computational cost, while considering out-of-distribution (OOD) generalization ability and adherence to fundamental physical constraints.