Abstract:Nuclear reactors are vital to the global economy due to the large amounts of baseload power they can provide with minimal intermittence. However, these reactors are extremely complicated to design and build. Therefore, any improvement in the design process and timeline of nuclear reactor development would have a significant impact on the reactor design community and the world. In recent years, machine learning (ML) algorithms have gained popularity in handling difficult problems that previously required too much data or computational power to effectively solve. These include natural language processing, computer vision, and advanced process optimization. ML algorithms present a potentially powerful tool in the realm of reactor design and have already been implemented in some specific reactor design and operational optimization applications by researchers around the world. While these previous uses of ML algorithms are effective, they are very specific and a more generalized, and easily applied framework could potentially be used to accelerate the design of Gen IV reactors, reducing the workload of reactor designers and researchers. The development of such a versatile framework for reactor optimization using ML, CFD, and neutronic codes, and the validation of such, was the purpose of this work. The baseline reactor to be optimized was the BYU Molten Salt Micro-Reactor ( Larsen et al., 2023 ). To establish this ML optimization, 35 training runs were completed using STARCCM + CFD software, and OpenMC neutronic modeling to generate data. The 3-dimensional cartesian data were extracted for each run, providing up to several million data points per training run. Moderator thickness, salt thickness, and moderator housing (plate) thickness were variables in the geometric optimization, and regressor type, data quantity per run, and training run quantity were variables in the model optimization. The model was first optimized by weighing model variables against train and test accuracy. This optimal model was then given 4096 geometric reactor iterations, and a temperature profile was predicted for each. The lowest-temperature option was chosen as lower temperature results in longer structural material life and less required secondary cooling expense, as well as more favorable neutronics. This result was then validated in CFD. The optimal reactor design surpassed all training runs by at least 220 K in maximum temperature, 85 K in average temperature, and 49 K in standard deviation of temperature. These represent significant improvement over all training designs and the baseline design.

Design Optimization of Nuclear Fusion Reactor through Deep Reinforcement Learning

Physics-informed Reinforcement Learning optimization of PWR core loading pattern

Design optimization of heat exchanger using deep reinforcement learning

Assessment of reinforcement learning algorithms for nuclear power plant fuel optimization

Multi-objective optimization of thermal power and outlet steam temperature for a nuclear steam supply system with deep reinforcement learning

Intelligent optimization method for real-time decision-making in laminated cooling configurations through reinforcement learning

Reactor Optimization Benchmark by Reinforcement Learning

Physics-Assisted Deep Reinforcement Learning-Based TSV Array Design for Signal and Power Integrity Co-Optimization

Optimizing the Fixed Number Detector Placement for the Nuclear Reactor Core Using Reinforcement Learning

"Deep Reinforcement Learning for Engineering Design Through Topology Optimization of Elementally Discretized Design Domains"

A Case Study of Deep Reinforcement Learning for Engineering Design: Application to Microfluidic Devices for Flow Sculpting

Multistep Criticality Search and Power Shaping in Microreactors with Reinforcement Learning

A novel reinforcement learning-based method for structure optimization

Optimization of passive modular molten salt microreactor geometric perturbations using machine learning

Computational Discovery of Energy-Efficient Heat Treatment for Microstructure Design using Deep Reinforcement Learning

Deep Neural Network-Based Surrogate Model for Optimal Component Sizing of Power Converters Using Deep Reinforcement Learning

DRLinFluids---An open-source python platform of coupling Deep Reinforcement Learning and OpenFOAM

Injection Optimization at Particle Accelerators via Reinforcement Learning: From Simulation to Real-World Application

Deep Reinforcement Learning for Inverse Inorganic Materials Design

A physics‐informed deep reinforcement learning framework for autonomous steel frame structure design