Abstract:Machine learning (ML) models of accelerator systems ('surrogate models') are able to provide fast, accurate predictions of accelerator physics phenomena. However, approaches to date typically do not include measured input diagnostics, such as the initial beam distributions, which are critical for accurately representing the beam evolution through the system. In addition, these inputs often vary over time, and models that can account for these changing conditions are needed. As beam time for measurements is often limited, simulations are in some cases needed to provide sufficient training data. These typically represent the designed machine before construction; however, the behavior of the installed components may be quite different due to changes over time or static differences that were not modeled. Therefore, surrogate models that can leverage both simulation and measured data successfully are needed. We introduce an approach based on convolutional neural networks that uses the drive laser distribution and scalar settings as inputs for a photoinjector system model (here, the linac coherent light source II, LCLS-II, injector frontend). The model is able to predict scalar beam parameters and the transverse beam distribution downstream, taking into account the impact of time-varying non-uniformities in the initial transverse laser distribution. We also introduce and evaluate a transfer learning procedure for adapting the surrogate model from the simulation domain to the measurement domain, to account for differences between the two. Applying this approach to our test case results in a model that can predict test sample outputs within a mean absolute percent error of 9%. This is a substantial improvement over the model trained only on simulations, which has an error of 261% when applied to measured data. While we focus on the LCLS-II Injector frontend, these approaches for improving ML-based online modeling of injector systems could be easily adapted to other accelerator facilities.

Invertible Surrogate Models: Joint surrogate modelling and reconstruction of Laser-Wakefield Acceleration by invertible neural networks

Neural Network-Based Surrogate Model for Inverse Design of Metasurfaces

Bayesian Inference and Deep Learning for Inverse Problems

Surrogate-Based Inverse Modeling of the Hydrological System: An Adaptive Approach Considering Surrogate Structural Error.

Rapid Surrogate Modeling of Electromagnetic Data in Frequency Domain Using Neural Operator.

Solving inverse problems using conditional invertible neural networks

Surrogate modeling for Bayesian inverse problems based on physics-informed neural networks

Unified, Verifiable Neural Simulators for Electromagnetic Wave Inverse Problems

Surrogate Models studies for laser-plasma accelerator electron source design through numerical optimisation

Symplectic neural surrogate models for beam dynamics

Improving surrogate model accuracy for the LCLS-II injector frontend using convolutional neural networks and transfer learning

Rapid surrogate modeling of magnetotelluric in the frequency domain using physics-driven deep neural networks

Transfer Learning Enhanced Full Waveform Inversion

Surrogate Modeling of the CLIC Final-Focus System using Artificial Neural Networks

Convergence and Recovery Guarantees of Unsupervised Neural Networks for Inverse Problems

Adaptive neural network surrogate model for solving the nonlinear elastic inverse problem via Bayesian inference

InversionNet: A Real-Time and Accurate Full Waveform Inversion with CNNs and continuous CRFs

Neural Networks as Effective Surrogate Models of Radio-Frequency Quadrupole Particle Accelerator Simulations

Applications of ML-Based Surrogates in Bayesian Approaches to Inverse Problems

An adaptive surrogate modeling based on deep neural networks for large-scale Bayesian inverse problems