Abstract:The simulation of high-energy physics collision events is a key element for data analysis at present and future particle accelerators. The comparison of simulation predictions to data allows looking for rare deviations that can be due to new phenomena not previously observed. We show that novel machine learning algorithms, specifically Normalizing Flows and Flow Matching, can be used to replicate accurate simulations from traditional approaches with several orders of magnitude of speed-up. The classical simulation chain starts from a physics process of interest, computes energy deposits of particles and electronics response, and finally employs the same reconstruction algorithms used for data. Eventually, the data are reduced to some high-level analysis format. Instead, we propose an end-to-end approach, simulating the final data format directly from physical generator inputs, skipping any intermediate steps. We use particle jets simulation as a benchmark for comparing both discrete and continuous Normalizing Flows models. The models are validated across a variety of metrics to identify the most accurate. We discuss the scaling of performance with the increase in training data, as well as the generalization power of these models on physical processes different from the training one. We investigate sampling multiple times from the same physical generator inputs, a procedure we name oversampling, and we show that it can effectively reduce the statistical uncertainties of a dataset. This class of ML algorithms is found to be capable of learning the expected detector response independently of the physical input process. Their speed and accuracy, coupled with the stability of the training procedure, make them a compelling tool for the needs of current and future experiments.

Classifier Surrogates: Sharing AI-based Searches with the World

Generative machine learning for detector response modeling with a conditional normalizing flow

Unifying Simulation and Inference with Normalizing Flows

Uncertainty quantification and out-of-distribution detection using surjective normalizing flows

SurroFlow: A Flow-Based Surrogate Model for Parameter Space Exploration and Uncertainty Quantification

End-to-end simulation of particle physics events with Flow Matching and generator Oversampling

Flow Matching Beyond Kinematics: Generating Jets with Particle-ID and Trajectory Displacement Information

Conditional Pseudo-Reversible Normalizing Flow for Surrogate Modeling in Quantifying Uncertainty Propagation

Probabilistic Surrogate Networks for Simulators with Unbounded Randomness

From strange-quark tagging to fragmentation tagging with machine learning

Improving $Λ$ Signal Extraction with Domain Adaptation via Normalizing Flows

ν-Flows: Conditional Neutrino Regression

Interpretable deep learning models for the inference and classification of LHC data

Fast Posterior Probability Sampling with Normalizing Flows and Its Applicability in Bayesian analysis in Particle Physics

Anomaly detection with flow-based fast calorimeter simulators

Normalizing Flows for High-Dimensional Detector Simulations

TopicFlow: Disentangling quark and gluon jets with normalizing flows

Flow Matching for Scalable Simulation-Based Inference

Universal Anomaly Detection at the LHC: Transforming Optimal Classifiers and the DDD Method