Abstract:We present a methodology for performing scans of BSM parameter spaces with reinforcement learning (RL). We identify a novel procedure using graph neural networks that is capable of exploring spaces of models without the user specifying a fixed particle content, allowing broad classes of BSM models to be explored. In theory, the technique is applicable to nearly any model space with a pre-specified gauge group. We provide a generic procedure by which a suitable graph grammar can be developed for any BSM model which features user-specified symmetry groups and a finite number of different possible particle species. As a proof of concept, we construct the graph grammar for theories with vector-like leptons that may or may not be charged under a dark U(1) group, inspired by portal matter extensions of the sub-GeV vector portal/kinetic mixing simplified dark matter models. We then use this graph grammar to create a RL environment tasked with creating models with these vector-like leptons that are consistent with a list of a variety of precision observables. The RL agent succeeds in developing models that can address the observed muon anomalous magnetic moment discrepancy while remaining consistent with flavor violation and electroweak precision observables, including both constructions that have previously been studied as well as new models which have not, to our knowledge, previously been identified. By inspecting the resulting ensembles of models that the agent produces and experimenting with different configurations for our RL environment and graph grammar, we also infer various lessons about the development of these environments that can be transferable to RL scans of more complicated model spaces, and comment on future directions for the development of this technique into a more mature tool.

Towards Beyond Standard Model Model-Building with Reinforcement Learning on Graphs

Graph Reinforcement Learning for Exploring BSM Model Spaces

Reinforcement learning-based statistical search strategy for an axion model from flavor

Graph Neural Networks in Particle Physics

Learning Symbolic Physics with Graph Networks

Toward an AI Physicist for Unsupervised Learning

Design Your Own Universe: A Physics-Informed Agnostic Method for Enhancing Graph Neural Networks

Model-based Meta Reinforcement Learning using Graph Structured Surrogate Models and Amortized Policy Search

Exploring the flavor structure of quarks and leptons with reinforcement learning

Graph learning-based generation of abstractions for reinforcement learning

GraphOpt: Learning Optimization Models of Graph Formation

Universal New Physics Latent Space

Simple, but not simplified: A new approach for optimising beyond-Standard Model physics searches at the Large Hadron Collider

Foundations and Frontiers of Graph Learning Theory

Model Gradient: Unified Model and Policy Learning in Model-Based Reinforcement Learning

Exploring Potential Energy Surfaces Using Reinforcement Machine Learning.

A cooperative game for automated learning of elasto-plasticity knowledge graphs and models with AI-guided experimentation

Branes with Brains: Exploring String Vacua with Deep Reinforcement Learning

Machine learning in the search for new fundamental physics

Deep Reinforcement Learning in Finite-Horizon to Explore the Most Probable Transition Pathway

Subspace Graph Physics: Real-Time Rigid Body-Driven Granular Flow Simulation