Abstract:We present a methodology for performing scans of BSM parameter spaces with reinforcement learning (RL). We identify a novel procedure using graph neural networks that is capable of exploring spaces of models without the user specifying a fixed particle content, allowing broad classes of BSM models to be explored. In theory, the technique is applicable to nearly any model space with a pre-specified gauge group. We provide a generic procedure by which a suitable graph grammar can be developed for any BSM model which features user-specified symmetry groups and a finite number of different possible particle species. As a proof of concept, we construct the graph grammar for theories with vector-like leptons that may or may not be charged under a dark U(1) group, inspired by portal matter extensions of the sub-GeV vector portal/kinetic mixing simplified dark matter models. We then use this graph grammar to create a RL environment tasked with creating models with these vector-like leptons that are consistent with a list of a variety of precision observables. The RL agent succeeds in developing models that can address the observed muon anomalous magnetic moment discrepancy while remaining consistent with flavor violation and electroweak precision observables, including both constructions that have previously been studied as well as new models which have not, to our knowledge, previously been identified. By inspecting the resulting ensembles of models that the agent produces and experimenting with different configurations for our RL environment and graph grammar, we also infer various lessons about the development of these environments that can be transferable to RL scans of more complicated model spaces, and comment on future directions for the development of this technique into a more mature tool.

Graph Reinforcement Learning for Exploring BSM Model Spaces

Towards Beyond Standard Model Model-Building with Reinforcement Learning on Graphs

Graph learning-based generation of abstractions for reinforcement learning

Model-based Meta Reinforcement Learning using Graph Structured Surrogate Models and Amortized Policy Search

Introducing Symmetries to Black Box Meta Reinforcement Learning

Exploring Supersymmetry with Machine Learning

Subequivariant Graph Reinforcement Learning in 3D Environments

Branes with Brains: Exploring String Vacua with Deep Reinforcement Learning

Exploring Parameter Space with Structured Noise for Meta-Reinforcement Learning

A survey on model-based reinforcement learning

Probing intractable beyond-standard-model parameter spaces armed with Machine Learning

Learning Latent Dynamic Robust Representations for World Models

Exploring the flavor structure of quarks and leptons with reinforcement learning

Sketching an open invisible space with multiagent reinforcement learning

Structure learning with Temporal Gaussian Mixture for model-based Reinforcement Learning

Bayesian Active Search on Parameter Space: a 95 GeV Spin-0 Resonance in the ($B-L$)SSM

Autonomous Exploration Under Uncertainty via Deep Reinforcement Learning on Graphs

Explore with Dynamic Map: Graph Structured Reinforcement Learning

Exploiting Generalization in the Subspaces for Faster Model-Based Reinforcement Learning

Geometric Active Exploration in Markov Decision Processes: the Benefit of Abstraction

An Analysis of Model-Based Reinforcement Learning From Abstracted Observations