Abstract:We provide a framework for exploring physics beyond the Standard Model with reinforcement learning using graph representations of new physics theories. The graph structure allows for model-building without a priori specifying definite numbers of new particles. As a case study, we apply our method to a simple class of theories involving vectorlike leptons and a dark U(1) inspired by the portal matter paradigm. Using modern policy gradient methods, the agent successfully explores a model space consisting of both continuous and discrete parameters and identifies consistent theories. The minimal models found include both known and previously unstudied examples that can accommodate the muon anomalous magnetic moment and satisfy precision electroweak and flavor constraints. The method represents a step forward in enabling an automated model-building process for physics beyond the Standard Model.

What problem does this paper attempt to address?

The problem that this paper attempts to solve is to explore physics theories beyond the Standard Model (BSM). In particular, in the situation where experiments have imposed unprecedentedly strict constraints on these theories, how to explore the possible BSM theory space more comprehensively. Specifically, the author proposes a method based on Reinforcement Learning (RL), using Graph Neural Networks (GNNs) to represent and explore BSM theories, thereby automatically constructing new physics models that are in line with experimental observations. ### Core problems of the paper 1. **Exploring the space of BSM theories**: - The Standard Model (SM) has successfully described many particle physics phenomena, but still has deficiencies in some aspects, such as explaining neutrino mass, dark matter, etc. - Experimentally, the constraints on BSM theories are becoming increasingly strict, making it more difficult to find new physics models. - The traditional method of manually constructing BSM models is inefficient and prone to missing potentially valid models. 2. **Automated model construction**: - Reinforcement learning provides a method for automatically exploring large and complex parameter spaces, especially when the feasible points are sparsely distributed. - By using a graph - structure to represent BSM theories, different numbers of new particles can be flexibly handled, and the need to pre - specify the specific number of particles can be avoided. 3. **Applied case studies**: - The author selects a class of simple BSM theories involving vector - like leptons and the dark U(1) gauge group as case studies. - These models can explain the muon anomalous magnetic moment and other precision electroweak and flavor constraints. ### Method overview - **Graph representation**: BSM theories are represented as graphs, where nodes represent fields or interaction terms, and edges represent coupling relationships. - **Reinforcement learning environment**: By defining the state space, action space, and reward mechanism, an agent is trained to explore in the BSM theory space. - **Result evaluation**: Evaluation indicators similar to the Akaike Information Criterion (AIC) are used, combined with experimental data, to evaluate the quality of the generated models. ### Main contributions - A new framework is proposed, which uses graph neural networks and reinforcement learning to automatically construct BSM models. - Known and unknown minimal models that can explain the muon anomalous magnetic moment and meet other experimental constraints have been successfully discovered. - The effectiveness and potential of this method in exploring the BSM theory space are proven, providing a new tool for further research. Through this method, researchers can explore the BSM theory space more efficiently, discover new physics models, and accelerate the feedback loop between theory and experiment.

Towards Beyond Standard Model Model-Building with Reinforcement Learning on Graphs

Graph Reinforcement Learning for Exploring BSM Model Spaces

Reinforcement learning-based statistical search strategy for an axion model from flavor

Graph Neural Networks in Particle Physics

Learning Symbolic Physics with Graph Networks

Toward an AI Physicist for Unsupervised Learning

Design Your Own Universe: A Physics-Informed Agnostic Method for Enhancing Graph Neural Networks

Model-based Meta Reinforcement Learning using Graph Structured Surrogate Models and Amortized Policy Search

Exploring the flavor structure of quarks and leptons with reinforcement learning

Graph learning-based generation of abstractions for reinforcement learning

GraphOpt: Learning Optimization Models of Graph Formation

Universal New Physics Latent Space

Simple, but not simplified: A new approach for optimising beyond-Standard Model physics searches at the Large Hadron Collider

Foundations and Frontiers of Graph Learning Theory

Model Gradient: Unified Model and Policy Learning in Model-Based Reinforcement Learning

Exploring Potential Energy Surfaces Using Reinforcement Machine Learning.

A cooperative game for automated learning of elasto-plasticity knowledge graphs and models with AI-guided experimentation

Branes with Brains: Exploring String Vacua with Deep Reinforcement Learning

Machine learning in the search for new fundamental physics

Deep Reinforcement Learning in Finite-Horizon to Explore the Most Probable Transition Pathway

Subspace Graph Physics: Real-Time Rigid Body-Driven Granular Flow Simulation