Machine Learning for New Physics Searches

Raffaele Tito D'Agnolo

DOI: https://doi.org/10.48550/arXiv.1809.11150

2018-09-29

Abstract:This is the summary of a talk given at CIPANP 2018. I briefly introduce neural networks and then discuss a new technique for model-independent new physics searches in background-dominated datasets.

High Energy Physics - Phenomenology

What problem does this paper attempt to address?

Machine learning in the search for new fundamental physics

Georgia Karagiorgi,Gregor Kasieczka,Scott Kravitz,Benjamin Nachman,David Shih

DOI: https://doi.org/10.1038/s42254-022-00455-1

IF: 36.273

2022-05-19

Nature Reviews Physics

Abstract:Compelling experimental evidence suggests the existence of new physics beyond the well-established and tested standard model of particle physics. Various current and upcoming experiments are searching for signatures of new physics. Despite the variety of approaches and theoretical models tested in these experiments, what they all have in common is the very large volume of complex data that they produce. This data challenge calls for powerful statistical methods. Machine learning has been in use in high-energy particle physics for well over a decade, but the rise of deep learning in the early 2010s has yielded a qualitative shift in terms of the scope and ambition of research. These modern machine learning developments are the focus of the present Review, which discusses methods and applications for new physics searches in the context of terrestrial high-energy physics experiments, including the Large Hadron Collider, rare event searches and neutrino experiments.

physics, applied, multidisciplinary
Machine learning in experimental neutrino physics

N. Poonthottathil

DOI: https://doi.org/10.1140/epjs/s11734-024-01280-6

2024-08-21

The European Physical Journal Special Topics

Abstract:Neutrino physics has entered into the era of precision measurements. Over the last two decades, significant efforts have been made to measure precise parameters of the PMNS matrix, which describes neutrino oscillation phenomena. The next generation neutrino experiment will prioritize measuring leptonic CP-violation, potentially revealing the matter–antimatter asymmetry of the universe. Technological advancements will enable faster and more precise measurements. This article describes how neutrino experiments, will utilize machine learning techniques to identify and reconstruct different neutrino event topology in detectors. This approach promises unprecedented measurements of neutrino oscillation parameters.

physics, multidisciplinary
Modern Machine Learning for LHC Physicists

Tilman Plehn,Anja Butter,Barry Dillon,Theo Heimel,Claudius Krause,Ramon Winterhalder

2024-04-12

Abstract:Modern machine learning is transforming particle physics fast, bullying its way into our numerical tool box. For young researchers it is crucial to stay on top of this development, which means applying cutting-edge methods and tools to the full range of LHC physics problems. These lecture notes lead students with basic knowledge of particle physics and significant enthusiasm for machine learning to relevant applications. They start with an LHC-specific motivation and a non-standard introduction to neural networks and then cover classification, unsupervised classification, generative networks, and inverse problems. Two themes defining much of the discussion are well-defined loss functions and uncertainty-aware networks. As part of the applications, the notes include some aspects of theoretical LHC physics. All examples are chosen from particle physics publications of the last few years.

High Energy Physics - Phenomenology
Beyond Cuts in Small Signal Scenarios -- Enhanced Sneutrino Detectability Using Machine Learning

Daniel Alvestad,Nikolai Fomin,Jörn Kersten,Steffen Maeland,Inga Strümke

DOI: https://doi.org/10.1140/epjc/s10052-023-11532-9

2023-07-07

Abstract:We investigate enhancing the sensitivity of new physics searches at the LHC by machine learning in the case of background dominance and a high degree of overlap between the observables for signal and background. We use two different models, XGBoost and a deep neural network, to exploit correlations between observables and compare this approach to the traditional cut-and-count method. We consider different methods to analyze the models' output, finding that a template fit generally performs better than a simple cut. By means of a Shapley decomposition, we gain additional insight into the relationship between event kinematics and the machine learning model output. We consider a supersymmetric scenario with a metastable sneutrino as a concrete example, but the methodology can be applied to a much wider class of models.

High Energy Physics - Phenomenology,Machine Learning
A Review on Machine Learning for Neutrino Experiments

Fernanda Psihas,Micah Groh,Christopher Tunnell,Karl Warburton

DOI: https://doi.org/10.1142/S0217751X20430058

2020-08-04

Abstract:Neutrino experiments study the least understood of the Standard Model particles by observing their direct interactions with matter or searching for ultra-rare signals. The study of neutrinos typically requires overcoming large backgrounds, elusive signals, and small statistics. The introduction of state-of-the-art machine learning tools to solve analysis tasks has made major impacts to these challenges in neutrino experiments across the board. Machine learning algorithms have become an integral tool of neutrino physics, and their development is of great importance to the capabilities of next generation experiments. An understanding of the roadblocks, both human and computational, and the challenges that still exist in the application of these techniques is critical to their proper and beneficial utilization for physics applications. This review presents the current status of machine learning applications for neutrino physics in terms of the challenges and opportunities that are at the intersection between these two fields.

Computational Physics,High Energy Physics - Experiment
Novel machine learning applications at the LHC

Javier M. Duarte

2024-09-30

Abstract:Machine learning (ML) is a rapidly growing area of research in the field of particle physics, with a vast array of applications at the CERN LHC. ML has changed the way particle physicists conduct searches and measurements as a versatile tool used to improve existing approaches and enable fundamentally new ones. In these proceedings, we describe novel ML techniques and recent results for improved classification, fast simulation, unfolding, and anomaly detection in LHC experiments.

High Energy Physics - Experiment,Machine Learning
High energy nuclear physics meets Machine Learning

Wan-Bing He,Yu-Gang Ma,Long-Gang Pang,Huichao Song,Kai Zhou

2023-03-13

Abstract:Though being seemingly disparate and with relatively new intersection, high energy nuclear physics and machine learning have already begun to merge and yield interesting results during the last few years. It's worthy to raise the profile of utilizing this novel mindset from machine learning in high energy nuclear physics, to help more interested readers see the breadth of activities around this intersection. The aim of this mini-review is to introduce to the community the current status and report an overview of applying machine learning for high energy nuclear physics, to present from different aspects and examples how scientific questions involved in high energy nuclear physics can be tackled using machine learning.

High Energy Physics - Phenomenology,High Energy Physics - Experiment,Nuclear Experiment,Nuclear Theory
Searching for Exotic Particles in High-Energy Physics with Deep Learning

Pierre Baldi,Peter Sadowski,Daniel Whiteson

DOI: https://doi.org/10.1038/ncomms5308

2014-06-06

Abstract:Collisions at high-energy particle colliders are a traditionally fruitful source of exotic particle discoveries. Finding these rare particles requires solving difficult signal-versus-background classification problems, hence machine learning approaches are often used. Standard approaches have relied on `shallow' machine learning models that have a limited capacity to learn complex non-linear functions of the inputs, and rely on a pain-staking search through manually constructed non-linear features. Progress on this problem has slowed, as a variety of techniques have shown equivalent performance. Recent advances in the field of deep learning make it possible to learn more complex functions and better discriminate between signal and background classes. Using benchmark datasets, we show that deep learning methods need no manually constructed inputs and yet improve the classification metric by as much as 8\% over the best current approaches. This demonstrates that deep learning approaches can improve the power of collider searches for exotic particles.

High Energy Physics - Phenomenology,High Energy Physics - Experiment
Colloquium: Machine Learning in Nuclear Physics

A. Boehnlein,M. Diefenthaler,Nobuo Sato,M. Schram,V. Ziegler,C. Fanelli,M. Hjorth‐Jensen,T. Horn,Michelle Kuchera,Dean Lee,W. Nazarewicz,P. N. Ostroumov,Kostas Orginos,A. W. P. Poon,Xin‐Nian Wang,Alexander Scheinker,M. S. Smith,Long-Gang Pang

DOI: https://doi.org/10.1103/revmodphys.94.031003

IF: 50.485

2022-01-01

Reviews of Modern Physics

Abstract:Nuclear physics deals with complex systems, large datasets, and complicated correlations between parameters, which makes the field suitable for the application of machine learning techniques. Machine learning can help classify and analyze data, find hidden correlations, and assist in the design of new experiments and detectors. This Colloquium explains how this will lead to advances in nuclear theory, experimental methods and data acquisition, and accelerator technology.
Physics-informed machine learning approaches to reactor antineutrino detection

Sophia Farrell,Marc Bergevin,Adam Bernstein

2024-07-09

Abstract:Nuclear reactors produce a high flux of MeV-scale antineutrinos that can be observed through inverse beta-decay (IBD) interactions in particle detectors. Reliable detection of reactor IBD signals depends on suppression of backgrounds, both by physical shielding and vetoing and by pattern recognition and rejection in acquired data. A particularly challenging background to reactor antineutrino detection is from cosmogenically induced fast neutrons, which can mimic the characteristics of an IBD signal. In this work, we explore two methods of machine learning -- a tree-based classifier and a graph-convolutional neural network -- to improve rejection of fast neutron-induced background events in a water Cherenkov detector. The tree-based classifier examines classification at the reconstructed feature level, while the graphical network classifies events using only the raw signal data. Both methods improve the sensitivity for a background-dominant search over traditional cut-and-count methods, with the greatest improvement being from the tree-based classification method. These performance enhancements are relevant for reactor monitoring applications that make use of deep underground oil-based or water-based kiloton-scale detectors with multichannel, PMT-based readouts, and they are likely extensible to other similar physics analyses using this class of detector.

Instrumentation and Detectors,High Energy Physics - Experiment,Data Analysis, Statistics and Probability
Universal New Physics Latent Space

Anna Hallin,Gregor Kasieczka,Sabine Kraml,André Lessa,Louis Moureaux,Tore von Schwartz,David Shih

2024-07-30

Abstract:We develop a machine learning method for mapping data originating from both Standard Model processes and various theories beyond the Standard Model into a unified representation (latent) space while conserving information about the relationship between the underlying theories. We apply our method to three examples of new physics at the LHC of increasing complexity, showing that models can be clustered according to their LHC phenomenology: different models are mapped to distinct regions in latent space, while indistinguishable models are mapped to the same region. This opens interesting new avenues on several fronts, such as model discrimination, selection of representative benchmark scenarios, and identifying gaps in the coverage of model space.

High Energy Physics - Phenomenology,Machine Learning,High Energy Physics - Experiment,Data Analysis, Statistics and Probability
Improving Neutrino Energy Reconstruction with Machine Learning

Joachim Kopp,Pedro Machado,Margot MacMahon,Ivan Martinez-Soler

2024-05-25

Abstract:Faithful energy reconstruction is foundational for precision neutrino experiments like DUNE, but is hindered by uncertainties in our understanding of neutrino--nucleus interactions. Here, we demonstrate that dense neural networks are very effective in overcoming these uncertainties by estimating inaccessible kinematic variables based on the observable part of the final state. We find improvements in the energy resolution by up to a factor of two compared to conventional reconstruction algorithms, which translates into an improved physics performance equivalent to a 10-30% increase in the exposure.

High Energy Physics - Phenomenology,High Energy Physics - Experiment
Special Topic: Applications of the Machine Learning in Nuclear Physics

He WanBing,He JunJie,Wang Rui,Ma YuGang

DOI: https://doi.org/10.1360/sspma-2021-0309

2021-01-01

Abstract:Machine learning is the most successful and active research direction in the field of artificial intelligence. It is being applied in various fields, such as big data analysis, autonomous driving, natural language processing, Internet technology, medical diagnosis, and market analysis. Accordingly, it is also widely used in the experimental and theoretical research of particle physics. This article discusses several machine learning techniques that are particularly relevant to nuclear physics. Additionally, the application of machine learning in various contexts of nuclear physics research is demonstrated through several different cases, including the deep convolutional neural networks combined with theoretical models to extract information about the nuclear cluster structure from low level data, unsupervised learning methods applied to experimental data to extract information about nuclear liquid-gas phase transitions, and neural network quantum state (NQS) as a trial wave function to solve the Schrodinger equation. Bayesian neural networks are applied to fit and predict the nucleus radius, and image recognition is applied to identify events in the active target time projection chamber detector. It shows the wide application of machine learning technology in the field of nuclear physics.
Deep Learning usage by Large Experiments

Benjamin Nachman

DOI: https://doi.org/10.1088/1742-6596/1085/2/022002

2018-09-01

Journal of Physics: Conference Series

Abstract:The modern machine learning revolution holds great promise for high energy physics. Enormous detectors have been designed to search for rare signals in order to expose the smallest distance scales in nature. Modern tools like deep neural networks will be required to fully explore the sub-nuclear universe. Using the radiation pattern inside high energy jets as an example, we show how neural networks are being used in new ways to produce a class of techniques that were not previously possible.
Machine learning techniques for intermediate mass gap lepton partner searches at the large hadron collider

Bhaskar Dutta,Tathagata Ghosh,Alyssa Horne,Jason Kumar,Sean Palmer,Pearl Sandick,Marcus Snedeker,Patrick Stengel,Joel W. Walker

DOI: https://doi.org/10.1103/physrevd.109.075018

IF: 5.407

2024-04-12

Physical Review D

Abstract:We consider machine learning techniques associated with the application of a boosted decision tree (BDT) to searches at the Large Hadron Collider (LHC) for pair-produced lepton partners which decay to leptons and invisible particles. This scenario can arise in the minimal supersymmetric Standard Model (MSSM), but can be realized in many other extensions of the Standard Model (SM). We focus on the case of intermediate mass splitting ( ∼30 GeV ) between the dark matter (DM) and the scalar. For these mass splittings, the LHC has made little improvement over LEP due to large electroweak backgrounds. We find that the use of machine learning techniques can push the LHC well past discovery sensitivity for a benchmark model with a lepton partner mass of ∼110 GeV , for an integrated luminosity of 300 fb−1 , with a signal-to-background ratio of ∼0.3 . The LHC could exclude models with a lepton partner mass as large as ∼160 GeV with the same luminosity. The use of machine learning techniques in searches for scalar lepton partners at the LHC could thus definitively probe the parameter space of the MSSM in which scalar muon mediated interactions between SM muons and Majorana singlet DM can both deplete the relic density through dark matter annihilation and satisfy the recently measured anomalous magnetic moment of the muon. We identify several machine learning techniques which can be useful in other LHC searches involving large and complex backgrounds. https://doi.org/10.1103/PhysRevD.109.075018 Published by the American Physical Society under the terms of the Creative Commons Attribution 4.0 International license. Further distribution of this work must maintain attribution to the author(s) and the published article's title, journal citation, and DOI. Funded by SCOAP 3 . Published by the American Physical Society

astronomy & astrophysics,physics, particles & fields
Deep Learning and Its Application to LHC Physics

Dan Guest,Kyle Cranmer,Daniel Whiteson

DOI: https://doi.org/10.1146/annurev-nucl-101917-021019

2018-10-19

Annual Review of Nuclear and Particle Science

Abstract:Machine learning has played an important role in the analysis of high-energy physics data for decades. The emergence of deep learning in 2012 allowed for machine learning tools which could adeptly handle higher-dimensional and more complex problems than previously feasible. This review is aimed at the reader who is familiar with high-energy physics but not machine learning. The connections between machine learning and high-energy physics data analysis are explored, followed by an introduction to the core concepts of neural networks, examples of the key results demonstrating the power of deep learning for analysis of LHC data, and discussion of future prospects and concerns.

physics, particles & fields, nuclear
Advancing Physics Data Analysis through Machine Learning and Physics-Informed Neural Networks

Vasileios Vatellis

2024-10-18

Abstract:In an era increasingly focused on green computing and explainable AI, revisiting traditional approaches in theoretical and phenomenological particle physics is paramount. This project evaluates various machine learning (ML) algorithms-including Nearest Neighbors, Decision Trees, Random Forest, AdaBoost, Naive Bayes, Quadratic Discriminant Analysis (QDA), and XGBoost-alongside standard neural networks and a novel Physics-Informed Neural Network (PINN) for physics data analysis. We apply these techniques to a binary classification task that distinguishes the experimental viability of simulated scenarios based on Higgs observables and essential parameters. Through this comprehensive analysis, we aim to showcase the capabilities and computational efficiency of each model in binary classification tasks, thereby contributing to the ongoing discourse on integrating ML and Deep Neural Networks (DNNs) into physics research. In this study, XGBoost emerged as the preferred choice among the evaluated machine learning algorithms for its speed and effectiveness, especially in the initial stages of computation with limited datasets. However, while standard Neural Networks and Physics-Informed Neural Networks (PINNs) demonstrated superior performance in terms of accuracy and adherence to physical laws, they require more computational time. These findings underscore the trade-offs between computational efficiency and model sophistication.

High Energy Physics - Phenomenology,Machine Learning
A novel quantum machine learning classifier to search for new physics

Ji-Chong Yang,Shuai Zhang,Chong-Xing Yue

2024-10-24

Abstract:Due to the success of the Standard Model~(SM), it is reasonable to anticipate that, the signal of new physics~(NP) beyond the SM is small, and future searches for NP and precision tests of the SM will require high luminosity collider experiments. Moreover, as the precision tests of the SM advances, rarer processes with a greater number of final-state particles will require consideration, which will in turn require the analysis of a multitude of observables. As an inherent consequence of the high luminosity, the generation of a large amount of experimental data in a large feature space presents a significant challenge for data processing. In recent years, quantum machine learning has emerged as a promising approach for processing large amounts of complex data on a quantum computer. In this study, we propose a variational quantum searching neighbor~(VQSN) algorithm to search for NP. As an example, we apply the VQSN in the phenomenological study of the gluon quartic gauge couplings~(gQGCs) at the Large Hadron Collider. The results suggest that VQSN demonstrates superior efficiency to a classical counterpart k-nearest neighbor algorithm, even when dealing with classical data.

High Energy Physics - Phenomenology,Quantum Physics
Data-driven and model-agnostic approach to solving combinatorial assignment problems in searches for new physics

Anthony Badea,Javier Montejo Berlingen

DOI: https://doi.org/10.1103/physrevd.109.l011702

IF: 5.407

2024-01-10

Physical Review D

Abstract:We present a novel approach to solving combinatorial assignment problems in particle physics. The correct assignment of decay products to parent particles is achieved in a model-agnostic fashion by introducing a neural network architecture, p asswd- abc , which combines a custom layer based on attention mechanisms and dual autoencoders. We demonstrate how the network, trained purely on background events in an unsupervised setting, is capable of reconstructing correctly hypothetical new particles regardless of their mass, decay multiplicity, and substructure, and produces simultaneously an anomaly score that can be used to efficiently suppress the background. This model allows the extension of the suite of searches for localized excesses to include nonresonant particle pair production where the reconstruction of the two resonant masses is thwarted by combinatorics. https://doi.org/10.1103/PhysRevD.109.L011702 Published by the American Physical Society under the terms of the Creative Commons Attribution 4.0 International license. Further distribution of this work must maintain attribution to the author(s) and the published article's title, journal citation, and DOI. Funded by SCOAP 3 . Published by the American Physical Society

astronomy & astrophysics,physics, particles & fields
Machine learning in nuclear physics at low and intermediate energies

Wanbing He,Qingfeng Li,Yugang Ma,Zhongming Niu,Junchen Pei,Yingxun Zhang

DOI: https://doi.org/10.1007/s11433-023-2116-0

2023-07-06

Science China: Physics, Mechanics and Astronomy

Abstract:Machine learning (ML) is becoming a new paradigm for scientific research in various research fields due to its exciting and powerful capability of modeling tools used for big-data processing tasks. In this review, we first briefly introduce the different methodologies used in ML algorithms and techniques. As a snapshot of many applications by ML, some selected applications are presented, especially for low- and intermediate-energy nuclear physics, which include topics on theoretical applications in nuclear structure, nuclear reactions, properties of nuclear matter, and experimental applications in event identification/reconstruction, complex system control, and firmware performance. Finally, we present a summary and outlook on the possible directions of ML use in low-intermediate energy nuclear physics and possible improvements in ML algorithms.

physics, multidisciplinary

Machine Learning for New Physics Searches

Machine learning in the search for new fundamental physics

Machine learning in experimental neutrino physics

Modern Machine Learning for LHC Physicists

Beyond Cuts in Small Signal Scenarios -- Enhanced Sneutrino Detectability Using Machine Learning

A Review on Machine Learning for Neutrino Experiments

Novel machine learning applications at the LHC

High energy nuclear physics meets Machine Learning

Searching for Exotic Particles in High-Energy Physics with Deep Learning

Colloquium: Machine Learning in Nuclear Physics

Physics-informed machine learning approaches to reactor antineutrino detection

Universal New Physics Latent Space

Improving Neutrino Energy Reconstruction with Machine Learning

Special Topic: Applications of the Machine Learning in Nuclear Physics

Deep Learning usage by Large Experiments

Machine learning techniques for intermediate mass gap lepton partner searches at the large hadron collider

Deep Learning and Its Application to LHC Physics

Advancing Physics Data Analysis through Machine Learning and Physics-Informed Neural Networks

A novel quantum machine learning classifier to search for new physics

Data-driven and model-agnostic approach to solving combinatorial assignment problems in searches for new physics

Machine learning in nuclear physics at low and intermediate energies