Open statistical issues in particle physics

Louis Lyons

DOI: https://doi.org/10.48550/arXiv.0811.1663

2008-11-11

Applications

Abstract:Many statistical issues arise in the analysis of Particle Physics experiments. We give a brief introduction to Particle Physics, before describing the techniques used by Particle Physicists for dealing with statistical problems, and also some of the open statistical questions.

What problem does this paper attempt to address?

Statistical Issues in Neutrino Physics Analyses

Louis Lyons

DOI: https://doi.org/10.48550/arXiv.1607.03549

2016-07-13

Abstract:Various statistical issues relevant to searches for new physics or to parameter determination in analyses of data in neutrino experiments are briefly discussed.

High Energy Physics - Experiment,Data Analysis, Statistics and Probability
The use of Ethernet in the DataFlow of the ATLAS Trigger & DAQ

Stefan Stancu,Bob Dobinson,Matei Ciobotaru,Krzysztof Korcyl,Emil Knezo

DOI: https://doi.org/10.48550/arXiv.cs/0305064

2003-05-31

Abstract:The article analyzes a proposed network topology for the ATLAS DAQ DataFlow, and identifies the Ethernet features required for a proper operation of the network: MAC address table size, switch performance in terms of throughput and latency, the use of Flow Control, Virtual LANs and Quality of Service. We investigate these features on some Ethernet switches, and conclude on their usefulness for the ATLAS DataFlow network.

Networking and Internet Architecture
Statistical Issues in Particle Physics -- A View from BaBar

Frank C. Porter

DOI: https://doi.org/10.48550/arXiv.physics/0311092

2003-11-19

Abstract:The statistical methods used in deriving physics results in the BaBar collaboration are reviewed, with especial emphasis on areas where practice is not uniform in particle physics.

Data Analysis, Statistics and Probability
A Practical Guide to Statistical Techniques in Particle Physics

Alejandro Segura,Angie Catalina Parra

2024-11-02

Abstract:In high-energy physics (HEP), both the exclusion and discovery of new theories depend not only on the acquisition of high-quality experimental data but also on the rigorous application of statistical methods. These methods provide probabilistic criteria (such as p-values) to compare experimental data with theoretical models, aiming to describe the data as accurately as possible. Hypothesis testing plays a central role in this process, as it enables comparisons between established theories and potential new explanations for the observed data. This report reviews key statistical methods currently employed in particle physics, using synthetic data and numerical comparisons to illustrate the concepts in a clear and accessible way. Our results highlight the practical significance of these statistical tools in enhancing the experimental sensitivity and model exclusion capabilities in HEP. All numerical results are estimated using Python and RooFit, a high-level statistical modeling package used by the ATLAS and CMS collaborations at CERN to model and report results from experimental data.

High Energy Physics - Phenomenology
Some Open Points in Nonextensive Statistical Mechanics

Constantino Tsallis

DOI: https://doi.org/10.1142/S0218127412300303

2011-02-12

Abstract:We present and discuss a list of some interesting points that are currently open in nonextensive statistical mechanics. Their analytical, numerical, experimental or observational advancement would naturally be very welcome.

Statistical Mechanics
Practical Statistics for Particle Physicists

Luca Lista

DOI: https://doi.org/10.23730/CYRSP-2017-005.213

2017-07-25

Abstract:These three lectures provide an introduction to the main concepts of statistical data analysis useful for precision measurements and searches for new signals in High Energy Physics. The frequentist and Bayesian approaches to probability theory are introduced and, for both approaches, inference methods are presented. Hypothesis tests will be discussed, then significance and upper limit evaluation will be presented with an overview of the modern and most advanced techniques adopted for data analysis at the Large Hadron Collider.

Data Analysis, Statistics and Probability,High Energy Physics - Experiment
Simple and Statistically Sound Recommendations for Analysing Physical Theories

Shehu S. AbdusSalam,Fruzsina J. Agocs,Benjamin C. Allanach,Peter Athron,Csaba Balázs,Emanuele Bagnaschi,Philip Bechtle,Oliver Buchmueller,Ankit Beniwal,Jihyun Bhom,Sanjay Bloor,Torsten Bringmann,Andy Buckley,Anja Butter,José Eliel Camargo-Molina,Marcin Chrzaszcz,Jan Conrad,Jonathan M. Cornell,Matthias Danninger,Jorge de Blas,Albert De Roeck,Klaus Desch,Matthew Dolan,Herbert Dreiner,Otto Eberhardt,John Ellis,Ben Farmer,Marco Fedele,Henning Flächer,Andrew Fowlie,Tomás E. Gonzalo,Philip Grace,Matthias Hamer,Will Handley,Julia Harz,Sven Heinemeyer,Sebastian Hoof,Selim Hotinli,Paul Jackson,Felix Kahlhoefer,Kamila Kowalska,Michael Krämer,Anders Kvellestad,Miriam Lucio Martinez,Farvah Mahmoudi,Diego Martinez Santos,Gregory D. Martinez,Satoshi Mishima,Keith Olive,Ayan Paul,Markus Tobias Prim,Werner Porod,Are Raklev,Janina J. Renk,Christopher Rogan,Leszek Roszkowski,Roberto Ruiz de Austri,Kazuki Sakurai,Andre Scaffidi,Pat Scott,Enrico Maria Sessolo,Tim Stefaniak,Patrick Stöcker,Wei Su,Sebastian Trojanowski,Roberto Trotta,Yue-Lin Sming Tsai,Jeriek Van den Abeele,Mauro Valli,Aaron C. Vincent,Georg Weiglein,Martin White,Peter Wienemann,Lei Wu,Yang Zhang

DOI: https://doi.org/10.1088/1361-6633/ac60ac

2022-01-01

Reports on Progress in Physics

Abstract:Physical theories that depend on many parameters or are tested against data from many different experiments pose unique challenges to statistical inference. Many models in particle physics, astrophysics and cosmology fall into one or both of these categories. These issues are often sidestepped with statistically unsound ad hoc methods, involving intersection of parameter intervals estimated by multiple experiments, and random or grid sampling of model parameters. Whilst these methods are easy to apply, they exhibit pathologies even in low-dimensional parameter spaces, and quickly become problematic to use and interpret in higher dimensions. In this article we give clear guidance for going beyond these procedures, suggesting where possible simple methods for performing statistically sound inference, and recommendations of readily-available software tools and standards that can assist in doing so. Our aim is to provide any physicists lacking comprehensive statistical training with recommendations for reaching correct scientific conclusions, with only a modest increase in analysis burden. Our examples can be reproduced with the code publicly available at https://doi.org/10.5281/zenodo.4322283.
Introduction to statistical physics outside physics

Dietrich Stauffer

DOI: https://doi.org/10.1016/j.physa.2004.01.004

2004-05-01

Abstract:We review the possibilities and difficulties for statistical physicists if they apply their methods to biology, economics, or sociology. WARNING: I report opinions, not simulations.
The use of statistical methods for the search for new physics at the LHC (in Russian)

S. I. Bityukov,N. V. Krasnikov,S.I. Bityukov,N.V. Krasnikov

DOI: https://doi.org/10.48550/arXiv.1107.3974

2011-07-20

Data Analysis, Statistics and Probability

Abstract:We review statistical methods used for the search for new physics at LHC.
Probability and Statistics for Particle Physicists

J. Ocariz

DOI: https://doi.org/10.48550/arXiv.1405.3402

2014-05-14

Abstract:Lectures presented at the 1st CERN Asia-Europe-Pacific School of High-Energy Physics, Fukuoka, Japan, 14-27 October 2012. A pedagogical selection of topics in probability and statistics is presented. Choice and emphasis are driven by the author's personal experience, predominantly in the context of physics analyses using experimental data from high-energy physics detectors.

Data Analysis, Statistics and Probability
Open Problems within Nonextensive Statistical Mechanics

Kenric P. Nelson

2024-01-22

Abstract:Nonextensive Statistical Mechanics has developed into an important framework for modeling the thermodynamics of complex systems and the information of complex signals. Upon the 80th birthday of the field's founder, Constantino Tsallis, a review of open problems that can stimulate future research is provided. Over the thirty-year development of NSM a variety of criticisms have been published ranging from questions about the justification for generalizing the entropy function to interpretation of the generalizing parameter q. While these criticisms have been addressed in the past and the breadth of applications has demonstrated the utility of the NSM methodologies, this review provides insights on how the field can continue to improve the understanding and application of complex system models. The review starts by grounding q-statistics within scale-shape distributions and then frames a series of open problems for investigation. The open problems include using the degree of freedom to quantify the difference between entropy and its generalization; clarifying the physical interpretation of the parameter q; improving the definition of the generalized product using multidimensional analysis; defining a generalized Fourier transform applicable to signal processing applications; and re-examination of the normalization of nonextensive entropy. The review concludes with a proposal that the shape parameter is a candidate for defining the statistical complexity of a system.

Statistical Mechanics
Statistics for Searches at the LHC

Glen Cowan

DOI: https://doi.org/10.48550/arXiv.1307.2487

2013-07-09

Abstract:These lectures describe several topics in statistical data analysis as used in High Energy Physics. They focus on areas most relevant to analyses at the LHC that search for new physical phenomena, including statistical tests for discovery and exclusion limits. Particular attention is payed to the treatment of systematic uncertainties through nuisance parameters.

High Energy Physics - Experiment,Data Analysis, Statistics and Probability
The dynamics of discrete particles in turbulent flows: open issues and current challenges in statistical modeling

Jean-Pierre Minier,Christophe Henry

2023-11-03

Abstract:This article is an invitation. It is, first, an invitation to consider as a subject worthy of attention the wide range of situations where small discrete elements, either bubbles, droplets or solid particles, are embedded in turbulent flows. Occurring often at a human scale and in our daily environments, these turbulent dispersed two-phase flows display complex behavior due to the interplay of two fundamental interactions, the fluid-particle and particle-particle interactions, compounded by the turbulence of the carrier flow. This is not a domain where the basic laws are unknown but where the huge number of degrees of freedom involved call for reduced, or coarse-grained, statistical descriptions to be developed. Since we are considering transport and collision phenomena or relaxation processes, it would seem that they can be handled by kinetic theory. In the general case of non-fully resolved turbulent flows, we are however dealing with particles influenced by random media with non-zero time and space correlations. The second invitation is therefore to recognize the limitations of kinetic-based descriptions and to address the challenges driving us to extend the classical framework, for fluid-particle as well as particle-particle interactions. Taking the standpoint provided by the modern formulation of stochastic processes and focusing on the description of the particle phase, this review proposes a step-by-step pedagogical presentation of current models while pointing out new directions and remaining uncharted territories. This is done to provide answers to the question `why?' as much as `how?' and to try to kindle interest into these open and fascinating issues.

Fluid Dynamics
Recent Theoretical Advances and Open Problems in Nuclear Cluster Physics

P.Schuck

DOI: https://doi.org/10.48550/arXiv.1811.11580

2018-11-28

Abstract:This contribution gives a short review of recent theoretical advances in most topics of nuclear cluster physics concentrating, however, around {$\alpha$} particle clustering. Along the route, the point of view will be critical mentioning not only progress but also failures and open problems.

Nuclear Theory
An appropriate statistical approach for nonequilibrium particle production

Abdel Nasser Tawfik,Eman R. Abou Elyazeed,A. A. Alshehri,Hayam Yassin

2024-09-15

Abstract:The incapability of thermal models to accurately reproduce the horn-like structure of the Kaon-to-pion ratio measured at AGS, SPS, and low RHIC energies, as well as confirmed in the beam energy scan program, has long been a persistent problem. This issue is believed to have arisen due to the inappropriate application of statistics, particularly the extensive additive Boltzmann-Gibbs (BG) statistics. The assumption that the analysis of particle production, a dynamic nonequilibrium process, should be primarily conducted using extensive BG or nonextensive Tsallis statistics, has proven to be an unsuccessful approach that has been followed for several decades. By employing generic (non)extensive statistics, two equivalence classes $(c,d)$ emerge, thereby undermining the validity of any ad hoc assumption. Consequently, the degree of (non)extensivity exhibited by the statistical ensemble is determined by its own characteristics. This encompasses both extensive BG statistics, characterized by $(1,1)$, and nonextensive Tsallis statistics, characterized by $(0,q)$. The energy dependence of light-, $\gamma_q$, and strange-quark occupation factor, $\gamma_s$, suggests that the produced particles are most appropriately described as a nonequilibrium ensemble. This is evidenced by a remarkable nonmonotonic behavior observed in the $\mathrm{K}^+/\pi^+$ horn, for instance. On the other hand, the resulting equivalence classes $(c,d)$ are associated with a generic nonextensivity related to extended exponential and Lambert-$W_0$ exponentially generating distribution function, which evidently arise from free, short- and long-range correlations. The incorporation of generic nonextensive statistics into the hadron resonance gas model yields an impressive ability to rightfully reproduce the nonmonotonic $\mathrm{K}^+/\pi^+$ ratio.

High Energy Physics - Phenomenology
On Understanding Statistical Data Analysis in Higher Education

Vera Montalbano

DOI: https://doi.org/10.48550/arXiv.1202.1794

2012-02-08

Physics Education

Abstract:Data analysis is a powerful tool in all experimental sciences. Statistical methods, such as sampling theory, computer technologies necessary for handling large amounts of data, skill in analysing information contained in different types of graphs are all competences necessary for achieving an in-depth data analysis. In higher education, these topics are usually fragmentized in different courses, the interdisciplinary integration can lack, some caution in the use of these topics can missing or be misunderstood. Students are often obliged to acquire these skills by themselves during the preparation of the final experimental thesis. A proposal for a learning path on nuclear phenomena is presented in order to develop these scientific competences in physics courses. An introduction to radioactivity and nuclear phenomenology is followed by measurements of natural radioactivity. Background and weak sources can be monitored for long time in a physics laboratory. The data are collected and analyzed in a computer lab in order to understand the importance of statistical analysis in a not trivial case.
On the foundations of statistical mechanics

Marco Baldovin,Giacomo Gradenigo,Angelo Vulpiani,Nino Zanghì

2024-11-13

Abstract:Although not as wide, and popular, as that of quantum mechanics, the investigation of fundamental aspects of statistical mechanics constitutes an important research field in the building of modern physics. Besides the interest for itself, both for physicists and philosophers, and the obvious pedagogical motivations, there is a further, compelling reason for a thorough understanding of the subject. The fast development of models and methods at the edge of the established domain of the field requires indeed a deep reflection on the essential aspects of the theory, which are at the basis of its success. These elements should never be disregarded when trying to expand the domain of statistical mechanics to systems with novel, little known features. It is thus important to (re)consider in a careful way the main ingredients involved in the foundations of statistical mechanics. Among those, a primary role is covered by the dynamical aspects (e.g. presence of chaos), the emergence of collective features for large systems, and the use of probability in the building of a consistent statistical description of physical systems. With this goal in mind, in the present review we aim at providing a consistent picture of the state of the art of the subject, both in the classical and in the quantum realm. In particular, we will highlight the similarities of the key technical and conceptual steps with emphasis on the relevance of the many degrees of freedom, to justify the use of statistical ensembles in the two domains.

Statistical Mechanics
Nonextensive Statistical Mechanics: Some Links with Astronomical Phenomena

Constantino Tsallis,Constantino Tsallis,Domingo Prato,Angel R. Plastino,Angel R. Plastino

DOI: https://doi.org/10.1023/b:astr.0000032528.99179.4f

2004-01-01

Astrophysics and Space Science

Abstract:A variety of astronomical phenomena appear to not satisfy the ergodic hypothesis in the relevant stationary state, if any. As such, there is no reason for expecting the applicability of Boltzmann–Gibbs (BG) statistical mechanics. Some of these phenomena appear to follow, instead, nonextensive statistical mechanics. In the same manner that the BG formalism is based on the entropy SBG=−k∑ipi ln pi, the nonextensive one is based on the form Sq=k(1 −∑ipiq)/(q− 1) (with S1=SBG). The stationary states of the former are characterized by an exponential dependence on the energy, whereas those of the latter are characterized by an (asymptotic) power law. A brief review of this theory is given here, as well as of some of its applications, such as the solar neutrino problem, polytropic self-gravitating systems, galactic peculiar velocities, cosmic rays and some cosmological aspects. In addition to these, an analogy with the Keplerian elliptic orbits versus the Ptolemaic epicycles is developed, where we show that optimizing Sq with a few constraints is equivalent to optimizing SBG with an infinite number of constraints.

astronomy & astrophysics
Open Heavy Flavors in Nuclear Collisions: Theory Overview

Pol Bernard Gossiaux

DOI: https://doi.org/10.1016/j.nuclphysa.2018.10.076

2019-01-07

Abstract:I review the current status and some prospects of theoretical studies on open heavy flavor physics in nuclear collisions at RHIC and LHC energies.

Nuclear Theory,High Energy Physics - Phenomenology,Nuclear Experiment

Open statistical issues in particle physics

Statistical Issues in Neutrino Physics Analyses

The use of Ethernet in the DataFlow of the ATLAS Trigger & DAQ

Statistical Issues in Particle Physics -- A View from BaBar

A Practical Guide to Statistical Techniques in Particle Physics

Some Open Points in Nonextensive Statistical Mechanics

Practical Statistics for Particle Physicists

Simple and Statistically Sound Recommendations for Analysing Physical Theories

Introduction to statistical physics outside physics

The use of statistical methods for the search for new physics at the LHC (in Russian)

Probability and Statistics for Particle Physicists

Open Problems within Nonextensive Statistical Mechanics

Statistics for Searches at the LHC

The dynamics of discrete particles in turbulent flows: open issues and current challenges in statistical modeling

Recent Theoretical Advances and Open Problems in Nuclear Cluster Physics

An appropriate statistical approach for nonequilibrium particle production

On Understanding Statistical Data Analysis in Higher Education

On the foundations of statistical mechanics

Nonextensive Statistical Mechanics: Some Links with Astronomical Phenomena

Open Heavy Flavors in Nuclear Collisions: Theory Overview