Computing for the Energy Frontier: Snowmass Study 2013

Ian Fisk,Jim Shank

DOI: https://doi.org/10.48550/arXiv.1401.1840

2014-01-08

High Energy Physics - Experiment

Abstract:The Contribution for the Computing for the Energy Frontier as part of the Snowmass study is discussed.

What problem does this paper attempt to address?

Snowmass 2013 Computing Frontier: Networking

Gregory Bell,Michael Ernst

DOI: https://doi.org/10.48550/arXiv.1311.2478

2013-11-12

Abstract:Computing has become a major component of all particle physics experiments and in many areas of theoretical particle physics. Progress in HEP experiment and theory will require significantly more computing, software development, storage, and networking, with different projects stretching future capabilities in different ways. However, there are many common needs among different areas in HEP, so more community planning is advised to increase efficiency. Careful and continuing review of the topics we studied, i.e., user needs and capabilities of current and future technology, is needed.

High Energy Physics - Experiment
Snowmass Energy Frontier Simulations using the Open Science Grid (A Snowmass 2013 whitepaper)

A. Avetisyan,S. Bhattacharya,M. Narain,S. Padhi,J. Hirschauer,T. Levshina,P. McBride,C. Sehgal,M. Slyz,M. Rynge,S. Malik,J. Stupak III

DOI: https://doi.org/10.48550/arXiv.1308.0843

2013-10-02

Abstract:Snowmass is a US long-term planning study for the high-energy community by the American Physical Society's Division of Particles and Fields. For its simulation studies, opportunistic resources are harnessed using the Open Science Grid infrastructure. Late binding grid technology, GlideinWMS, was used for distributed scheduling of the simulation jobs across many sites mainly in the US. The pilot infrastructure also uses the Parrot mechanism to dynamically access CvmFS in order to ascertain a homogeneous environment across the nodes. This report presents the resource usage and the storage model used for simulating large statistics Standard Model backgrounds needed for Snowmass Energy Frontier studies.

High Energy Physics - Experiment,Distributed, Parallel, and Cluster Computing
Snowmass 2013 Computing Frontier: Intensity Frontier

B. Rebel,M. C. Sanchez,S. Wolbers

DOI: https://doi.org/10.48550/arXiv.1310.6964

2013-10-25

High Energy Physics - Experiment

Abstract:The Intensity Frontier (IF) is a primary focus of the U.S.-based particle physics program. It encompasses a large spectrum of physics, including quark flavor physics, charged lepton processes, neutrinos, baryon number violation, new light weakly-coupled particles, and nucleons, nuclei and atoms. There are many experiments, a range of scales in data output and throughput, and a wide range in the number of experimenters. The experiments, projects and theory in this area all require demanding computing capabilities and technologies. The IF experiments have significant computing requirements for simulation, theory and modeling, beam line and experiment design, triggers and DAQ, online monitoring, event reconstruction and processing, and physics analysis. We have conducted a qualitative survey of the current and near-term future experiments in the IF to understand the computing demands of this area and their expected evolution. This report details the expected computing requirements for the IF in the context of the Snowmass Community Summer Study 2013.
Snowmass 2013 Computing Frontier: Accelerator Science

p spentzouris,estelle cormiermichel,c joshi,j amundson,woojin an,david l bruhwiler,john r cary,benjamin m cowan,viktor k decyk,e esarey,ricardo a fonseca,a friedman,c g r geddes,d p grote,i kourbanis,w p leemans,w lu,warren b mori,c ng,j qiang,t j roberts,robert d ryne,c schroeder,l o silva,frank shihyu tsung,j l vay,j d vieira

2013-01-01

Abstract: This is the working summary of the Accelerator Science working group of the Computing Frontier of the Snowmass meeting 2013. It summarizes the computing requirements to support accelerator technology in both Energy and Intensity Frontiers.
Snowmass Computational Frontier: Topical Group Report on Quantum Computing

Travis S. Humble,Gabriel N. Perdue,Martin J. Savage

DOI: https://doi.org/10.48550/arXiv.2209.06786

2022-09-15

Abstract:Quantum computing will play a pivotal role in the High Energy Physics (HEP) science program over the early parts of the 21$^{st}$ Century, both as a major expansion of our capabilities across the Computational Frontier, and in synthesis with quantum sensing and quantum networks. This report outlines how Quantum Information Science (QIS) and HEP are deeply intertwined endeavors that benefit enormously from a strong engagement together. Quantum computers do not represent a detour for HEP, rather they are set to become an integral part of our discovery toolkit. Problems ranging from simulating quantum field theories, to fully leveraging the most sensitive sensor suites for new particle searches, and even data analysis will run into limiting bottlenecks if constrained to our current computing paradigms. Easy access to quantum computers is needed to build a deeper understanding of these opportunities. In turn, HEP brings crucial expertise to the national quantum ecosystem in quantum domain knowledge, superconducting technology, cryogenic and fast microelectronics, and massive-scale project management. The role of quantum technologies across the entire economy is expected to grow rapidly over the next decade, so it is important to establish the role of HEP in the efforts surrounding QIS. Fully delivering on the promise of quantum technologies in the HEP science program requires robust support. It is important to both invest in the co-design opportunities afforded by the broader quantum computing ecosystem and leverage HEP strengths with the goal of designing quantum computers tailored to HEP science.

Quantum Physics,High Energy Physics - Experiment,High Energy Physics - Phenomenology,High Energy Physics - Theory
Snowmass 2013 Computing Frontier Storage and Data Management

Michelle Butler,Richard Mount,Mike Hildreth

DOI: https://doi.org/10.48550/arXiv.1311.4580

2013-11-18

High Energy Physics - Experiment

Abstract:The data storage and data management needs are summarized for the energy frontier, intensity frontier, cosmic frontier, lattice field theory, perturbative QCD and accelerator science. The outlook for data storage technologies and costs is then outlined, followed by a summary of the current state of data, software and physics analysis capability preservation. The HEP outlook is summarized, pointing out where future data volumes may strain against what is technologically and financially feasible. Finally recommendations for areas of particular attention and action are made.
Instrumentation for the Energy Frontier

Ulrich Heintz,Daniela Bortoletto,Marcus Hohlmann,Thomas LeCompte,Ron Lipton,Meenakshi Narain,Andrew White

DOI: https://doi.org/10.48550/arXiv.1309.0162

2013-08-31

Instrumentation and Detectors

Abstract:The Instrumentation Frontier was set up as a part of the Snowmass 2013 Community Summer Study to examine the instrumentation R&D needed to support particle physics research over the coming decade. This report summarizes the findings of the Energy Frontier subgroup of the Instrumentation Frontier.
Intensity Frontier Instrumentation

S. H. Kettell,R. A. Rameika,R. S. Tschirhart,S.H. Kettell,R.A. Rameika,R.S. Tschirhart

DOI: https://doi.org/10.48550/arXiv.1309.6704

2013-09-26

High Energy Physics - Experiment

Abstract:This report summarizes findings of the 2013 Snowmass Community Summer Study Instrumentation Frontier's subgroup on the Intensity Frontier. This report is directed at identifying instrumentation R&D needed to support particle physics research over the coming decades at the Intensity Frontier.
New Particles Working Group Report of the Snowmass 2013 Community Summer Study

y gershtein,markus a luty,m narain,lin tong wang,d whiteson,kaustubh agashe,leonard apanasevich,g artoni,aram avetisyan,howard baer,christoph bartels,m e bauer,d berge,m berggren,s k bhattacharya,k m black,t bose,j brau,r brock,e brownson,m cahillrowley,altan cakir,a chaus,timothy cohen,baradhwaj coleppa,r c cotta,nathaniel craig,keith r dienes,bogdan a dobrescu,daniel duggan,rouven essig,j a evans,a drlicawagner,s funk,jayamol george,florian goertz,t golling,t han,a haas,michael hance,daniel hayden,u heintz,a henrichs,joanne l hewett,j f hirschauer,k howe,ahmed ismail,k kaadze,yevgeny kats,felix kling,d kolchmeyer,d kr ucker,k c kong,amit kumar,graham d kribs,paul langacker,a lath,s j lee,j list,tingan lin,l linssen,t liu,z liu,a lobanov,j loyal,a martin,i a melzerpellmann,mihoko m nojiri,sanjay padhi,n parashar,b penning,maxim perelstein,michael e peskin,albert pierce,werner porod,c t potter,thomas g rizzo,g sciolla,john stupak,s su,tim m p tait,t tanabe,brian f thomas,stuart p thomas,s n upadhyay,n varelas,e w varnes,luca vecchi,a venturini,benedikt vormwald,jay g wacker,michael j walker,m e j wood,f yu,ning zhou

2017-01-01

Abstract: This report summarizes the work of the Energy Frontier New Physics working group of the 2013 Community Summer Study (Snowmass).
Snowmass Computational Frontier: Topical Group Report on Experimental Algorithm Parallelization

G. Cerati,K. Heitmann,W. Hopkins,J. Bennett,T.Y. Chen,V.V. Gligorov,O. Gutsche,S. Habib,M. Kortelainen,C. Leggett,R. Mandelbaum,N. Whitehorn,M. Williams

DOI: https://doi.org/10.48550/arXiv.2209.07356

2022-09-15

Abstract:The substantial increase in data volume and complexity expected from future experiments will require significant investment to prepare experimental algorithms. These algorithms include physics object reconstruction, calibrations, and processing of observational data. In addition, the changing computing architecture landscape, which will be primarily composed of heterogeneous resources, will continue to pose major challenges with regard to algorithmic migration. Portable tools need to be developed that can be shared among the frontiers (e.g., for code execution on different platforms) and opportunities, such as forums or cross-experimental working groups, need to be provided where experiences and lessons learned can be shared between experiments and frontiers. At the same time, individual experiments also need to invest considerable resources to develop algorithms unique to their needs (e.g., for facilities dedicated to the experiment), and ensure that their specific algorithms will be able to efficiently exploit external heterogeneous computing facilities. Common software tools represent a cost-effective solution, providing ready-to-use software solutions as well as a platform for R\&D work. These are particularly important for small experiments which typically do not have dedicated resources needed to face the challenges imposed by the evolving computing technologies. Workforce development is a key concern across frontiers and experiments, and additional support is needed to provide career opportunities for researchers working in the field of experimental algorithm development. Finally, cross-discipline collaborations going beyond high-energy physics are a key ingredient to address the challenges ahead and more support for such collaborations needs to be created. This report targets future experiments, observations and experimental algorithm development for the next 10-15 years.

High Energy Physics - Experiment
Snowmass 2021 Computational Frontier CompF03 Topical Group Report: Machine Learning

Phiala Shanahan,Kazuhiro Terao,Daniel Whiteson

DOI: https://doi.org/10.48550/arXiv.2209.07559

2022-09-16

Abstract:The rapidly-developing intersection of machine learning (ML) with high-energy physics (HEP) presents both opportunities and challenges to our community. Far beyond applications of standard ML tools to HEP problems, genuinely new and potentially revolutionary approaches are being developed by a generation of talent literate in both fields. There is an urgent need to support the needs of the interdisciplinary community driving these developments, including funding dedicated research at the intersection of the two fields, investing in high-performance computing at universities and tailoring allocation policies to support this work, developing of community tools and standards, and providing education and career paths for young researchers attracted by the intellectual vitality of machine learning for high energy physics.

Computational Physics,Artificial Intelligence,High Energy Physics - Experiment,High Energy Physics - Lattice,High Energy Physics - Theory
Energy Efficiency in Cloud Computing: Exploring the Intellectual Structure of the Research Field and Its Research Fronts with Direct Citation Analysis

Adam Kozakiewicz,Andrzej Lis

DOI: https://doi.org/10.3390/en14217036

IF: 3.2

2021-10-27

Energies

Abstract:The aim of the study is to explore the intellectual structure of the field and fronts in research on energy efficiency in the context of cloud computing and thus to contribute to science mapping of the research field. The research process was driven by the following study questions: (1) what are the most influential publications in the research field? and (2) what are the research fronts in the research field? The method of direct citation analysis was employed in the research process. Data for analysis were obtained from the Scopus database and analyzed with the use of VOSviewer science mapping software. In response to the first question, we identified the most influential publications in the research field and analyzed their types (i.e., whether they are original research papers or rather the “context” papers e.g., survey or review papers, framework papers, challenges papers, and study papers). Moreover, a comparison analysis between the types of papers among the most cited “classical” publications and “emerging stars” was conducted. In response to the second research question, we identified five research fronts concentrated around the issues of: virtual machine management (“VM”); task-focus, concerning data replication, task consolidation, and task scheduling (“task”); energy efficiency (“energy”); modelling and optimization (“model”); and energy efficiency in the networking context (“network”).

energy & fuels
The ECP ALPINE project: In situ and post hoc visualization infrastructure and analysis capabilities for exascale

James Ahrens,Marco Arienti,Utkarsh Ayachit,Janine Bennett,Roba Binyahib,Ayan Biswas,Peer-Timo Bremer,Eric Brugger,Roxana Bujack,Hamish Carr,Jieyang Chen,Hank Childs,Soumya Dutta,Abdelilah Essiari,Berk Geveci,Cyrus Harrison,Subhashis Hazarika,Megan Hickman Fulp,Petar Hristov,Xuan Huang,Joseph Insley,Yuya Kawakami,Chloe Keilers,James Kress,Matthew Larsen,Dan Lipsa,Meghanto Majumder,Nicole Marsaglia,Victor A Mateevitsi,Valerio Pascucci,John Patchett,Saumil Patel,Steve Petruzza,David Pugmire,Silvio Rizzi,David H Rogers,Oliver Rübel,Jorge Salinas,Sudhanshu Sane,Sergei Shudler,Alexandra Stewart,Karen Tsai,Terece L Turton,Will Usher,Zhe Wang,Gunther H Weber,Corey Wetterer-Nelson,Jonathan Woodring,Abhishek Yenpure

DOI: https://doi.org/10.1177/10943420241286521

2024-10-07

The International Journal of High Performance Computing Applications

Abstract:The International Journal of High Performance Computing Applications, Ahead of Print. A significant challenge on an exascale computer is the speed at which we compute results exceeds by many orders of magnitude the speed at which we save these results. Therefore the Exascale Computing Project (ECP) ALPINE project focuses on providing exascale-ready visualization solutions including in situ processing. In situ visualization and analysis runs as the simulation is run, on simulations results are they are generated avoiding the need to save entire simulations to storage for later analysis. The ALPINE project made post hoc visualization tools, ParaView and VisIt, exascale ready and developed in situ algorithms and infrastructures. The suite of ALPINE algorithms developed under ECP includes novel approaches to enable automated data analysis and visualization to focus on the most important aspects of the simulation. Many of the algorithms also provide data reduction benefits to meet the I/O challenges at exascale. ALPINE developed a new lightweight in situ infrastructure, Ascent.

computer science, theory & methods, interdisciplinary applications, hardware & architecture
Exploring the Frontiers of Energy Efficiency using Power Management at System Scale

Ahmad Maroof Karimi,Matthias Maiterth,Woong Shin,Naw Safrin Sattar,Hao Lu,Feiyi Wang

2024-08-03

Abstract:In the face of surging power demands for exascale HPC systems, this work tackles the critical challenge of understanding the impact of software-driven power management techniques like Dynamic Voltage and Frequency Scaling (DVFS) and Power Capping. These techniques have been actively developed over the past few decades. By combining insights from GPU benchmarking to understand application power profiles, we present a telemetry data-driven approach for deriving energy savings projections. This approach has been demonstrably applied to the Frontier supercomputer at scale. Our findings based on three months of telemetry data indicate that, for certain resource-constrained jobs, significant energy savings (up to 8.5%) can be achieved without compromising performance. This translates to a substantial cost reduction, equivalent to 1438 MWh of energy saved. The key contribution of this work lies in the methodology for establishing an upper limit for these best-case scenarios and its successful application. This work sheds light on potential energy savings and empowers HPC professionals to optimize the power-performance trade-off within constrained power budgets, not only for the exascale era but also beyond.

Distributed, Parallel, and Cluster Computing
High-performance computing for materials design to advance energy science

Mark T. Lusk,Ann E. Mattsson

DOI: https://doi.org/10.1557/mrs.2011.30

IF: 5

2011-03-01

MRS Bulletin

Abstract:Abstract

materials science, multidisciplinary,physics, applied
CompF5: End User Analysis Topical Group Report

Gavin S. Davies,Peter Onyisi,Amy Roberts

DOI: https://doi.org/10.48550/arXiv.2209.14984

2022-09-30

Abstract:This report summarizes the work of the Computational Frontier topical group on end user analysis for Snowmass 2021. End User Analysis refers to the extraction of physics results from reconstructed and simulated experimental data. High energy physics experiments produce systems that perform common reconstruction, calibration, and simulation tasks, resulting in shared data samples. These detailed data samples are then reduced to create a range of analysis samples, often optimized for a particular physics topic by a trigger or data object selection. End users (analyzers) then analyze those samples to produce physics results. Community discussions converged on categorizing the end user analysis ensemble into Analysis Ecosystems, Analysis Models, Dataset Bookkeeping and Formats, Collaborative Software, and Training. We present findings and recommendations based on these key areas that impact end user analysis.

Computational Physics,High Energy Physics - Experiment,High Energy Physics - Lattice,High Energy Physics - Phenomenology,High Energy Physics - Theory
Chapter Four - Data Flow Computing in Geoscience Applications.

Lin Gan,Haohuan Fu,Oskar Mencer,Wayne Luk,Guangwen Yang

DOI: https://doi.org/10.1016/bs.adcom.2016.09.005

IF: 3.067

2017-01-01

Advances in Computers

Abstract:Abstract Geoscience research is one of the major fields that calls for the support of high-performance computers (HPC). With the algorithms of geoscience application becoming more complex, and the ever-increasing demands for better performance and finer resolutions, technical innovations from both algorithmic and architectural perspectives are highly desired. In recent years, data flow computing engines based on reconfigurable computing systems such as FPGAs have been introduced into HPC area, and start to show some inspiringly good results in many important applications. In this chapter, we summarize our initial efforts and experiences of using Maxeler Data Flow Engines as high-performance platforms, and target at eliminating the main bottlenecks and obtaining higher efficiencies for solving geoscience problems. Choosing three computing kernels from two popular geoscience application domains (climate modeling and exploration geophysics), we present a set of customization and optimization techniques based on the reconfigurable hardware platforms. Through building highly efficient computing pipelines that fit well to both the algorithm and the architecture, we manage to achieve better results in both the performance and power efficiency over traditional multi-core and many-core architectures. Our work demonstrates that data flow computing engines are promising candidates to make contributions to the development of geoscience applications.
Snowmass '21 Community Engagement Frontier 6: Public Policy and Government Engagement: Congressional Advocacy for Areas Beyond HEP Funding

Richie Diurba,Rob Fine,Mandeep Gill,Harvey Newman,Kevin Pedro,Alexx Perloff,Breese Quinn,Louise Suter,Shawn Westerdale

DOI: https://doi.org/10.48550/arXiv.2207.00124

2022-06-30

Physics and Society

Abstract:This document has been prepared as a Snowmass contributed paper by the Public Policy \& Government Engagement topical group (CEF06) within the Community Engagement Frontier. The charge of CEF06 is to review all aspects of how the High Energy Physics (HEP) community engages with government at all levels and how public policy impacts members of the community and the community at large, and to assess and raise awareness within the community of direct community-driven engagement of the US federal government (\textit{i.e.} advocacy). The focus of this paper is the potential for HEP community advocacy on topics other than funding for basic research.
Summary Report Topical Group on Application and Industry Community Engagement Frontier Snowmass 2021

Farah Fahim,Alex Murokh,Koji Yoshimura

DOI: https://doi.org/10.48550/arXiv.2210.01248

2022-10-03

Physics and Society

Abstract:HEP community leads and operates cutting-edge experiments for the DOE Office of Science which have challenging sensing, data processing, and computing requirements that far surpass typical industrial applications. To make necessary progress in the energy, material, and fundamental sciences, development of novel technologies is often required to enable these advanced detector and accelerator programs. Our capabilities include efficient co-design, which is a prerequisite to enable the deployment of advanced techniques in a scientific setting where development spans from rapid prototyping to robust and reliable production scale. This applies across the design spectrum from the low level fabrication techniques to the high level software development. It underpins the requirement for a holistic approach of innovation that accelerates the cycle of technology development and deployment. The challenges set by the next generation of experiments requires a collaborative approach between academia, industry and national labs. Just a single stakeholder will be unable to deliver the technologies required for the success of the scientific goals. Tools and techniques developed for High Energy Physics (HEP) research can accelerate scientific discovery more broadly across DOE Office of Science and other federal initiatives and also benefit industry applications.
Benchmarking with Supernovae: A Performance Study of the FLASH Code

Joshua Martin,Catherine Feldman,Eva Siegmann,Tony Curtis,David Carlson,Firat Coskun,Daniel Wood,Raul Gonzalez,Robert J. Harrison,Alan C. Calder

DOI: https://doi.org/10.1145/3626203.3670536

2024-08-29

Abstract:Astrophysical simulations are computation, memory, and thus energy intensive, thereby requiring new hardware advances for progress. Stony Brook University recently expanded its computing cluster "SeaWulf" with an addition of 94 new nodes featuring Intel Sapphire Rapids Xeon Max series CPUs. We present a performance and power efficiency study of this hardware performed with FLASH: a multi-scale, multi-physics, adaptive mesh-based software instrument. We extend this study to compare performance to that of Stony Brook's Ookami testbed which features ARM-based A64FX-700 processors, and SeaWulf's AMD EPYC Milan and Intel Skylake nodes. Our application is a stellar explosion known as a thermonuclear (Type Ia) supernova and for this 3D problem, FLASH includes operators for hydrodynamics, gravity, and nuclear burning, in addition to routines for the material equation of state. We perform a strong-scaling study with a 220 GB problem size to explore both single- and multi-node performance. Our study explores the performance of different MPI mappings and the distribution of processors across nodes. From these tests, we determined the optimal configuration to balance runtime and energy consumption for our application.

Distributed, Parallel, and Cluster Computing,Instrumentation and Methods for Astrophysics

Computing for the Energy Frontier: Snowmass Study 2013

Snowmass 2013 Computing Frontier: Networking

Snowmass Energy Frontier Simulations using the Open Science Grid (A Snowmass 2013 whitepaper)

Snowmass 2013 Computing Frontier: Intensity Frontier

Snowmass 2013 Computing Frontier: Accelerator Science

Snowmass Computational Frontier: Topical Group Report on Quantum Computing

Snowmass 2013 Computing Frontier Storage and Data Management

Instrumentation for the Energy Frontier

Intensity Frontier Instrumentation

New Particles Working Group Report of the Snowmass 2013 Community Summer Study

Snowmass Computational Frontier: Topical Group Report on Experimental Algorithm Parallelization

Snowmass 2021 Computational Frontier CompF03 Topical Group Report: Machine Learning

Energy Efficiency in Cloud Computing: Exploring the Intellectual Structure of the Research Field and Its Research Fronts with Direct Citation Analysis

The ECP ALPINE project: In situ and post hoc visualization infrastructure and analysis capabilities for exascale

Exploring the Frontiers of Energy Efficiency using Power Management at System Scale

High-performance computing for materials design to advance energy science

CompF5: End User Analysis Topical Group Report

Chapter Four - Data Flow Computing in Geoscience Applications.

Snowmass '21 Community Engagement Frontier 6: Public Policy and Government Engagement: Congressional Advocacy for Areas Beyond HEP Funding

Summary Report Topical Group on Application and Industry Community Engagement Frontier Snowmass 2021

Benchmarking with Supernovae: A Performance Study of the FLASH Code