Abstract:Exponential increases in scientific experimental data are outstripping the rate of progress in silicon technology. As a result, heterogeneous combinations of architectures and process or device technologies are increasingly important to meet the computing demands of future scientific experiments. However, the complexity of heterogeneous computing systems requires systematic modeling to understand performance. We present a model which addresses this need by framing key aspects of data collection pipelines and constraints, and combines them with the important vectors of technology that shape alternatives, computing metrics that allow complex alternatives to be compared. For instance, a data collection pipeline may be characterized by parameters such as sensor sampling rates, amount of data collected, and the overall relevancy of retrieved samples. Alternatives to this pipeline are enabled by hardware development vectors including advancing CMOS, GPUs, neuromorphic computing, and edge computing. By calculating metrics for each alternative such as overall F1 score, power, hardware cost, and energy expended per relevant sample, this model allows alternate data collection systems to be rigorously compared. To demonstrate this model's capability, we apply it to the CMS experiment (and planned HL-LHC upgrade) to evaluate and compare the application of novel technologies in the data acquisition system (DAQ). We demonstrate that improvements to early stages in the DAQ are highly beneficial, greatly reducing the resources required at later stages of processing (such as a 60% power reduction) and increasing the amount of relevant data retrieved from the experiment per unit power (improving from 0.065 to 0.31 samples/kJ) However, we predict further advances will be required in order to meet overall power and cost constraints for the DAQ.

First performance measurements with the Analysis Grand Challenge

Physics analysis for the HL-LHC: concepts and pipelines in practice with the Analysis Grand Challenge

Machine Learning for Columnar High Energy Physics Analysis

Analysis Facilities for HL-LHC

ATLAS Data Challenge 1

Early experiences on the OLCF Frontier system with AthenaPK and Parthenon‐Hydro

First test results of the HGCAL concentrator ASICs: ECON-T and ECON-D

Prototyping a ROOT-based distributed analysis workflow for HL-LHC: the CMS use case

GRANDlib: A simulation pipeline for the Giant Radio Array for Neutrino Detection (GRAND)

AGATA: Performance of $γ$-ray tracking and associated algorithms

Big Data in HEP: A comprehensive use case study

Evaluating FPGA Accelerator Performance with a Parameterized OpenCL Adaptation of the HPCChallenge Benchmark Suite

Coffea-Casa: Building composable analysis facilities for the HL-LHC

The AGILE real-time analysis pipelines in the multi-messenger era

Performance update of an event-type based analysis for the Cherenkov Telescope Array

First Experiences in Performance Benchmarking with the New SPEChpc 2021 Suites

Analyzing the HCP Datasets using GPUs: The Anatomy of a Science Engagement

GPU-based reconstruction and data compression at ALICE during LHC Run 3

Modeling Performance of Data Collection Systems for High-Energy Physics

HPC AI500: Representative, Repeatable and Simple HPC AI Benchmarking

Granular Gym: High Performance Simulation for Robotic Tasks with Granular Materials