Abstract:Exponential increases in scientific experimental data are outstripping the rate of progress in silicon technology. As a result, heterogeneous combinations of architectures and process or device technologies are increasingly important to meet the computing demands of future scientific experiments. However, the complexity of heterogeneous computing systems requires systematic modeling to understand performance. We present a model which addresses this need by framing key aspects of data collection pipelines and constraints, and combines them with the important vectors of technology that shape alternatives, computing metrics that allow complex alternatives to be compared. For instance, a data collection pipeline may be characterized by parameters such as sensor sampling rates, amount of data collected, and the overall relevancy of retrieved samples. Alternatives to this pipeline are enabled by hardware development vectors including advancing CMOS, GPUs, neuromorphic computing, and edge computing. By calculating metrics for each alternative such as overall F1 score, power, hardware cost, and energy expended per relevant sample, this model allows alternate data collection systems to be rigorously compared. To demonstrate this model's capability, we apply it to the CMS experiment (and planned HL-LHC upgrade) to evaluate and compare the application of novel technologies in the data acquisition system (DAQ). We demonstrate that improvements to early stages in the DAQ are highly beneficial, greatly reducing the resources required at later stages of processing (such as a 60% power reduction) and increasing the amount of relevant data retrieved from the experiment per unit power (improving from 0.065 to 0.31 samples/kJ) However, we predict further advances will be required in order to meet overall power and cost constraints for the DAQ.

A proposed solution for analysis management in high energy physics

Physics analysis for the HL-LHC: concepts and pipelines in practice with the Analysis Grand Challenge

Analysis Description Languages for the LHC

Preservation of the Direct Photon and Neutral Meson Analysis in the PHENIX Experiment at RHIC

Toward real-time data query systems in HEP

Analysis Facilities for HL-LHC

Analysis Facilities White Paper

Improving Software Quality Through Program Analysis

Dedicated Analysis Facility for HEP Experiments

Data Management Challenges and Event Index Technologies in High Energy Physics

A customizable data management framework for high-repetition-rate high-energy-density science

Data Preservation and Long Term Analysis in High Energy Physics

Proposal for a High Energy Nuclear Database

A High Energy Nuclear Database Proposal

An Operator Library System for HEP Events Processing Based on Hbase Coprocessor.

A Plugin-Based Software Framework for Data Acquisition and Online Processing

Design and Implementation of Distributed Data Acquisition Architecture in High Energy Physics

Modeling Performance of Data Collection Systems for High-Energy Physics

Development of a data infrastructure for a global data and analysis center in astroparticle physics

Daisy: Data analysis integrated software system for X-ray experiments

A High-Level Analysis Framework for HAWC