Abstract:The challenges expected for the next era of the Large Hadron Collider (LHC), both in terms of storage and computing resources, provide LHC experiments with a strong motivation for evaluating ways of rethinking their computing models at many levels. Great efforts have been put into optimizing the computing resource utilization for the data analysis, which leads both to lower hardware requirements and faster turnaround for physics analyses. In this scenario, the Compact Muon Solenoid (CMS) collaboration is involved in several activities aimed at benchmarking different solutions for running High Energy Physics (HEP) analysis workflows. A promising solution is evolving software towards more user-friendly approaches featuring a declarative programming model and interactive workflows. The computing infrastructure should keep up with this trend by offering on the one side modern interfaces, and on the other side hiding the complexity of the underlying environment, while efficiently leveraging the already deployed grid infrastructure and scaling toward opportunistic resources like public cloud or HPC centers. This article presents the first example of using the ROOT RDataFrame technology to exploit such next-generation approaches for a production-grade CMS physics analysis. A new analysis facility is created to offer users a modern interactive web interface based on JupyterLab that can leverage HTCondor-based grid resources on different geographical sites. The physics analysis is converted from a legacy iterative approach to the modern declarative approach offered by RDataFrame and distributed over multiple computing nodes. The new scenario offers not only an overall improved programming experience, but also an order of magnitude speedup increase with respect to the previous approach.

RootInteractive tool for multidimensional statistical analysis, machine learning and analytical model validation

Particle identification with machine learning in ALICE Run 3

Particle identification with machine learning from incomplete data in the ALICE experiment

MLAnalysis: An open-source program for high energy physics analyses

Machine Learning for Columnar High Energy Physics Analysis

Machine and deep learning techniques in heavy-ion collisions with ALICE

Machine Learning methods for simulating particle response in the Zero Degree Calorimeter at the ALICE experiment, CERN

Improving ATLAS Hadronic Object Performance with ML/AI Algorithms

Machine-learning-based particle identification with missing data

Prototyping a ROOT-based distributed analysis workflow for HL-LHC: the CMS use case

Seiberg--Witten Monopoles on Seifert Fibered Spaces

Machine learning opportunities for online and offline tagging of photo-induced and diffractive events in continuous readout experiments

Novel machine learning applications at the LHC

Reduced Simulations for High-Energy Physics, a Middle Ground for Data-Driven Physics Research

Machine Learning for the LHCb Simulation

Machine Learning as a Service for HEP

Software Challenges For HL-LHC Data Analysis

MLaaS4HEP: Machine Learning as a Service for HEP

Reweighting simulated events using machine-learning techniques in the CMS experiment