Abstract:High-Energy Physics experiments are facing a multi-fold data increase with every new iteration. This is certainly the case for the upcoming High-Luminosity LHC upgrade. Such increased data processing requirements forces revisions to almost every step of the data processing pipeline. One such step in need of an overhaul is the task of particle track reconstruction, a.k.a., tracking. A Machine Learning-assisted solution is expected to provide significant improvements, since the most time-consuming step in tracking is the assignment of hits to particles or track candidates. This is the topic of this paper. We take inspiration from large language models. As such, we consider two approaches: the prediction of the next word in a sentence (next hit point in a track), as well as the one-shot prediction of all hits within an event. In an extensive design effort, we have experimented with three models based on the Transformer architecture and one model based on the U-Net architecture, performing track association predictions for collision event hit points. In our evaluation, we consider a spectrum of simple to complex representations of the problem, eliminating designs with lower metrics early on. We report extensive results, covering both prediction accuracy (score) and computational performance. We have made use of the REDVID simulation framework, as well as reductions applied to the TrackML data set, to compose five data sets from simple to complex, for our experiments. The results highlight distinct advantages among different designs in terms of prediction accuracy and computational performance, demonstrating the efficiency of our methodology. Most importantly, the results show the viability of a one-shot encoder-classifier based Transformer solution as a practical approach for the task of tracking.

A unified machine learning approach for reconstructing hadronically decaying tau leptons

Tau lepton identification and reconstruction: A new frontier for jet-tagging ML algorithms

Invariant mass reconstruction of heavy gauge bosons decaying to $τ$ leptons using machine learning techniques

Heterogeneous Graph Neural Network for Identifying Hadronically Decayed Tau Leptons at the High Luminosity LHC

Lepton Flavour Violation Identification in Tau Decay ($τ^{-} \rightarrow μ^{-}μ^{-}μ^{+}$) Using Artificial Intelligence

Trees versus Neural Networks for enhancing tau lepton real-time selection in proton-proton collisions

TAUOLA for simulation of tau decay and production: perspectives for precision low energy and LHC applications

Pseudo-observables and Deep Neural Network for mixed CP -- H to tau tau decays at LHC

Tau lepton production and decays: perspective of multi-dimensional distributions and Monte Carlo methods

Invariant mass reconstruction of heavy gauge bosons decaying to leptons using machine learning techniques

Probing Higgs boson exotic decays at the LHC with machine learning

Detecting highly collimated photon-jets from Higgs boson exotic decays with deep learning

Transformers for Charged Particle Track Reconstruction in High Energy Physics

New hadronic currents in TAUOLA: for confrontation with the experimental data

From strange-quark tagging to fragmentation tagging with machine learning

TrackFormers: In Search of Transformer-Based Particle Tracking for the High-Luminosity LHC Era

Identifying the Quantum Properties of Hadronic Resonances using Machine Learning

Machine Learning based jet momentum reconstruction in heavy-ion collisions

Transformer networks for Heavy flavor jet tagging

Improved particle-flow event reconstruction with scalable neural networks for current and future particle detectors