Abstract:In this study, we introduce the More-Interaction Particle Transformer (MIParT), a novel deep learning neural network designed for jet tagging. This framework incorporates our own design, the More-Interaction Attention (MIA) mechanism, which increases the dimensionality of particle interaction embeddings. We tested MIParT using the top tagging and quark-gluon datasets. Our results show that MIParT not only matches the accuracy and AUC of LorentzNet and a series of Lorentz-equivariant methods, but also significantly outperforms the ParT model in background rejection. Specifically, it improves background rejection by approximately 25% at a 30% signal efficiency on the top tagging dataset and by 3% on the quark-gluon dataset. Additionally, MIParT requires only 30% of the parameters and 53% of the computational complexity needed by ParT, proving that high performance can be achieved with reduced model complexity. For very large datasets, we double the dimension of particle embeddings, referring to this variant as MIParT-Large (MIParT-L). We find that MIParT-L can further capitalize on the knowledge from large datasets. From a model pre-trained on the 100M JetClass dataset, the background rejection performance of the fine-tuned MIParT-L improved by 39% on the top tagging dataset and by 6% on the quark-gluon dataset, surpassing that of the fine-tuned ParT. Specifically, the background rejection of fine-tuned MIParT-L improved by an additional 2% compared to the fine-tuned ParT. The results suggest that MIParT has the potential to advance efficiency benchmarks for jet tagging and event identification in particle physics. The code is available at the following GitHub repository: <a class="link-external link-https" href="https://github.com/USST-HEP/MIParT" rel="external noopener nofollow">this https URL</a>

Application of Particle Transformer to quark flavor tagging in the ILC project

Interpreting Transformers for Jet Tagging

Jet Tagging with More-Interaction Particle Transformer

Transformer networks for Heavy flavor jet tagging

Particle Transformer for Jet Tagging

Jet Flavour Tagging at FCC-ee with a Transformer-based Neural Network: DeepJetTransformer

High Level Reconstruction with Deep Learning using ILD Full Simulation

Particle Multi-Axis Transformer for Jet Tagging

ParticleNet and its application on CEPC Jet Flavor Tagging

Machine learning in high energy physics: a review of heavy-flavor jet tagging at the LHC

Performance studies of jet flavor tagging and measurement of R<sub>b</sub>(R<sub>c</sub>) using ParticleNet at CEPC

From strange-quark tagging to fragmentation tagging with machine learning

Strange quark as a probe for new physics in the Higgs sector

Tau lepton identification and reconstruction: A new frontier for jet-tagging ML algorithms

Performance studies of jet flavor tagging and measurement of $R_b(R_c)$ using ParticleNet at CEPC

Quark/Gluon Discrimination and Top Tagging with Dual Attention Transformer

The flavor-changing top-charm associated productions at ILC in littlest Higgs model with T parity

Learning the language of QCD jets with transformers

Fast Inclusive Flavour Tagging at LHCb