Abstract:Recent developments in the methods of explainable AI (XAI) allow researchers to explore the inner workings of deep neural networks (DNNs), revealing crucial information about input-output relationships and realizing how data connects with machine learning models. In this paper we explore interpretability of DNN models designed to identify jets coming from top quark decay in high energy proton-proton collisions at the Large Hadron Collider (LHC). We review a subset of existing top tagger models and explore different quantitative methods to identify which features play the most important roles in identifying the top jets. We also investigate how and why feature importance varies across different XAI metrics, how correlations among features impact their explainability, and how latent space representations encode information as well as correlate with physically meaningful quantities. Our studies uncover some major pitfalls of existing XAI methods and illustrate how they can be overcome to obtain consistent and meaningful interpretation of these models. We additionally illustrate the activity of hidden layers as Neural Activation Pattern (NAP) diagrams and demonstrate how they can be used to understand how DNNs relay information across the layers and how this understanding can help to make such models significantly simpler by allowing effective model reoptimization and hyperparameter tuning. These studies not only facilitate a methodological approach to interpreting models but also unveil new insights about what these models learn. Incorporating these observations into augmented model design, we propose the Particle Flow Interaction Network (PFIN) model and demonstrate how interpretability-inspired model augmentation can improve top tagging performance.

Interpretability Study on Deep Learning for Jet Physics at the Large Hadron Collider

A Detailed Study of Interpretability of Deep Neural Network based Top Taggers

Recursive Neural Networks in Quark/Gluon Tagging

Interpretable Machine Learning Methods Applied to Jet Background Subtraction in Heavy Ion Collisions

Interplay of Traditional Methods and Machine Learning Algorithms for Tagging Boosted Objects

Jet Flavor Classification in High-Energy Physics with Deep Neural Networks

Tau lepton identification and reconstruction: a new frontier for jet-tagging ML algorithms

JetLOV: Enhancing Jet Tree Tagging through Neural Network Learning of Optimal LundNet Variables

Deep-Learning Jets with Uncertainties and More

Identifying the Quantum Properties of Hadronic Resonances using Machine Learning

Jet Constituents for Deep Neural Network Based Top Quark Tagging

An Efficient Lorentz Equivariant Graph Neural Network for Jet Tagging

Efficient and Robust Jet Tagging at the LHC with Knowledge Distillation

Transformer networks for Heavy flavor jet tagging

End-to-end particle and event identification at the Large Hadron Collider with CMS Open Data

PET Image Reconstruction with Parallax Correction Based on a Distance-Driven Deep Neural Network

Pet Image Resolution Uniformity Improvements Using Deep Learning

The Fundamental Limit of Jet Tagging

Probing highly collimated photon-jets with deep learning

From strange-quark tagging to fragmentation tagging with machine learning