Abstract:Molecular featurisation refers to the transformation of molecular data into numerical feature vectors. It is one of the key research areas in molecular machine learning and computational drug discovery. Recently, message-passing graph neural networks (GNNs) have emerged as a novel method to learn differentiable features directly from molecular graphs. While such techniques hold great promise, further investigations are needed to clarify if and when they indeed manage to definitively outcompete classical molecular featurisations such as extended-connectivity fingerprints (ECFPs) and physicochemical-descriptor vectors (PDVs). We systematically explore and further develop classical and graph-based molecular featurisation methods for two important tasks: molecular property prediction, in particular, quantitative structure-activity relationship (QSAR) prediction, and the largely unexplored challenge of activity-cliff (AC) prediction. We first give a technical description and critical analysis of PDVs, ECFPs and message-passing GNNs, with a focus on graph isomorphism networks (GINs). We then conduct a rigorous computational study to compare the performance of PDVs, ECFPs and GINs for QSAR and AC-prediction. Following this, we mathematically describe and computationally evaluate a novel twin neural network model for AC-prediction. We further introduce an operation called substructure pooling for the vectorisation of structural fingerprints as a natural counterpart to graph pooling in GNN architectures. We go on to propose Sort & Slice, a simple substructure-pooling technique for ECFPs that robustly outperforms hash-based folding at molecular property prediction. Finally, we outline two ideas for future research: (i) a graph-based self-supervised learning strategy to make classical molecular featurisations trainable, and (ii) trainable substructure-pooling via differentiable self-attention.

Pipeline for performance evaluation of flavour tagging dedicated Graph Neural Network algorithms

Pipeline for performance evaluation of flavour tagging dedicated Graph Neural Network algorithms

Flavour tagging with graph neural networks with the ATLAS detector

Jet Flavor Classification in High-Energy Physics with Deep Neural Networks

Fast Inclusive Flavour Tagging at LHCb

A modern framework for jet tagger development

Differentiable Vertex Fitting for Jet Flavour Tagging

Machine learning in high energy physics: a review of heavy-flavor jet tagging at the LHC

ATGNN: Audio Tagging Graph Neural Network

Jet Flavour Tagging at FCC-ee with a Transformer-based Neural Network: DeepJetTransformer

Differentiable vertex fitting for jet flavor tagging

PCN: A Deep Learning Approach to Jet Tagging Utilizing Novel Graph Construction Methods and Chebyshev Graph Convolutions

A Detailed Study of Interpretability of Deep Neural Network based Top Taggers

Harnessing Graph Neural Networks to Craft Fragrances Based on Consumer Feedback

Investigating Graph Neural Networks and Classical Feature-Extraction Techniques in Activity-Cliff and Molecular Property Prediction

JetLOV: Enhancing Jet Tree Tagging through Neural Network Learning of Optimal LundNet Variables

Gas Identification Using Electronic Nose Via Gramian-Angular-Field-Based Image Conversion and Convolutional Neural Networks Architecture Search

A Novel Gas Recognition Algorithm for Gas Sensor Array Combining Savitzky–Golay Smooth and Image Conversion Route

Enhancing High-Energy Particle Physics Collision Analysis through Graph Data Attribution Techniques

NuGraph2: A Graph Neural Network for Neutrino Physics Event Reconstruction