Abstract:Heterogeneous catalysts are rather complex materials that come in many classes (e.g., metals, oxides, carbides) and shapes. At the same time, the interaction of the catalyst surface with even a relatively simple gas-phase environment such as syngas (CO and H2) may already produce a wide variety of reaction intermediates ranging from atoms to complex molecules. The starting point for creating predictive maps of, e.g., surface coverages or chemical activities of potential catalyst materials is the reliable prediction of adsorption enthalpies of all of these intermediates. For simple systems, direct density functional theory (DFT) calculations are currently the method of choice. However, a wider exploration of complex materials and reaction networks generally requires enthalpy predictions at lower computational cost.The use of machine learning (ML) and related techniques to make accurate and low-cost predictions of quantum-mechanical calculations has gained increasing attention lately. The employed approaches span from physically motivated models over hybrid physics-ΔML approaches to complete black-box methods such as deep neural networks. In recent works we have explored the possibilities for using a compressed sensing method (Sure Independence Screening and Sparsifying Operator, SISSO) to identify sparse (low-dimensional) descriptors for the prediction of adsorption enthalpies at various active-site motifs of metals and oxides. We start from a set of physically motivated primary features such as atomic acid/base properties, coordination numbers, or band moments and let the data and the compressed sensing method find the best algebraic combination of these features. Here we take this work as a starting point to categorize and compare recent ML-based approaches with a particular focus on model sparsity, data efficiency, and the level of physical insight that one can obtain from the model.Looking ahead, while many works to date have focused only on the mere prediction of databases of, e.g., adsorption enthalpies, there is also an emerging interest in our field to start using ML predictions to answer fundamental science questions about the functioning of heterogeneous catalysts or perhaps even to design better catalysts than we know today. This task is significantly simplified in works that make use of scaling-relation-based models (volcano curves), where the model outcome is determined by only one or two adsorption enthalpies and which consequently become the sole target for ML-based high-throughput screening or design. However, the availability of cheap ML energetics also allows going beyond scaling relations. On the basis of our own work in this direction, we will discuss the additional physical insight that can be achieved by integrating ML-based predictions with traditional catalysis modeling techniques from thermal and electrocatalysis, such as the computational hydrogen electrode and microkinetic modeling, as well as the challenges that lie ahead.

Glycoproteins of chicken liver nuclei cross-linked to DNA by cis-diamminedichloroplatinum.

A strategy to apply machine learning to small datasets in materials science

Farthest Point Sampling in Property Designated Chemical Feature Space as a General Strategy for Enhancing the Machine Learning Model Performance for Small Scale Chemical Dataset

Accurate machine learning models based on small dataset of energetic materials through spatial matrix featurization methods

Two-Dimensional Energy Histograms as Features for Machine Learning to Predict Adsorption in Diverse Nanoporous Materials.

Predicting binding motifs of complex adsorbates using machine learning with a physics-inspired graph representation

Universal machine-learning algorithm for predicting adsorption performance of organic molecules based on limited data set: Importance of feature description

Adsorption Enthalpies for Catalysis Modeling through Machine-Learned Descriptors

Local environment-based machine learning for molecular adsorption energy prediction

Error Minimization in Predicting Accurate Adsorption Energies Using Machine Learning

Building Chemical Property Models for Energetic Materials from Small Datasets Using a Transfer Learning Approach

Exploring Structure-Sensitive Relations for Small Species Adsorption Using Machine Learning

On the Interplay of Subset Selection and Informed Graph Neural Networks

Machine Learning in Complex Organic Mixtures: Applying Domain Knowledge Allows for Meaningful Performance with Small Datasets.

Applying machine learning techniques to predict the properties of energetic materials

Interpreting Chemisorption Strength with AutoML-based Feature Deletion Experiments

Explainable Data-driven Modeling of Adsorption Energy in Heterogeneous Catalysis

Spectroscopy-Guided Deep Learning Predicts Solid-Liquid Surface Adsorbate Properties in Unseen Solvents.

Noisy, sparse, nonlinear: Navigating the Bermuda Triangle of physical inference with deep filtering

Machine Learning Small Molecule Properties in Drug Discovery

A novel unambiguous strategy of molecular feature extraction in machine learning assisted predictive models for environmental properties