A framework for conditional diffusion modelling with applications in motif scaffolding for protein design

Kieran Didi,Francisco Vargas,Simon V Mathis,Vincent Dutordoir,Emile Mathieu,Urszula J Komorowska,Pietro Lio

2024-03-14

Abstract:Many protein design applications, such as binder or enzyme design, require scaffolding a structural motif with high precision. Generative modelling paradigms based on denoising diffusion processes emerged as a leading candidate to address this motif scaffolding problem and have shown early experimental success in some cases. In the diffusion paradigm, motif scaffolding is treated as a conditional generation task, and several conditional generation protocols were proposed or imported from the Computer Vision literature. However, most of these protocols are motivated heuristically, e.g. via analogies to Langevin dynamics, and lack a unifying framework, obscuring connections between the different approaches. In this work, we unify conditional training and conditional sampling procedures under one common framework based on the mathematically well-understood Doob's h-transform. This new perspective allows us to draw connections between existing methods and propose a new variation on existing conditional training protocols. We illustrate the effectiveness of this new protocol in both, image outpainting and motif scaffolding and find that it outperforms standard methods.

Machine Learning,Biomolecules

What problem does this paper attempt to address?

The paper attempts to address the problem of precise motif scaffolding in protein design. Specifically, many protein design applications, such as the design of binders or enzymes, require high-precision construction of structural motifs. Generative models based on denoising diffusion processes have shown potential in this area and have already achieved initial success in some experiments. However, existing conditional generation protocols mostly lack a unified framework, leading to unclear connections between different methods. The authors propose a new conditional generation method by introducing a mathematically rigorous Doob's h-transform to unify the conditional training and conditional sampling procedures. This method not only explains existing methods but also proposes new conditional training protocols, demonstrating superior performance over standard methods in tasks such as outpainting and protein structural motif construction. Additionally, the authors classify different conditional generation methods and provide theoretical support.

A framework for conditional diffusion modelling with applications in motif scaffolding for protein design

A Unified Conditional Diffusion Framework for Dual Protein Targets Based Bioactive Molecule Generation

On Diffusion Posterior Sampling via Sequential Monte Carlo for Zero-Shot Scaffolding of Protein Motifs

Diffusion probabilistic modeling of protein backbones in 3D for the motif-scaffolding problem

DEFT: Efficient Fine-Tuning of Diffusion Models by Learning the Generalised $h$-transform

FrameDiPT: SE(3) Diffusion Model for Protein Structure Inpainting

Protein Design with Guided Discrete Diffusion

Context-Guided Diffusion for Out-of-Distribution Molecular and Protein Design

Floating Anchor Diffusion Model for Multi-motif Scaffolding

Practical and Asymptotically Exact Conditional Sampling in Diffusion Models

Diffusion-Driven Generative Framework for Molecular Conformation Prediction

Modiff: Action-Conditioned 3D Motion Generation with Denoising Diffusion Probabilistic Models

Graph Denoising Diffusion for Inverse Protein Folding

Fine-Tuning Discrete Diffusion Models via Reward Optimization with Applications to DNA and Protein Design

Out of Many, One: Designing and Scaffolding Proteins at the Scale of the Structural Universe with Genie 2

Unite and Conquer: Plug & Play Multi-Modal Synthesis using Diffusion Models

Improved motif-scaffolding with SE(3) flow matching

SE(3) diffusion model with application to protein backbone generation

Conditional Image Synthesis with Diffusion Models: A Survey

Graph Diffusion Transformers for Multi-Conditional Molecular Generation

Conditional Generation from Unconditional Diffusion Models using Denoiser Representations