Abstract:Protein sequence design, the inverse problem of protein structure prediction, plays a crucial role in protein engineering. Although recent deep learning-based methods have shown promising advancements, achieving accurate and robust protein sequence design remains an ongoing challenge. Here, we present CarbonDesign, a new approach that draws inspiration from successful ingredients of AlphaFold for protein structure prediction and makes significant and novel developments tailored specifically for protein sequence design. At its core, CarbonDesign explores Inverseformer, a novel network architecture adapted from AlphaFold’s Evoformer, to learn representations from backbone structures and an amortized Markov Random Fields model for sequence decoding. Moreover, we incorporate other essential AlphaFold concepts into CarbonDesign: an end-to-end network recycling technique to leverage evolutionary constraints in protein language models and a multi-task learning technique to generate side chain structures corresponding to the designed sequences. Through rigorous evaluations on independent testing data sets, including the CAMEO and recent CASP15 data sets, as well as the predicted structures from AlphaFold, we show that CarbonDesign outperforms other published methods, achieving high accuracy in sequence generation. Moreover, it exhibits superior performance on de novo backbone structures obtained from recent diffusion generative models such as RFdiffusion and FrameDiff, highlighting its potential for enhancing de novo protein design. Notably, CarbonDesign also supports zero-shot prediction of the functional effects of sequence variants, indicating its potential application in directed evolution-based design. In summary, our results illustrate CarbonDesign’s accurate and robust performance in protein sequence design, making it a promising tool for applications in bioengineering.

ProteinWeaver: A Divide-and-Assembly Approach for Protein Backbone Design

ProteinInvBench: Benchmarking Protein Inverse Folding on Diverse Tasks, Models, and Metrics.

Global-Context Aware Generative Protein Design

Generative De Novo Protein Design with Global Context

Scaffold-Lab: Critical Evaluation and Ranking of Protein Backbone Generation Methods in A Unified Framework

Proteus: exploring protein structure generation for enhanced designability and efficiency

Generating Novel, Designable, and Diverse Protein Structures by Equivariantly Diffusing Oriented Residue Clouds

TopoDiff: Improving Protein Backbone Generation with Topology-aware Latent Encoding

A generic framework for hierarchical de novo protein design

Amalga: Designable Protein Backbone Generation with Folding and Inverse Folding Guidance

Improving diffusion-based protein backbone generation with global-geometry-aware latent encoding

A backbone-centred energy function of neural networks for protein design

SE(3) diffusion model with application to protein backbone generation

Protein Design with A Comprehensive Statistical Energy Function and Boosted by Experimental Selection for Foldability

Functional Geometry Guided Protein Sequence and Backbone Structure Co-Design

De novo design of cavity-containing proteins with a backbone-centered neural network energy function

Protein structure generation via folding diffusion

Diffusion probabilistic modeling of protein backbones in 3D for the motif-scaffolding problem

Highly accurate and robust protein sequence design with CarbonDesign

In Silico Protein Design by Combinatorial Assembly of Protein Building Blocks

Protein Language Model Supervised Precise and Efficient Protein Backbone Design Method