Abstract:Protein sequence design, the inverse problem of protein structure prediction, plays a crucial role in protein engineering. Although recent deep learning-based methods have shown promising advancements, achieving accurate and robust protein sequence design remains an ongoing challenge. Here, we present CarbonDesign, a new approach that draws inspiration from successful ingredients of AlphaFold for protein structure prediction and makes significant and novel developments tailored specifically for protein sequence design. At its core, CarbonDesign explores Inverseformer, a novel network architecture adapted from AlphaFold’s Evoformer, to learn representations from backbone structures and an amortized Markov Random Fields model for sequence decoding. Moreover, we incorporate other essential AlphaFold concepts into CarbonDesign: an end-to-end network recycling technique to leverage evolutionary constraints in protein language models and a multi-task learning technique to generate side chain structures corresponding to the designed sequences. Through rigorous evaluations on independent testing data sets, including the CAMEO and recent CASP15 data sets, as well as the predicted structures from AlphaFold, we show that CarbonDesign outperforms other published methods, achieving high accuracy in sequence generation. Moreover, it exhibits superior performance on de novo backbone structures obtained from recent diffusion generative models such as RFdiffusion and FrameDiff, highlighting its potential for enhancing de novo protein design. Notably, CarbonDesign also supports zero-shot prediction of the functional effects of sequence variants, indicating its potential application in directed evolution-based design. In summary, our results illustrate CarbonDesign’s accurate and robust performance in protein sequence design, making it a promising tool for applications in bioengineering.

Generating new protein sequences by using dense network and attention mechanism

Global-Context Aware Generative Protein Design

Generative De Novo Protein Design with Global Context

Expanding functional protein sequence spaces using generative adversarial networks

DenseCPD: Improving the Accuracy of Neural-Network-Based Computational Protein Sequence Design with DenseNet

Functional Protein Structure Annotation Using a Deep Convolutional Generative Adversarial Network

ProGAN: Protein Solubility Generative Adversarial Nets for Data Augmentation in DNN Framework

Deep generative modeling for protein design

Computational Protein Design with Deep Learning Neural Networks

A new age in protein design empowered by deep learning

Towards deep learning sequence-structure co-generation for protein design

GANcon: Protein Contact Map Prediction with Deep Generative Adversarial Network.

Generating Novel, Designable, and Diverse Protein Structures by Equivariantly Diffusing Oriented Residue Clouds

Highly accurate and robust protein sequence design with CarbonDesign

Robust deep learning based protein sequence design using ProteinMPNN

Leveraging Deep Generative Model For Computational Protein Design And Optimization

PCGAN: a generative approach for protein complex identification from protein interaction networks

DeepGATGO: A Hierarchical Pretraining-Based Graph-Attention Model for Automatic Protein Function Prediction

Protein sequence design on given backbones with deep learning

Accurate and robust protein sequence design with CarbonDesign

Structure-based protein and small molecule generation using EGNN and diffusion models: A comprehensive review