Abstract:Protein sequence design, the inverse problem of protein structure prediction, plays a crucial role in protein engineering. Although recent deep learning-based methods have shown promising advancements, achieving accurate and robust protein sequence design remains an ongoing challenge. Here, we present CarbonDesign, a new approach that draws inspiration from successful ingredients of AlphaFold for protein structure prediction and makes significant and novel developments tailored specifically for protein sequence design. At its core, CarbonDesign explores Inverseformer, a novel network architecture adapted from AlphaFold’s Evoformer, to learn representations from backbone structures and an amortized Markov Random Fields model for sequence decoding. Moreover, we incorporate other essential AlphaFold concepts into CarbonDesign: an end-to-end network recycling technique to leverage evolutionary constraints in protein language models and a multi-task learning technique to generate side chain structures corresponding to the designed sequences. Through rigorous evaluations on independent testing data sets, including the CAMEO and recent CASP15 data sets, as well as the predicted structures from AlphaFold, we show that CarbonDesign outperforms other published methods, achieving high accuracy in sequence generation. Moreover, it exhibits superior performance on de novo backbone structures obtained from recent diffusion generative models such as RFdiffusion and FrameDiff, highlighting its potential for enhancing de novo protein design. Notably, CarbonDesign also supports zero-shot prediction of the functional effects of sequence variants, indicating its potential application in directed evolution-based design. In summary, our results illustrate CarbonDesign’s accurate and robust performance in protein sequence design, making it a promising tool for applications in bioengineering.

DNDesign: Enhancing Physical Understanding of Protein Inverse Folding Model via Denoising

Generative De Novo Protein Design with Global Context

ProteinInvBench: Benchmarking Protein Inverse Folding on Diverse Tasks, Models, and Metrics.

Graph Denoising Diffusion for Inverse Protein Folding

OPUS-Design: Designing Protein Sequence from Backbone Structure with 3DCNN and Protein Language Model

Highly accurate and robust protein sequence design with CarbonDesign

De novo protein design with a denoising diffusion network independent of pretrained structure prediction models

Mask prior-guided denoising diffusion improves inverse protein folding

PiFold: Toward effective and efficient protein inverse folding

Inverse Protein Folding Using Deep Bayesian Optimization

Protein sequence design on given backbones with deep learning

DIProT: A deep learning based interactive toolkit for efficient and effective Protein design

De novo protein design by inversion of the AlphaFold structure prediction network

Accurate and robust protein sequence design with CarbonDesign

Exploring "dark-matter" protein folds using deep learning

Robust deep learning based protein sequence design using ProteinMPNN

Progressive Multi-Modality Learning for Inverse Protein Folding

ZetaDesign: an end-to-end deep learning method for protein sequence design and side-chain packing

EBM-Fold: Fully-Differentiable Protein Folding Powered by Energy-based Models

Protein Design Using Structure-Prediction Networks: AlphaFold and RoseTTAFold as Protein Structure Foundation Models

Protein Language Model Supervised Precise and Efficient Protein Backbone Design Method