Abstract:Protein sequence design, the inverse problem of protein structure prediction, plays a crucial role in protein engineering. Although recent deep learning-based methods have shown promising advancements, achieving accurate and robust protein sequence design remains an ongoing challenge. Here, we present CarbonDesign, a new approach that draws inspiration from successful ingredients of AlphaFold for protein structure prediction and makes significant and novel developments tailored specifically for protein sequence design. At its core, CarbonDesign explores Inverseformer, a novel network architecture adapted from AlphaFold’s Evoformer, to learn representations from backbone structures and an amortized Markov Random Fields model for sequence decoding. Moreover, we incorporate other essential AlphaFold concepts into CarbonDesign: an end-to-end network recycling technique to leverage evolutionary constraints in protein language models and a multi-task learning technique to generate side chain structures corresponding to the designed sequences. Through rigorous evaluations on independent testing data sets, including the CAMEO and recent CASP15 data sets, as well as the predicted structures from AlphaFold, we show that CarbonDesign outperforms other published methods, achieving high accuracy in sequence generation. Moreover, it exhibits superior performance on de novo backbone structures obtained from recent diffusion generative models such as RFdiffusion and FrameDiff, highlighting its potential for enhancing de novo protein design. Notably, CarbonDesign also supports zero-shot prediction of the functional effects of sequence variants, indicating its potential application in directed evolution-based design. In summary, our results illustrate CarbonDesign’s accurate and robust performance in protein sequence design, making it a promising tool for applications in bioengineering.

Protein design using structure-based residue preferences

Global-Context Aware Generative Protein Design

Generative De Novo Protein Design with Global Context

Computational protein design with evolutionary-based and physics-inspired modeling: current and future synergies

Functional Geometry Guided Protein Sequence and Backbone Structure Co-Design

Computational Protein Design with Deep Learning Neural Networks

A probabilistic view of protein stability, conformational specificity, and design

Generating Novel, Designable, and Diverse Protein Structures by Equivariantly Diffusing Oriented Residue Clouds

Enzyme structure correlates with variant effect predictability

A backbone-centred energy function of neural networks for protein design

De novo design of cavity-containing proteins with a backbone-centered neural network energy function

Protein Design Using Structure-Prediction Networks: AlphaFold and RoseTTAFold as Protein Structure Foundation Models

BC-Design: A Biochemistry-Aware Framework for Highly Accurate Inverse Protein Folding

BC-Design: A Biochemistry-Aware Framework for High-Precision Inverse Protein Folding

Exploring "dark-matter" protein folds using deep learning

A Coarse-Grained Approach to Protein Design: Learning from Design to Understand Folding

Highly accurate and robust protein sequence design with CarbonDesign

Transferable coarse-grained potential for $\textit{de novo}$ protein folding and design

Effective Local and Secondary Protein Structure Prediction by Combining a Neural Network-Based Approach with Extensive Feature Design and Selection without Reliance on Evolutionary Information

Protein sequence design on given backbones with deep learning