Abstract:AI-based protein structure prediction pipelines, such as AlphaFold2, have achieved near-experimental accuracy. These advanced pipelines mainly rely on Multiple Sequence Alignments (MSAs) as inputs to learn the co-evolution information from the homologous sequences. Nonetheless, searching MSAs from protein databases is time-consuming, usually taking dozens of minutes. Consequently, we attempt to explore the limits of fast protein structure prediction by using only primary sequences of proteins. HelixFold-Single is proposed to combine a large-scale protein language model with the superior geometric learning capability of AlphaFold2. Our proposed method, HelixFold-Single, first pre-trains a large-scale protein language model (PLM) with thousands of millions of primary sequences utilizing the self-supervised learning paradigm, which will be used as an alternative to MSAs for learning the co-evolution information. Then, by combining the pre-trained PLM and the essential components of AlphaFold2, we obtain an end-to-end differentiable model to predict the 3D coordinates of atoms from only the primary sequence. HelixFold-Single is validated in datasets CASP14 and CAMEO, achieving competitive accuracy with the MSA-based methods on the targets with large homologous families. Furthermore, HelixFold-Single consumes much less time than the mainstream pipelines for protein structure prediction, demonstrating its potential in tasks requiring many predictions. The code of HelixFold-Single is available at <a class="link-external link-https" href="https://github.com/PaddlePaddle/PaddleHelix/tree/dev/apps/protein_folding/helixfold-single" rel="external noopener nofollow">this https URL</a>, and we also provide stable web services on <a class="link-external link-https" href="https://paddlehelix.baidu.com/app/drug/protein-single/forecast" rel="external noopener nofollow">this https URL</a>.

CPE-Pro: A Structure-Sensitive Deep Learning Method for Protein Representation and Origin Evaluation

CPE-Pro: A Structure-Sensitive Deep Learning Model for Protein Representation and Origin Evaluation

Global-Context Aware Generative Protein Design

CGLFold: a contact-assisted <i>de novo</i> protein structure prediction using global exploration and loop perturbation sampling algorithm

A Systematic Study of Joint Representation Learning on Protein Sequences and Structures

Accurate Protein Structure Prediction by Embeddings and Deep Learning Representations

SFM-Protein: Integrative Co-evolutionary Pre-training for Advanced Protein Sequence Representation

Protein 3D Graph Structure Learning for Robust Structure-based Protein Property Prediction

DeepProSite: Structure-aware Protein Binding Site Prediction Using ESMFold and Pretrained Language Model

Comprehensive Study on Enhancing Low-Quality Position-Specific Scoring Matrix with Deep Learning for Accurate Protein Structure Property Prediction: Using Bagging Multiple Sequence Alignment Learning

PEST: A General-Purpose Protein Embedding Model for Homology Search

Enhancing the Protein Tertiary Structure Prediction by Multiple Sequence Alignment Generation

PLMC: Language Model of Protein Sequences Enhances Protein Crystallization Prediction

Structure-Informed Protein Language Model

Functional Geometry Guided Protein Sequence and Backbone Structure Co-Design

When Protein Structure Embedding Meets Large Language Models

PSSP-RFE: Accurate Prediction of Protein Structural Class by Recursive Feature Extraction from PSI-BLAST Profile, Physical-Chemical Property and Functional Annotations

PepHarmony: A Multi-View Contrastive Learning Framework for Integrated Sequence and Structure-Based Peptide Encoding

Exploring evolution-aware & -free protein language models as protein function predictors

Protein-peptide binding residue prediction based on protein language models and cross-attention mechanism

HelixFold-Single: MSA-free Protein Structure Prediction by Using Protein Language Model as an Alternative