Abstract:In the last decades, huge efforts have been made in the bioinformatics community to develop machine learning-based methods for the prediction of structural features of proteins in the hope of answering fundamental questions about the way proteins function and their involvement in several illnesses. The recent advent of Deep Learning has renewed the interest in neural networks, with dozens of methods being developed taking advantage of these new architectures. However, most methods are still heavily based pre-processing of the input data, as well as extraction and integration of multiple hand-picked, and manually designed features. Multiple Sequence Alignments (MSA) are the most common source of information in de novo prediction methods. Deep Networks that automatically refine the MSA and extract useful features from it would be immensely powerful. In this work, we propose a new paradigm for the prediction of protein structural features called rawMSA. The core idea behind rawMSA is borrowed from the field of natural language processing to map amino acid sequences into an adaptively learned continuous space. This allows the whole MSA to be input into a Deep Network, thus rendering pre-calculated features such as sequence profiles and other features calculated from MSA obsolete. We showcased the rawMSA methodology on three different prediction problems: secondary structure, relative solvent accessibility and inter-residue contact maps. We have rigorously trained and benchmarked rawMSA on a large set of proteins and have determined that it outperforms classical methods based on position-specific scoring matrices (PSSM) when predicting secondary structure and solvent accessibility, while performing on par with methods using more pre-calculated features in the inter-residue contact map prediction category in CASP12 and CASP13. Clearly demonstrating that rawMSA represents a promising development that can pave the way for improved methods using rawMSA instead of sequence profiles to represent evolutionary information in the coming years. Availability: datasets, dataset generation code, evaluation code and models are available at: https://bitbucket.org/clami66/rawmsa.

MSAGPT: Neural Prompting Protein Structure Prediction via MSA Generative Pre-Training

Enhancing the Protein Tertiary Structure Prediction by Multiple Sequence Alignment Generation

Retrieval Augmented Protein Language Models for Protein Structure Prediction

Global-Context Aware Generative Protein Design

Improving deep learning protein monomer and complex structure prediction using DeepMSA2 with huge metagenomics data

A-Prot: protein structure modeling using MSA transformer

Unsupervisedly Prompting AlphaFold2 for Accurate Few-Shot Protein Structure Prediction.

Single-sequence protein structure prediction using a language model and deep learning

Multi-level Protein Structure Pre-training via Prompt Learning

Unsupervisedly Prompting AlphaFold2 for Few-Shot Learning of Accurate Folding Landscape and Protein Structure Prediction

DeepMSA: constructing deep multiple sequence alignment to improve contact prediction and fold-recognition for distant-homology proteins

Retrieved Sequence Augmentation for Protein Representation Learning

So ManyFolds, So Little Time: Efficient Protein Structure Prediction With pLMs and MSAs

rawMSA: End-to-end Deep Learning using raw Multiple Sequence Alignments

Comprehensive Study on Enhancing Low-Quality Position-Specific Scoring Matrix with Deep Learning for Accurate Protein Structure Property Prediction: Using Bagging Multiple Sequence Alignment Learning

fastMSA: Accelerating Multiple Sequence Alignment with Dense Retrieval on Protein Language

Seq-SetNet: directly exploiting multiple sequence alignment for protein secondary structure prediction

Probabilistic Multiple Sequence Alignment using Spatial Transformations

Few Shot Protein Generation

HelixFold-Single: MSA-free Protein Structure Prediction by Using Protein Language Model as an Alternative

ProteinGPT: Multimodal LLM for Protein Property Prediction and Structure Understanding