Abstract:A major challenge to the characterization of intrinsically disordered regions (IDRs), which are widespread in the proteome, but relatively poorly understood, is the identification of molecular features that mediate functions of these regions, such as short motifs, amino acid repeats and physicochemical properties. Here, we introduce a proteome-scale feature discovery approach for IDRs. Our approach, which we call "reverse homology", exploits the principle that important functional features are conserved over evolution. We use this as a contrastive learning signal for deep learning: given a set of homologous IDRs, the neural network has to correctly choose a held-out homolog from another set of IDRs sampled randomly from the proteome. We pair reverse homology with a simple architecture and standard interpretation techniques, and show that the network learns conserved features of IDRs that can be interpreted as motifs, repeats, or bulk features like charge or amino acid propensities. We also show that our model can be used to produce visualizations of what residues and regions are most important to IDR function, generating hypotheses for uncharacterized IDRs. Our results suggest that feature discovery using unsupervised neural networks is a promising avenue to gain systematic insight into poorly understood protein sequences. Intrinsically disordered regions (IDRs) are widespread in proteins but are poorly understood on a systematic level because they evolve too rapidly for classic bioinformatics methods to be effective. We designed a neural network that learns what features (for example, electrostatic charge, or the presence of certain motifs) might be important to the function of IDRs, even when we don't have prior knowledge of function. Our neural network learns by exploiting principles of evolution. Important features tend to be conserved over species, so guessing what sequences evolved from the same common ancestor helps the neural network identify these features. Importantly, training a neural network this way can be defined as a fully automatic operation, so no manual effort is required. After our neural network is trained, we can apply interpretation techniques to understand what kinds of features are important to IDRs globally in the proteome, and to form hypotheses about specific IDRs. We show that many of the features our neural network learns are consistent with features we already know to be important to IDRs. We hope that our neural network can be applied to help biologists form hypotheses about poorly characterized IDRs.

Protein intrinsically disordered region prediction by combining neural architecture search and multi-objective genetic algorithm

An Overview of Predictors for Intrinsically Disordered Proteins over 2010–2014

Computational Prediction of Protein Intrinsically Disordered Region Related Interactions and Functions

PredIDR: Accurate prediction of protein intrinsic disorder regions using deep convolutional neural network

Deep Learning Frameworks for Protein–protein Interaction Prediction

Deep learning in prediction of intrinsic disorder in proteins

Accurate and Fast Prediction of Intrinsically Disordered Protein by Multiple Protein Language Models and Ensemble Learning

Accurate Single-Sequence Prediction of Protein Intrinsic Disorder by an Ensemble of Deep Recurrent and Convolutional Architectures

Direct prediction of intrinsically disordered protein conformational properties from sequences

Inherent Relationships among Different Biophysical Prediction Methods for Intrinsically Disordered Proteins

Discovering molecular features of intrinsically disordered regions by using evolution for contrastive learning

A Sequence-based Approach for Predicting Protein Disordered Regions

Predicting Conformational Ensembles of Intrinsically Disordered Proteins: From Molecular Dynamics to Machine Learning

PUNCH2: explore the strategy for Intrinsically Disordered Protein predictor

DR-BERT: A protein language model to annotate disordered regions

Combined Prediction and Design Reveals the Target Recognition Mechanism of an Intrinsically Disordered Protein Interaction Domain.

ADOPT: intrinsic protein disorder prediction through deep bidirectional transformers

Direct prediction of intermolecular interactions driven by disordered regions

Protein-protein interaction prediction via structure-based deep learning

iDLB-Pred: identification of disordered lipid binding residues in protein sequences using convolutional neural network

flDPnn2: Accurate and Fast Predictor of Intrinsic Disorder in Proteins