Abstract:With over 60 disorder predictors, users need help navigating the predictor selection task. We review 28 surveys of disorder predictors, showing that only 11 include assessment of predictive performance. We identify and address a few drawbacks of these past surveys. To this end, we release a novel benchmark dataset with reduced similarity to the training sets of the considered predictors. We use this dataset to perform a first-of-its-kind comparative analysis that targets two large functional families of disordered proteins that interact with proteins and with nucleic acids. We show that limiting sequence similarity between the benchmark and the training datasets has a substantial impact on predictive performance. We also demonstrate that predictive quality is sensitive to the use of the well-annotated order and inclusion of the fully structured proteins in the benchmark datasets, both of which should be considered in future assessments. We identify three predictors that provide favorable results using the new benchmark set. While we find that VSL2B offers the most accurate and robust results overall, ESpritz-DisProt and SPOT-Disorder perform particularly well for disordered proteins. Moreover, we find that predictions for the disordered protein-binding proteins suffer low predictive quality compared to generic disordered proteins and the disordered nucleic acids-binding proteins. This can be explained by the high disorder content of the disordered protein-binding proteins, which makes it difficult for the current methods to accurately identify ordered regions in these proteins. This finding motivates the development of a new generation of methods that would target these difficult-to-predict disordered proteins. We also discuss resources that support users in collecting and identifying high-quality disorder predictions.

A comprehensive review and comparison of existing computational methods for intrinsically disordered protein and region prediction.

Computational Prediction of Protein Intrinsically Disordered Region Related Interactions and Functions

An Overview of Predictors for Intrinsically Disordered Proteins over 2010–2014

A comprehensive review and comparison of existing computational methods for protein function prediction

Inherent Relationships among Different Biophysical Prediction Methods for Intrinsically Disordered Proteins

Comprehensive comparative assessment of in-silico predictors of disordered regions.

Prediction of the Disordered Regions of Intrinsically Disordered Proteins Based on the Molecular Functions.

A Comprehensive Review and Comparison of Different Computational Methods for Protein Remote Homology Detection

Protein Inter-residue Contacts Prediction: Methods, Performances and Applications

Protein intrinsically disordered region prediction by combining neural architecture search and multi-objective genetic algorithm

IDP–CRF: Intrinsically Disordered Protein/Region Identification Based on Conditional Random Fields

Tutorial: a guide for the selection of fast and accurate computational tools for the prediction of intrinsic disorder in proteins

Computational Methods to Investigate Intrinsically Disordered Proteins and their Complexes

Computational Methods for Protein Localization Prediction

Exploring the computational methods for protein-ligand binding site prediction

A Sequence-based Approach for Predicting Protein Disordered Regions

Prediction of Intrinsically Disordered Proteins Using Multi-Scale Analysis

Machine learning methods to study disordered proteins

A Review of Protein Inter-residue Distance Prediction

Comparative Assessment of Intrinsic Disorder Predictions with a Focus on Protein and Nucleic Acid-Binding Proteins

A comprehensive review of protein-centric predictors for biomolecular interactions: from proteins to nucleic acids and beyond