Abstract:Mitochondria and plastids import thousands of proteins. Their experimental localisation remains a frequent task, but can be resource-intensive and sometimes impossible. Hence, hundreds of studies make use of algorithms that predict a localisation based on a protein's sequence. Their reliability across evolutionary diverse species is unknown. Here, we evaluate the performance of common algorithms (TargetP, Localizer and WoLFPSORT) for four photosynthetic eukaryotes ( Arabidopsis thaliana , Zea mays , Physcomitrium patens , and Chlamydomonas reinhardtii ) for which experimental plastid and mitochondrial proteome data is available, and 171 eukaryotes using orthology inferences. The match between predictions and experimental data ranges from 75% to as low as 2%. Results worsen as the evolutionary distance between training and query species increases, especially for plant mitochondria for which performance borders on random sampling. Specificity, sensitivity and precision analyses highlight cross-organelle errors and uncover the evolutionary divergence of organelles as the main driver of current performance issues. The results encourage to train the next generation of neural networks on an evolutionary more diverse set of organelle proteins for optimizing performance and reliability. Recent advancements in genome sequencing and machine learning have been instrumental in solving numerous biological challenges, such as the prediction of the folded state of proteins from sequences alone. An intriguing cell biological challenge is tracking the localization of proteins within cells. For example, some nuclear-encoded proteins localize to mitochondria, while some are sorted to plastids. Experimentally tracking the localization of each protein across thousands of species is laborious. Instead, researchers use machine learning algorithms to predict where proteins are likely to be localized based on their sequence. How reliable are these predictions? We evaluated the reliability of prediction tools across more than a hundred plant species. We found that, as the evolutionary distance between the species used for training the algorithms and those used for testing increases, the accuracy of the predictions declines sharply. This perspective has allowed us to propose new strategies to improve these algorithms. We believe that training more distant plant genome sequences in combination with advances in artificial intelligence–and viewed through an evolutionary lens–will be crucial for developing localization prediction algorithms that are reliable across a wide range of species.

An Overview on Predicting Protein Subchloroplast Localization by using Machine Learning Methods

Psi: A Comprehensive And Integrative Approach For Accurate Plant Subcellular Localization Prediction

SubChlo-GO: Predicting Protein Subchloroplast Locations with Weighted Gene Ontology Scores

SubChlo: Predicting Protein Subchloroplast Locations with Pseudo-Amino Acid Composition and the Evidence-Theoretic K-nearest Neighbor (ET-KNN) Algorithm.

Recent progress in predicting protein sub-subcellular locations.

DaDL-SChlo: protein subchloroplast localization prediction based on generative adversarial networks and pre-trained protein language model

A Study of Prediction Methods for Protein Subcellular Localization

Subcellular Localization Prediction of Human Proteins Using Multifeature Selection Methods

Esub8: a Novel Tool to Predict Protein Subcellular Localizations in Eukaryotic Organisms.

Protein Subcellular Localization Based on PSI-BLAST and Machine Learning.

Predicting Human Protein Subcellular Locations by Using a Combination of Network and Function Features

Predicting subcellular localization of proteins using support vector machine with n-terminal amino composition

Identification of Multiple Subcellular Locations for Proteins in Budding Yeast

Protein Subcellular Localization Prediction Tools

Prediction of protein subcellular localization in single cells

Improving Prediction of Protein Subcellular Localization Using Evolutionary Information and Sequence-Order Information

Critical evaluation of web-based prediction tools for human protein subcellular localization

Multilabel Learning for Protein Subcellular Location Prediction

Reliability of plastid and mitochondrial localisation prediction declines rapidly with the evolutionary distance to the training set increasing

Prediction of protein subplastid localization and origin with PlastoGram

Identifying Protein Submitochondrial Location by Using Features of Sequence