Abstract:MOTIVATION:The development of microscopic imaging techniques enables us to study protein subcellular locations from the tissue level down to the cell level, contributing to the rapid development of image-based protein subcellular location prediction approaches. However, existing methods suffer from intrinsic limitations, such as poor feature representation ability, data imbalanced issue, and multi-label classification problem, greatly impacting the model performance and generalization.RESULTS:In this study, we propose MSTLoc, a novel multi-scale end-to-end deep learning model to identify protein subcellular locations in the imbalanced multi-label immunohistochemistry (IHC) images dataset. In our MSTLoc, we deploy a deep convolution neural network to extract multi-scale features from the IHC images, aggregate the high-level features and low-level features via feature fusion to sufficiently exploit the dependencies amongst various subcellular locations, and utilize Vision Transformer (ViT) to model the relationship amongst the features and enhance the feature representation ability. We demonstrate that the proposed MSTLoc achieves better performance than current state-of-the-art models in multi-label subcellular location prediction. Through feature visualization and interpretation analysis, we demonstrate that as compared with the hand-crafted features, the multi-scale deep features learnt from our model exhibit better ability in capturing discriminative patterns underlying protein subcellular locations, and the features from different scales are complementary for the improvement in performance. Finally, case study results indicate that our MSTLoc can successfully identify some biomarkers from proteins that are closely involved with cancer development.AVAILABILITY AND IMPLEMENTATION:For the convenient use of our method, we establish a user-friendly webserver available at http://server.wei-group.net/MSTLoc.SUPPLEMENTARY INFORMATION:Supplementary data are available at Bioinformatics online.

Protein Subcellular Localization Prediction by Concatenation of Convolutional Blocks for Deep Features Extraction From Microscopic Images

An Artificial Intelligence-Based Stacked Ensemble Approach for Prediction of Protein Subcellular Localization in Confocal Microscopy Images

Protein subcellular localization based on deep image features and criterion learning strategy

Human Protein Subcellular Localization with Integrated Source and Multi-label Ensemble Classifier.

ImPLoc: a Multi-Instance Deep Learning Model for the Prediction of Protein Subcellular Localization Based on Immunohistochemistry Images.

Bioimage-Based Prediction of Protein Subcellular Location in Human Tissue with Ensemble Features and Deep Networks.

Extracting Cellular Location of Human Proteins Using Deep Learning

Subcellular Localization Prediction by Deep N-to-1 Convolutional Neural Networks

Deep Model-Based Feature Extraction for Predicting Protein Subcellular Localizations from Bio-Images.

Prediction of Protein Subcellular Localization Based on Microscopic Images via Multi-Task Multi-Instance Learning

Protein Subcellular Localization Prediction Based on Attention Mechanism and Multi-Channel Spatial Modeling for Imbalanced Data

Imbalanced multi-modal multi-label learning for subcellular localization prediction of human proteins with both single and multiple sites

Multi-labelled Proteins Recognition for High-Throughput Microscopy Images Using Deep Convolutional Neural Networks.

Protein Subcellular Localization Prediction Model Based on Graph Convolutional Network

AMC-Net: Asymmetric and Multi-Scale Convolutional Neural Network for Multi-Label HPA Classification.

Convolutional Neural Network-Based Artificial Intelligence for Classification of Protein Localization Patterns

A Multi-Scale Multi-Model Deep Neural Network Via Ensemble Strategy on High-Throughput Microscopy Image for Protein Subcellular Localization

PScL-HDeep: Image-Based Prediction of Protein Subcellular Location in Human Tissue Using Ensemble Learning of Handcrafted and Deep Learned Features with Two-Layer Feature Selection.

Multilabel Learning for Protein Subcellular Location Prediction

Deep localization of protein structures in fluorescence microscopy images

Multi-scale Deep Learning for the Imbalanced Multi-Label Protein Subcellular Localization Prediction Based on Immunohistochemistry Images