Abstract:MOTIVATION:The development of microscopic imaging techniques enables us to study protein subcellular locations from the tissue level down to the cell level, contributing to the rapid development of image-based protein subcellular location prediction approaches. However, existing methods suffer from intrinsic limitations, such as poor feature representation ability, data imbalanced issue, and multi-label classification problem, greatly impacting the model performance and generalization.RESULTS:In this study, we propose MSTLoc, a novel multi-scale end-to-end deep learning model to identify protein subcellular locations in the imbalanced multi-label immunohistochemistry (IHC) images dataset. In our MSTLoc, we deploy a deep convolution neural network to extract multi-scale features from the IHC images, aggregate the high-level features and low-level features via feature fusion to sufficiently exploit the dependencies amongst various subcellular locations, and utilize Vision Transformer (ViT) to model the relationship amongst the features and enhance the feature representation ability. We demonstrate that the proposed MSTLoc achieves better performance than current state-of-the-art models in multi-label subcellular location prediction. Through feature visualization and interpretation analysis, we demonstrate that as compared with the hand-crafted features, the multi-scale deep features learnt from our model exhibit better ability in capturing discriminative patterns underlying protein subcellular locations, and the features from different scales are complementary for the improvement in performance. Finally, case study results indicate that our MSTLoc can successfully identify some biomarkers from proteins that are closely involved with cancer development.AVAILABILITY AND IMPLEMENTATION:For the convenient use of our method, we establish a user-friendly webserver available at http://server.wei-group.net/MSTLoc.SUPPLEMENTARY INFORMATION:Supplementary data are available at Bioinformatics online.

Multi-marginal Contrastive Learning for Multilabel Subcellular Protein Localization

Multi-scale Deep Learning for the Imbalanced Multi-Label Protein Subcellular Localization Prediction Based on Immunohistochemistry Images

MMLoc: A Multi-instance Multi-label Learning Approach for Predicting Protein Subcellular Localization from Immunofluorescence Images

Multilabel Learning for Protein Subcellular Location Prediction

Imbalanced multi-modal multi-label learning for subcellular localization prediction of human proteins with both single and multiple sites

ImPLoc: a Multi-Instance Deep Learning Model for the Prediction of Protein Subcellular Localization Based on Immunohistochemistry Images.

Prediction of Protein Subcellular Localization Based on Microscopic Images via Multi-Task Multi-Instance Learning

Mix-Domain Contrastive Learning for Unpaired H&E-to-IHC Stain Translation

Multi-scale Multi-Instance Contrastive Learning for Whole Slide Image Classification

MIC_Locator: a Novel Image-Based Protein Subcellular Location Multi-Label Prediction Model Based on Multi-Scale Monogenic Signal Representation and Intensity Encoding Strategy

Multi Label Learning for Prediction of Human Protein Subcellular Localizations

Deep Learning-Based Classification of Protein Subcellular Localization from Immunohistochemistry Images

Incorporating Label Correlations into Deep Neural Networks to Classify Protein Subcellular Location Patterns in Immunohistochemistry Images

Unsupervised Representation Learning for Tissue Segmentation in Histopathological Images: from Global to Local Contrast.

Protein subcellular localization based on deep image features and criterion learning strategy

PScL-HDeep: Image-Based Prediction of Protein Subcellular Location in Human Tissue Using Ensemble Learning of Handcrafted and Deep Learned Features with Two-Layer Feature Selection.

Enhancing Weakly Supervised Semantic Segmentation with Multi-label Contrastive Learning and LLM Features Guidance

PScL-DDCFPred: an ensemble deep learning-based approach for characterizing multiclass subcellular localization of human proteins from bioimage data

Partial-Label Contrastive Representation Learning for Fine-grained Biomarkers Prediction from Histopathology Whole Slide Images

Mutual Contrastive Low-rank Learning to Disentangle Whole Slide Image Representations for Glioma Grading

An Artificial Intelligence-Based Stacked Ensemble Approach for Prediction of Protein Subcellular Localization in Confocal Microscopy Images