HistoSPACE: Histology-Inspired Spatial Transcriptome Prediction And Characterization Engine

Shivam Kumar,Samrat Chatterjee
2024-08-07
Abstract:Spatial transcriptomics (ST) enables the visualization of gene expression within the context of tissue morphology. This emerging discipline has the potential to serve as a foundation for developing tools to design precision medicines. However, due to the higher costs and expertise required for such experiments, its translation into a regular clinical practice might be challenging. Despite the implementation of modern deep learning to enhance information obtained from histological images using AI, efforts have been constrained by limitations in the diversity of information. In this paper, we developed a model, HistoSPACE that explore the diversity of histological images available with ST data to extract molecular insights from tissue image. Our proposed study built an image encoder derived from universal image autoencoder. This image encoder was connected to convolution blocks to built the final model. It was further fine tuned with the help of ST-Data. This model is notably lightweight in compared to traditional histological models. Our developed model demonstrates significant efficiency compared to contemporary algorithms, revealing a correlation of 0.56 in leave-one-out cross-validation. Finally, its robustness was validated through an independent dataset, showing a well matched preditction with predefined disease pathology.
Image and Video Processing,Computer Vision and Pattern Recognition
What problem does this paper attempt to address?
### What problem does this paper attempt to solve? This paper aims to solve the problem of predicting the spatial distribution of gene expression from histomorphological images (such as HE - stained images). Specifically, the paper attempts to overcome the limitations of existing technologies by developing a model named **HistoSPACE**. The following are the core issues of this study: 1. **High cost and professional requirements**: - Although spatial transcriptomics (ST) can provide spatial information of gene expression in tissues, its high cost and requirements for professional techniques limit its application in routine clinical practice. 2. **Limitations of existing methods**: - Although deep - learning techniques have made certain progress in enhancing information extraction from histological images, these methods still have limitations in information diversity. For example, existing ST data - processing methods may not fully capture the complex features in histological images, thus affecting the prediction accuracy. 3. **Improving prediction accuracy and robustness**: - The goal of the paper is to develop a lightweight and efficient model that can retain high prediction accuracy while reducing the demand for computational resources and maintaining good generalization ability on different datasets. ### Solutions To solve the above problems, the authors proposed an algorithm based on auto - encoders - **HistoSPACE**. The main features of this model include: - **Image encoder**: Use the encoder part trained by the general - purpose image auto - encoder as a feature extractor and combine it with convolutional blocks to build the final model. - **Lightweight design**: Compared with traditional histological models, HistoSPACE is more lightweight and has lower computational costs. - **Efficient prediction**: Through leave - one - out cross - validation, the model shows a correlation of 0.56, indicating its efficiency in predicting gene expression. - **External validation**: Through the validation of an independent dataset, the robustness of the model and its matching with predefined pathologies are proved. ### Conclusions Through the development of the HistoSPACE model, this study not only improves the ability to predict gene expression from histological images but also reduces the required professional knowledge and technical thresholds, and is expected to promote the wide application of spatial transcriptomics in clinical practice.