Abstract:Brain tumor is a fatal central nervous system disease that occurs in around 250,000 people each year globally and it is the second cause of cancer in children. It has been widely acknowledged that genetic factor is one of the significant risk factors for brain cancer. Thus, accurate descriptions of the locations of where the relative genes are active and how these genes express are critical for understanding the pathogenesis of brain tumor and for early detection. The Allen Developing Mouse Brain Atlas is a project on gene expression over the course of mouse brain development stages. Utilizing mouse models allows us to use a relatively homogeneous system to reveal the genetic risk factor of brain cancer. In the Allen atlas, about 435,000 high-resolution spatiotemporal in situ hybridization images have been generated for approximately 2,100 genes and currently the expression patterns over specific brain regions are manually annotated by experts, which does not scale with the continuously expanding collection of images. In this paper, we present an efficient computational approach to perform automated gene expression pattern annotation on brain images. First, the gene expression information in the brain images is captured by invariant features extracted from local image patches. Next, we adopt an augmented sparse coding method, called Stochastic Coordinate Coding, to construct high-level representations. Different pooling methods are then applied to generate gene-level features. To discriminate gene expression patterns at specific brain regions, we employ supervised learning methods to build accurate models for both binary-class and multi-class cases. Random undersampling and majority voting strategies are utilized to deal with the inherently imbalanced class distribution within each annotation task in order to further improve predictive performance. In addition, we propose a novel structure-based multi-label classification approach, which makes use of label hierarchy based on brain ontology during model learning. Extensive experiments have been conducted on the atlas and results show that the proposed approach produces higher annotation accuracy than several baseline methods. Our approach is shown to be robust on both binary-class and multi-class tasks and even with a relatively low training ratio. Our results also show that the use of label hierarchy can significantly improve the annotation accuracy at all brain ontology levels.

Automated identification of protein expression intensity and classification of protein cellular locations in mouse brain regions from immunofluorescence images

Automated gene expression pattern annotation in the mouse brain

Deep convolutional neural networks for annotating gene expression patterns in the mouse brain

Learning complex subcellular distribution patterns of proteins via analysis of immunohistochemistry images

Extracting Cellular Location of Human Proteins Using Deep Learning

Automated classification of protein subcellular localization in immunohistochemistry images to reveal biomarkers in colon cancer

Learning Consistent Subcellular Landmarks to Quantify Changes in Multiplexed Protein Maps.

CNN-based Automatic Region Identification for Accelerating Whole Mouse Brain Imaging

A Multi-Scale Multi-Model Deep Neural Network Via Ensemble Strategy on High-Throughput Microscopy Image for Protein Subcellular Localization

Mouse Brain Extractor: Brain segmentation of mouse MRI using global positional encoding and SwinUNETR

Molecularly defined and spatially resolved cell atlas of the whole mouse brain

Automatic Mouse Brain Extraction in Micro-Pet/ct Images Based on a Modified Level-Set Method.

Multi-labelled Proteins Recognition for High-Throughput Microscopy Images Using Deep Convolutional Neural Networks.

Automatic classification of neurons based on three-dimensional cytoarchitectonic images

A Template‐based Automatic Skull‐stripping Approach for Mouse Brain MR Microscopy

Automated Brain Region Segmentation for Single Cell Resolution Histological Images Based on Markov Random Field.

A molecularly defined and spatially resolved cell atlas of the whole mouse brain

Automatically detecting bregma and lambda points in rodent skull anatomy images

Transcriptome Architecture of Adult Mouse Brain Revealed by Sparse Coding of Genome-Wide In Situ Hybridization Images

MAPS: pathologist-level cell type annotation from tissue images through machine learning

AnNoBrainer, an Automated Annotation of Mouse Brain Images using Deep Learning