Abstract:Joint registration of a stack of 2D histological sections to recover 3D structure (``3D histology reconstruction'') finds application in areas such as atlas building and validation of \emph{in vivo} imaging. Straightforward pairwise registration of neighbouring sections yields smooth reconstructions but has well-known problems such as ``banana effect'' (straightening of curved structures) and ``z-shift'' (drift). While these problems can be alleviated with an external, linearly aligned reference (e.g., Magnetic Resonance (MR) images), registration is often inaccurate due to contrast differences and the strong nonlinear distortion of the tissue, including artefacts such as folds and tears. In this paper, we present a probabilistic model of spatial deformation that yields reconstructions for multiple histological stains that that are jointly smooth, robust to outliers, and follow the reference shape. The model relies on a spanning tree of latent transforms connecting all the sections and slices of the reference volume, and assumes that the registration between any pair of images can be see as a noisy version of the composition of (possibly inverted) latent transforms connecting the two images. Bayesian inference is used to compute the most likely latent transforms given a set of pairwise registrations between image pairs within and across modalities. The framework is used for accurate 3D reconstruction of two stains (Nissl and parvalbumin) from the Allen human brain atlas, showing its benefits on real data with severe distortions. Moreover, we also provide the registration of the reconstructed volume to MNI space, bridging the gaps between two of the most widely used atlases in histology and MRI. The 3D reconstructed volumes and atlas registration can be downloaded from <a class="link-external link-https" href="https://openneuro.org/datasets/ds003590" rel="external noopener nofollow">this https URL</a>. The code is freely available at <a class="link-external link-https" href="https://github.com/acasamitjana/3dhirest" rel="external noopener nofollow">this https URL</a>.

MMIR: an open-source software for the registration of multimodal histological images

Non-rigid Registration of Multimodality Medical Images Based on ITK

Regional Weighted Mutual Information For Multimodal Rigid Registration

MvMM-RegNet: A new image registration framework based on multivariate mixture model and neural network estimation

Multi-modal Image Registration for Correlative Microscopy

MURF: Mutually Reinforcing Multi-Modal Image Registration and Fusion

Multimodal image registration techniques: a comprehensive survey

CoMIR: Contrastive Multimodal Image Representation for Registration

Robust joint registration of multiple stains and MRI for multimodal 3D histology reconstruction: Application to the Allen human brain atlas

Deformable multi-modal image registration for the correlation between optical measurements and histology images

2D-3D Deformable Image Registration of Histology Slide and Micro-CT with ML-based Initialization

Framework for Deep Learning Based Multi-Modality Image Registration of Snapshot and Pathology Images

Multi-Modal Image Registration Based on Multi-Feature Mutual Information

Deformable Registration of Ultrasound and Magnetic Resonance Imaging Using A New Self-Similarity Based Neighborhood Descriptor

A hierarchical and multi-view registration of serial histopathological images

ANHIR: Automatic Non-Rigid Histological Image Registration Challenge

Multimodality image registration by maximization of mutual information

Mutual Information for Automated Unwarping of Rat Brain Autoradiographs

Unsupervised Multimodal 3D Medical Image Registration with Multilevel Correlation Balanced Optimization

Multimodal Registration of Retinal Images Using Domain-Specific Landmarks and Vessel Enhancement