A hierarchical and multi-view registration of serial histopathological images
Zhineng Chen,Shuai Zhao,Kai Hu,Jing Han,Yuan Ji,Shaoping Ling,Xieping Gao
DOI: https://doi.org/10.1016/j.patrec.2021.10.019
IF: 4.757
2021-12-01
Pattern Recognition Letters
Abstract:Serial histopathological images sliced from the same biopsy section exhibit quite similar topological structures. They are usually stained with different dyes and inspected individually for different clinical purposes in the routine workflow of pathology. Recently there is increasing demand for browsing them jointly, e.g., viewing the colocalization of biomarkers. Image registration is recognized as a feasible means to bridge this requirement. However, it is challenging to register the images due to their natural content difference, variation and distortion introduced from slice preparation, the extremely large image size, etc. This letter proposes a novel Hierarchical and Multi-View Registration (HMVReg) method to alleviate the difficulties. It is a three-stage coarse-to-fine registration consisting of global rigid registration, multi-view affine transformation and multi-view elastic registration, respectively for eliminating the translational and rotational differences, globally isotropic deformation and locally anisotropic distortion. The stages are complementary and jointly contribute to a stable registration. Experimental results on both private and public data, which cover histopathological images from multiple organ tissues, demonstrate the effectiveness of the proposed HMVReg. It not only well balance the registration accuracy, robustness and speed, where serial but differently stained images are accurately aligned in a reasonable time cost. Moreover, it also shows satisfactory user experience in applying the alignment to biomarker colocalization browsing.
computer science, artificial intelligence