Abstract:Purpose: The purpose of this study is to analyze and compare six automatic intensity-based registration methods for intraoperative infrared thermography (IRT) and visible light imaging (VIS/RGB). The practical requirement is to get a good performance of Euclidean distance between manually set landmarks in reference and target images as well as to achieve a high structural similarity index metric (SSIM) and peak signal-to-noise ratio (PSNR) with respect to the reference image. Methods: In this study, preprocessing is applied to bring both image types to a similar intensity. Similarity transformation is employed to align roughly IRT and visible light images. Two optimizers and two measures are used in this process. Thereafter, due to locally different displacement of the brain surface through respiration and heartbeat, two non-rigid transformations are applied, and finally, a bicubic interpolation is carried out to compensate for the resulting estimated transformation. Performance was assessed using eleven image datasets. The registration accuracy of the different computational approaches was assessed based on SSIM and PSNR. Additionally, five concise landmarks for each dataset were selected manually in reference and target images and the Euclidean distance between the corresponding landmarks was compared. Results: The results are showing that the combination of normalized intensity, mutual information measure with one-plus-one evolutionary optimizer in combination with Demon registration results in improved accuracy and performance as compared to all other methods tested here. Furthermore, the obtained results led to [Formula: see text], [Formula: see text], [Formula: see text], [Formula: see text], and [Formula: see text] registrations for datasets 1, 2, 5, 7, and 8 with respect to the second best result by calculating the mean Euclidean distance of five landmarks. Conclusions: We conclude that the mutual information measure with one-plus-one evolutionary optimizer in combination with Demon registration can achieve better accuracy and performance to those other methods mentioned here for automatic registration of IRT and visible light images in neurosurgery.

Intensity-based registration of bright-field and second-harmonic generation images of histopathology tissue sections

Deformable Registration of Histological Cancer Margins to Gross Hyperspectral Images using Demons

Accurate and Robust Alignment of Differently Stained Histologic Images Based on Greedy Diffeomorphic Registration

Deep learning based registration of serial whole-slide histopathology images in different stains

Registration Of 3-D Ct And 2-D Flat Images Of Mouse Via Affine Transformation

Fidelity-Imposed Displacement Editing for the Learn2Reg 2024 SHG-BF Challenge

Framework for Deep Learning Based Multi-Modality Image Registration of Snapshot and Pathology Images

Automatic Registration of SHG and H&E Images with Feature-based Initial Alignment and Intensity-based Instance Optimization: Contribution to the COMULIS Challenge

A Hybrid Deep Feature-Based Deformable Image Registration Method for Pathology Images

2D-3D Deformable Image Registration of Histology Slide and Micro-CT with ML-based Initialization

Registration of IRT and visible light images in neurosurgery: analysis and comparison of automatic intensity-based registration approaches

Deformable multi-modal image registration for the correlation between optical measurements and histology images

Registering Histological and Mr Images of Prostate for Image-Based Cancer Detection

Improving Algorithm for the Alignment of Consecutive, Whole-Slide, Immunohistochemical Section Images

3D Biological/Biomedical Image Registration with enhanced Feature Extraction and Outlier Detection

Weakly Supervised Registration of Prostate MRI and Histopathology Images

A hierarchical and multi-view registration of serial histopathological images

Point-Based Registration for Multi-stained Histology Images

Nonlinear Imaging Histopathology: A Pipeline to Correlate Gold-Standard Hematoxylin and Eosin Staining With Modern Nonlinear Microscopy

High-plex immunofluorescence imaging and traditional histology of the same tissue section for discovering image-based biomarkers