Abstract:In various applications, such as computer vision, medical imaging and robotics, three-dimensional (3D) image registration is a significant step. It enables the alignment of various datasets into a single coordinate system, consequently providing a consistent perspective that allows further analysis. By precisely aligning images we can compare, analyze, and combine data collected in different situations. This paper presents a novel approach for 3D or z-stack microscopy and medical image registration, utilizing a combination of conventional and deep learning techniques for feature extraction and adaptive likelihood-based methods for outlier detection. The proposed method uses the Scale-invariant Feature Transform (SIFT) and the Residual Network (ResNet50) deep neural learning network to extract effective features and obtain precise and exhaustive representations of image contents. The registration approach also employs the adaptive Maximum Likelihood Estimation SAmple Consensus (MLESAC) method that optimizes outlier detection and increases noise and distortion resistance to improve the efficacy of these combined extracted features. This integrated approach demonstrates robustness, flexibility, and adaptability across a variety of imaging modalities, enabling the registration of complex images with higher precision. Experimental results show that the proposed algorithm outperforms state-of-the-art image registration methods, including conventional SIFT, SIFT with Random Sample Consensus (RANSAC), and Oriented FAST and Rotated BRIEF (ORB) methods, as well as registration software packages such as bUnwrapJ and TurboReg, in terms of Mutual Information (MI), Phase Congruency-Based (PCB) metrics, and Gradiant-based metrics (GBM), using 3D MRI and 3D serial sections of multiplex microscopy images.

Feature-based registration of confocal fluorescence endomicroscopy images

Registration of in vivo fluorescence endomicroscopy images based on feature detection.

Registration of Confocal Fluorescence Endomicroscopy Images Using Phase Correlation

A Low-Cost Real-Time Three-Dimensional Confocal Fluorescence Endomicroscopy Imaging System

Registration Of 3d Fmt And Ct Images Of Mouse Via Affine Transformation Using Sequential Monte Carlo

Registration Of 3-D Ct And 2-D Flat Images Of Mouse Via Affine Transformation

Registration of 3D FMT and CT Images of Mouse Via Affine Transformation with Bayesian Iterative Closest Points

[Confocal probe localization algorithm based on region growing and endoscope size prior]

Study on Multi-spectral Fluorescence Confocal Endomicroscopy System

Embedded Computing for Fluorescence Confocal Endomicroscopy Imaging

Robust Mosaicing of Endomicroscopic Videos Via Context-Weighted Correlation Ratio.

Confocal microendoscopic 3D imaging using MEMS scanners for both lateral and axial scans

A dual-wavelength line-scan confocal endomicroscopy system for rapid molecular imaging (Conference Presentation)

Toward Robust Histology-Prior Embedding for Endomicroscopy Image Classification

3D Biological/Biomedical Image Registration with enhanced Feature Extraction and Outlier Detection

Confocal Laser Endomicroscope with Distal MEMS Scanner for Real-Time Histopathology

Targeted sections in either XY or XZ plane with dual-axes confocal endomicroscope (Conference Presentation)

Robot assisted endomicroscopic image mosaicing with optimal surface coverage and reconstruction

High speed, line-scanning, fiber bundle fluorescence confocal endomicroscopy for improved mosaicking.

Research on registration method for enface image using multi-feature fusion

Transfer Recurrent Feature Learning for Endomicroscopy Image Recognition.