Abstract:Image registration is an essential step in many medical image analysis tasks. Traditional methods for image registration are primarily optimization-driven, finding the optimal deformations that maximize the similarity between two images. Recent learning-based methods, trained to directly predict transformations between two images, run much faster, but suffer from performance deficiencies due to model generalization and the inefficiency in handling individual image specific deformations. Here we present a new neural net based image registration framework, called NIR (Neural Image Registration), which is based on optimization but utilizes deep neural nets to model deformations between image pairs. NIR represents the transformation between two images with a continuous function implemented via neural fields, receiving a 3D coordinate as input and outputting the corresponding deformation vector. NIR provides two ways of generating deformation field: directly output a displacement vector field for general deformable registration, or output a velocity vector field and integrate the velocity field to derive the deformation field for diffeomorphic image registration. The optimal registration is discovered by updating the parameters of the neural field via stochastic gradient descent. We describe several design choices that facilitate model optimization, including coordinate encoding, sinusoidal activation, coordinate sampling, and intensity sampling. Experiments on two 3D MR brain scan datasets demonstrate that NIR yields state-of-the-art performance in terms of both registration accuracy and regularity, while running significantly faster than traditional optimization-based methods.

Deep Convolutional Feature-Based Fluorescence-to-Color Image Registration.

Deep Learning Enhanced Fluorescence Emission Difference Microscopy

Enhanced Stimulated Raman and Fluorescence Imaging by Single-Frame Trained BDN

Deep learning-assisted co-registration of full-spectral autofluorescence lifetime microscopic images with H&E-stained histology images

Enhancing fluorescence microscopy performance with Richardson-Lucy based deep learning

Indocyanine Green-Based Fluorescence Imaging Improved by Deep Learning.

DeepLearnMOR: a Deep-Learning Framework for Fluorescence Image-Based Classification of Organelle Morphology.

High-quality Label-Free Prediction of Fluorescence Images Through Stimulated Raman Scattering Imaging and Recurrent Deep Neural Network.

Deep Learning for in Vivo Near-Infrared Imaging.

Deep learning method for detecting fluorescence spots in cancer diagnostics via fluorescence in situ hybridization

Deep Learning Based Fluorescence Microscopy Imaging Technologies and Applications

Registration of in vivo fluorescence endomicroscopy images based on feature detection.

DeepFLASH: an Efficient Network for Learning-based Medical Image Registration

Deep Learning Fluorescence Imaging of Visible to NIR‐II Based on Modulated Multimode Emissions Lanthanide Nanocrystals

Fluo-Fluo translation based on deep learning

Fast and Accurate Electron Microscopy Image Registration with 3D Convolution

Medical Image Registration via Neural Fields

Deep Learning-Enhanced Fluorescence Microscopy Via Degeneration Decoupling.

Volumetric feature points integration with bio-structure-informed guidance for deformable multi-modal CT image registration

Deep learning-enhanced fluorescence microscopy via confocal physical imaging model.

Deep Learning in Fluorescence Imaging and Analysis