Abstract:Image-based navigation is widely considered the next frontier of minimally invasive surgery. It is believed that image-based navigation will increase the access to reproducible, safe, and high-precision surgery as it may then be performed at acceptable costs and effort. This is because image-based techniques avoid the need of specialized equipment and seamlessly integrate with contemporary workflows. Furthermore, it is expected that image-based navigation techniques will play a major role in enabling mixed reality environments, as well as autonomous and robot-assisted workflows. A critical component of image guidance is 2D/3D registration, a technique to estimate the spatial relationships between 3D structures, e.g., preoperative volumetric imagery or models of surgical instruments, and 2D images thereof, such as intraoperative X-ray fluoroscopy or endoscopy. While image-based 2D/3D registration is a mature technique, its transition from the bench to the bedside has been restrained by well-known challenges, including brittleness with respect to optimization objective, hyperparameter selection, and initialization, difficulties in dealing with inconsistencies or multiple objects, and limited single-view performance. One reason these challenges persist today is that analytical solutions are likely inadequate considering the complexity, variability, and high-dimensionality of generic 2D/3D registration problems. The recent advent of machine learning-based approaches to imaging problems that, rather than specifying the desired functional mapping, approximate it using highly expressive parametric models holds promise for solving some of the notorious challenges in 2D/3D registration. In this manuscript, we review the impact of machine learning on 2D/3D registration to systematically summarize the recent advances made by introduction of this novel technology. Grounded in these insights, we then offer our perspective on the most pressing needs, significant open problems, and possible next steps.

Particle Swarm Optimization in 3D Medical Image Registration: A Systematic Review

Image registration algorithm using an improved PSO algorithm

An Medical Image Registration Approach Using Improved Hausdorff Distance Combined with Particle Swarm Optimization

Medical Image Registration Based on JS Measure and Niche Chaotic Mutation Quantum-Behaved Particle Swarm Optimization

Medical Image Registration Based on Improved PSO Algorithm

Feature and Intensity Based Medical Image Registration Using Particle Swarm Optimization

A Distance Oriented Kalman Filter Particle Swarm Optimizer Applied to Multi-Modality Image Registration

Multimodal Medical Image Registration Based on Gradient Vector Flow and Particle Swarm Optimization

Optical Remote Sensing Image Registration Using Spatial-Consistency and Average Regional Information Divergence Minimization Via Quantum-Behaved Particle Swarm Optimization.

Primitive Simultaneous Optimization of Similarity Metrics for Image Registration

Particle Swarm Optimization for Solving Medical Image Reconstruction Ill-conditioned Problems

A Review of Deep Learning-Based Three-Dimensional Medical Image Registration Methods

3D Biological/Biomedical Image Registration with enhanced Feature Extraction and Outlier Detection

Embedded Feature Similarity Optimization with Specific Parameter Initialization for 2D/3D Medical Image Registration

Nature Inspired Evolutionary Swarm Optimizers for Biomedical Image and Signal Processing -- A Systematic Review

The Impact of Machine Learning on 2D/3D Registration for Image-Guided Interventions: A Systematic Review and Perspective

An Artificial Agent for Robust Image Registration

Bacterial Foraging Optimization for intensity-based medical image registration

Particle Swarm Optimization Algorithm and Its Applications: A Systematic Review

Attention Guided Policy Optimization for 3D Medical Image Registration

Research on particle swarm optimization based clustering: A systematic review of literature and techniques