Analysis of posterior capsule opacification.

T. Aslam,N. Patton,B. Dhillon

DOI: https://doi.org/10.1111/J.1600-0420.2005.00552.X

2009-08-17

Acta Ophthalmologica

Abstract:

What problem does this paper attempt to address?

Automating Linear and Angular Measurements for the Hip and Knee After Computed Tomography: Validation of a Three-Stage Deep Learning and Computer Vision-Based Pipeline for Pathoanatomic Assessment

Faizaan R Vidhani,Joshua J Woo,Yibin B Zhang,Reena J Olsen,Prem N Ramkumar

DOI: https://doi.org/10.1016/j.artd.2024.101394

2024-05-11

Abstract:Background: Variability in the bony morphology of pathologic hips/knees is a challenge in automating preoperative computed tomography (CT) scan measurements. With the increasing prevalence of CT for advanced preoperative planning, processing this data represents a critical bottleneck in presurgical planning, research, and development. The purpose of this study was to demonstrate a reproducible and scalable methodology for analyzing CT-based anatomy to process hip and knee anatomy for perioperative planning and execution. Methods: One hundred patients with preoperative CT scans undergoing total knee arthroplasty for osteoarthritis were processed. A two-step deep learning pipeline of classification and segmentation models was developed that identifies landmark images and then generates contour representations. We utilized an open-source computer vision library to compute measurements. Classification models were assessed by accuracy, precision, and recall. Segmentation models were evaluated using dice and mean Intersection over Union (IOU) metrics. Contour measurements were compared against manual measurements to validate posterior condylar axis angle, sulcus angle, trochlear groove-tibial tuberosity distance, acetabular anteversion, and femoral version. Results: Classifiers identified landmark images with accuracy of 0.91 and 0.88 for hip and knee models, respectively. Segmentation models demonstrated mean IOU scores above 0.95 with the highest dice coefficient of 0.957 [0.954-0.961] (UNet3+) and the highest mean IOU of 0.965 [0.961-0.969] (Attention U-Net). There were no statistically significant differences for the measurements taken automatically vs manually (P > 0.05). Average time for the pipeline to preprocess (48.65 +/- 4.41 sec), classify/retrieve landmark images (8.36 +/- 3.40 sec), segment images (<1 sec), and obtain measurements was 2.58 (+/- 1.92) minutes. Conclusions: A fully automated three-stage deep learning and computer vision-based pipeline of classification and segmentation models accurately localized, segmented, and measured landmark hip and knee images for patients undergoing total knee arthroplasty. Incorporation of clinical parameters, like patient-reported outcome measures and instability risk, will be important considerations alongside anatomic parameters.
Fully automated 2D-3D registration and verification

Andreas Varnavas,Tom Carrell,Graeme Penney

DOI: https://doi.org/10.1016/j.media.2015.08.005

Abstract:Clinical application of 2D-3D registration technology often requires a significant amount of human interaction during initialisation and result verification. This is one of the main barriers to more widespread clinical use of this technology. We propose novel techniques for automated initial pose estimation of the 3D data and verification of the registration result, and show how these techniques can be combined to enable fully automated 2D-3D registration, particularly in the case of a vertebra based system. The initialisation method is based on preoperative computation of 2D templates over a wide range of 3D poses. These templates are used to apply the Generalised Hough Transform to the intraoperative 2D image and the sought 3D pose is selected with the combined use of the generated accumulator arrays and a Gradient Difference Similarity Measure. On the verification side, two algorithms are proposed: one using normalised features based on the similarity value and the other based on the pose agreement between multiple vertebra based registrations. The proposed methods are employed here for CT to fluoroscopy registration and are trained and tested with data from 31 clinical procedures with 417 low dose, i.e. low quality, high noise interventional fluoroscopy images. When similarity value based verification is used, the fully automated system achieves a 95.73% correct registration rate, whereas a no registration result is produced for the remaining 4.27% of cases (i.e. incorrect registration rate is 0%). The system also automatically detects input images outside its operating range.
Automatic 2D-3D Registration without Contrast Agent during Neurovascular Interventions

Robert Homan,René van Rijsselt,Daniel Ruijters

DOI: https://doi.org/10.48550/arXiv.2106.15308

2021-06-08

Computer Vision and Pattern Recognition

Abstract:Fusing live fluoroscopy images with a 3D rotational reconstruction of the vasculature allows to navigate endovascular devices in minimally invasive neuro-vascular treatment, while reducing the usage of harmful iodine contrast medium. The alignment of the fluoroscopy images and the 3D reconstruction is initialized using the sensor information of the X-ray C-arm geometry. Patient motion is then corrected by an image-based registration algorithm, based on a gradient difference similarity measure using digital reconstructed radiographs of the 3D reconstruction. This algorithm does not require the vessels in the fluoroscopy image to be filled with iodine contrast agent, but rather relies on gradients in the image (bone structures, sinuses) as landmark features. This paper investigates the accuracy, robustness and computation time aspects of the image-based registration algorithm. Using phantom experiments 97% of the registration attempts passed the success criterion of a residual registration error of less than 1 mm translation and 3{\deg} rotation. The paper establishes a new method for validation of 2D-3D registration without requiring changes to the clinical workflow, such as attaching fiducial markers. As a consequence, this method can be retrospectively applied to pre-existing clinical data. For clinical data experiments, 87% of the registration attempts passed the criterion of a residual translational error of < 1 mm, and 84% possessed a rotational error of < 3{\deg}.
Machine learning for automated and real-time two-dimensional to three-dimensional registration of the spine using a single radiograph

Andrew Abumoussa,Vivek Gopalakrishnan,Benjamin Succop,Michael Galgano,Sivakumar Jaikumar,Yueh Z Lee,Deb A Bhowmick

DOI: https://doi.org/10.3171/2023.3.FOCUS2345

Abstract:Objective: The goal of this work was to methodically evaluate, optimize, and validate a self-supervised machine learning algorithm capable of real-time automatic registration and fluoroscopic localization of the spine using a single radiograph or fluoroscopic frame. Methods: The authors propose a two-dimensional to three-dimensional (2D-3D) registration algorithm that maximizes an image similarity metric between radiographic images to identify the position of a C-arm relative to a 3D volume. This work utilizes digitally reconstructed radiographs (DRRs), which are synthetic radiographic images generated by simulating the x-ray projections as they would pass through a CT volume. To evaluate the algorithm, the authors used cone-beam CT data for 127 patients obtained from an open-source de-identified registry of cervical, thoracic, and lumbar scans. They systematically evaluated and tuned the algorithm, then quantified the convergence rate of the model by simulating C-arm registrations with 80 randomly simulated DRRs for each CT volume. The endpoints of this study were time to convergence, accuracy of convergence for each of the C-arm's degrees of freedom, and overall registration accuracy based on a voxel-by-voxel measurement. Results: A total of 10,160 unique radiographic images were simulated from 127 CT scans. The algorithm successfully converged to the correct solution 82% of the time with an average of 1.96 seconds of computation. The radiographic images for which the algorithm converged to the solution demonstrated 99.9% registration accuracy despite utilizing only single-precision computation for speed. The algorithm was found to be optimized for convergence when the search space was limited to a ± 45° offset in the right anterior oblique/left anterior oblique, cranial/caudal, and receiver rotation angles with the radiographic isocenter contained within 8000 cm3 of the volumetric center of the CT volume. Conclusions: The investigated machine learning algorithm has the potential to aid surgeons in level localization, surgical planning, and intraoperative navigation through a completely automated 2D-3D registration process. Future work will focus on algorithmic optimizations to improve the convergence rate and speed profile.
Automated Morphometric Analysis of the Hip Joint on MRI from the German National Cohort Study

Marc Fischer,Sven S Walter,Tobias Hepp,Manuela Zimmer,Mike Notohamiprodjo,Fritz Schick,Bin Yang

DOI: https://doi.org/10.1148/ryai.2021200213

2021-06-02

Abstract:Purpose: To develop and validate an automated morphometric analysis framework for the quantitative analysis of geometric hip joint parameters in MR images from the German National Cohort (GNC) study. Materials and methods: A secondary analysis on 40 participants (mean age, 51 years; age range, 30-67 years; 25 women) from the prospective GNC MRI study (2015-2016) was performed. Based on a proton density-weighted three-dimensional fast spin-echo sequence, a morphometric analysis approach was developed, including deep learning-based landmark localization, bone segmentation of the femora and pelvis, and a shape model for annotation transfer. The centrum-collum-diaphyseal, center-edge (CE), three alpha angles, head-neck offset (HNO), and HNO ratio along with the acetabular depth, inclination, and anteversion were derived. Quantitative validation was provided by comparison with average manual assessments of radiologists in a cross-validation format. Paired-sample t tests with a Bonferroni-corrected significance level of .005 were employed alongside mean differences and 10th/90th percentiles, median absolute deviations (MADs), and intraclass correlation coefficients (ICCs). Results: High agreement in mean Dice similarity coefficients was achieved (average of 97.52% ± 0.46 [standard deviation]). The subsequent morphometric analysis produced results with low mean MAD values, with the highest values of 3.34° (alpha 03:00 o'clock position) and 0.87 mm (HNO) and ICC values ranging between 0.288 (HNO ratio) and 0.858 (CE) compared with manual assessments. These values were in line with interreader agreements, which at most had MAD values of 4.02° (alpha 12:00 o'clock position) and 1.07 mm (HNO) and ICC values ranging between 0.218 (HNO ratio) and 0.777 (CE). Conclusion: Automatic extraction of geometric hip parameters from MRI is feasible using a morphometric analysis approach with deep learning.Keywords: Computer-Aided Diagnosis (CAD), Interventional-MSK, MR-Imaging, Neural Networks, Skeletal-Appendicular, Hip, Anatomy, Computer Applications-3D, Segmentation, Vision, Application Domain, Quantification Supplemental material is available for this article. © RSNA, 2021.
Automatic registration with continuous pose updates for marker-less surgical navigation in spine surgery

Florentin Liebmann,Marco von Atzigen,Dominik Stütz,Julian Wolf,Lukas Zingg,Daniel Suter,Nicola A Cavalcanti,Laura Leoty,Hooman Esfandiari,Jess G Snedeker,Martin R Oswald,Marc Pollefeys,Mazda Farshad,Philipp Fürnstahl,Nicola A. Cavalcanti,Jess G. Snedeker,Martin R. Oswald

DOI: https://doi.org/10.1016/j.media.2023.103027

IF: 10.9

2024-01-01

Medical Image Analysis

Abstract:Established surgical navigation systems for pedicle screw placement have been proven to be accurate, but still reveal limitations in registration or surgical guidance. Registration of preoperative data to the intraoperative anatomy remains a time-consuming, error-prone task that includes exposure to harmful radiation. Surgical guidance through conventional displays has well-known drawbacks, as information cannot be presented in-situ and from the surgeon's perspective. Consequently, radiation-free and more automatic registration methods with subsequent surgeon-centric navigation feedback are desirable. In this work, we present a marker-less approach that automatically solves the registration problem for lumbar spinal fusion surgery in a radiation-free manner. A deep neural network was trained to segment the lumbar spine and simultaneously predict its orientation, yielding an initial pose for preoperative models, which then is refined for each vertebra individually and updated in real-time with GPU acceleration while handling surgeon occlusions. An intuitive surgical guidance is provided thanks to the integration into an augmented reality based navigation system. The registration method was verified on a public dataset with a median of 100% successful registrations, a median target registration error of 2.7 mm, a median screw trajectory error of 1.6°and a median screw entry point error of 2.3 mm. Additionally, the whole pipeline was validated in an ex-vivo surgery, yielding a 100% screw accuracy and a median target registration error of 1.0 mm. Our results meet clinical demands and emphasize the potential of RGB-D data for fully automatic registration approaches in combination with augmented reality guidance.

engineering, biomedical,computer science, interdisciplinary applications, artificial intelligence,radiology, nuclear medicine & medical imaging
Fast and Automatic Periacetabular Osteotomy Fragment Pose Estimation Using Intraoperatively Implanted Fiducials and Single-View Fluoroscopy

Robert Grupp,Ryan Murphy,Rachel Hegeman,Clayton Alexander,Mathias Unberath,Yoshito Otake,Benjamin McArthur,Mehran Armand,Russell Taylor

DOI: https://doi.org/10.1088/1361-6560/aba089

2020-06-13

Abstract:Accurate and consistent mental interpretation of fluoroscopy to determine the position and orientation of acetabular bone fragments in 3D space is difficult. We propose a computer assisted approach that uses a single fluoroscopic view and quickly reports the pose of an acetabular fragment without any user input or initialization. Intraoperatively, but prior to any osteotomies, two constellations of metallic ball-bearings (BBs) are injected into the wing of a patient's ilium and lateral superior pubic ramus. One constellation is located on the expected acetabular fragment, and the other is located on the remaining, larger, pelvis fragment. The 3D locations of each BB are reconstructed using three fluoroscopic views and 2D/3D registrations to a preoperative CT scan of the pelvis. The relative pose of the fragment is established by estimating the movement of the two BB constellations using a single fluoroscopic view taken after osteotomy and fragment relocation. BB detection and inter-view correspondences are automatically computed throughout the processing pipeline. The proposed method was evaluated on a multitude of fluoroscopic images collected from six cadaveric surgeries performed bilaterally on three specimens. Mean fragment rotation error was 2.4 +/- 1.0 degrees, mean translation error was 2.1 +/- 0.6 mm, and mean 3D lateral center edge angle error was 1.0 +/- 0.5 degrees. The average runtime of the single-view pose estimation was 0.7 +/- 0.2 seconds. The proposed method demonstrates accuracy similar to other state of the art systems which require optical tracking systems or multiple-view 2D/3D registrations with manual input. The errors reported on fragment poses and lateral center edge angles are within the margins required for accurate intraoperative evaluation of femoral head coverage.

Computer Vision and Pattern Recognition,Image and Video Processing
Fiducial-Free 2D/3D Registration for Robot-Assisted Femoroplasty

Cong Gao,Amirhossein Farvardin,Robert B Grupp,Mahsan Bakhtiarinejad,Liuhong Ma,Mareike Thies,Mathias Unberath,Russell H Taylor,Mehran Armand

DOI: https://doi.org/10.1109/tmrb.2020.3012460

Abstract:Femoroplasty is a proposed alternative therapeutic method for preventing osteoporotic hip fractures in the elderly. Previously developed navigation system for femoroplasty required the attachment of an external X-ray fiducial to the femur. We propose a fiducial-free 2D/3D registration pipeline using fluoroscopic images for robot-assisted femoroplasty. Intraoperative fluoroscopic images are taken from multiple views to perform registration of the femur and drilling/injection device. The proposed method was tested through comprehensive simulation and cadaveric studies. Performance was evaluated on the registration error of the femur and the drilling/injection device. In simulations, the proposed approach achieved a mean accuracy of 1.26±0.74 mm for the relative planned injection entry point; 0.63±0.21° and 0.17±0.19° for the femur injection path direction and device guide direction, respectively. In the cadaver studies, a mean error of 2.64 ± 1.10 mm was achieved between the planned entry point and the device guide tip. The biomechanical analysis showed that even with a 4 mm translational deviation from the optimal injection path, the yield load prior to fracture increased by 40.7%. This result suggests that the fiducial-less 2D/3D registration is sufficiently accurate to guide robot assisted femoroplasty.
Towards automatic initialization of registration algorithms using simulated endoscopy images

Ayushi Sinha,Masaru Ishii,Russell H. Taylor,Gregory D. Hager,Austin Reiter

DOI: https://doi.org/10.48550/arXiv.1806.10748

2018-06-28

Abstract:Registering images from different modalities is an active area of research in computer aided medical interventions. Several registration algorithms have been developed, many of which achieve high accuracy. However, these results are dependent on many factors, including the quality of the extracted features or segmentations being registered as well as the initial alignment. Although several methods have been developed towards improving segmentation algorithms and automating the segmentation process, few automatic initialization algorithms have been explored. In many cases, the initial alignment from which a registration is initiated is performed manually, which interferes with the clinical workflow. Our aim is to use scene classification in endoscopic procedures to achieve coarse alignment of the endoscope and a preoperative image of the anatomy. In this paper, we show using simulated scenes that a neural network can predict the region of anatomy (with respect to a preoperative image) that the endoscope is located in by observing a single endoscopic video frame. With limited training and without any hyperparameter tuning, our method achieves an accuracy of 76.53 (+/-1.19)%. There are several avenues for improvement, making this a promising direction of research. Code is available at <a class="link-external link-https" href="https://github.com/AyushiSinha/AutoInitialization" rel="external noopener nofollow">this https URL</a>.

Computer Vision and Pattern Recognition,Graphics,Machine Learning
Utility of a novel integrated deep convolutional neural network for the segmentation of hip joint from computed tomography images in the preoperative planning of total hip arthroplasty

Dong Wu,Xin Zhi,Xingyu Liu,Yiling Zhang,Wei Chai

DOI: https://doi.org/10.1186/s13018-022-02932-w

2022-03-15

Abstract:Purpose: Preoperative three-dimensional planning is important for total hip arthroplasty. To simulate the placement of joint implants on computed tomography (CT), pelvis and femur must be segmented. Accurate and rapid segmentation of the hip joint is challenging. This study aimed to develop a novel deep learning network, named Changmugu Net (CMG Net), which could achieve accurate segmentation of the femur and pelvis. Methods: The overall deep neural network architecture of CMG Net employed three interrelated modules. CMG Net included the 2D U-net to separate the bony and soft tissues. The modular hierarchy method was used for the main femur segmentation to achieve better performance. A layer classifier was adopted to localise femur layers among a series of CT scan images. The first module was a modified 2D U-net, which separated bony and soft tissues; it provided intermediate supervision for the main femur segmentation. The second module was the main femur segmentation, which was used to distinguish the femur from the acetabulum. The third module was the layer classifier, which served as a post-processor for the second module. Results: There was a much greater overlap in accuracy results with the "gold standard" segmentation than with competing networks. The dice overlap coefficient was 93.55% ± 5.57%; the mean surface distance was 1.34 ± 0.24 mm, and the Hausdorff distance was 4.19 ± 1.04 mm in the normal and diseased hips, which indicated greater accuracy than the other four competing networks. Moreover, the mean segmentation time of CMG Net was 25.87 ± 2.73 s, which was shorter than the times of the other four networks. Conclusions: The prominent segmentation accuracy and run-time of CMG Net suggest that it is a reliable method for clinicians to observe anatomical structures of the hip joints, even in severely diseased cases.
[Nine cases of bladder cancer occurring in occupational dye users].

T. Murase,M. Takashi,Y. Aota,T. Shimoji,K. Miyake,H. Mitsuya

1985-08-01

Abstract:Workers in the dye manufacturing industry have a high risk of urinary bladder cancer. There may also be a high relative risk of bladder cancer in occupational dye users. Nine occupational dye users were found to have bladder cancer. The period of engaging with dye work ranged from 5 to 40 years. Seven patients had bladder cancer and the other 2 patients had lesions both in the bladder and in the renal pelvis. Histopathology of all cases was transitional cell carcinoma. Three cases were classified into grade 1 and 6 cases into grade 2. One patient died of bladder cancer. The other 8 patients are alive. Four cases recurred after TUR therapy. It is necessary to establish systemic mass screening examination of occupational dye users for the early diagnosis of bladder cancer.
Multi-task Localization and Segmentation for X-ray Guided Planning in Knee Surgery

Florian Kordon,Peter Fischer,Maxim Privalov,Benedict Swartman,Marc Schnetzke,Jochen Franke,Ruxandra Lasowski,Andreas Maier,Holger Kunze

DOI: https://doi.org/10.48550/arXiv.1907.10465

2019-07-24

Abstract:X-ray based measurement and guidance are commonly used tools in orthopaedic surgery to facilitate a minimally invasive workflow. Typically, a surgical planning is first performed using knowledge of bone morphology and anatomical landmarks. Information about bone location then serves as a prior for registration during overlay of the planning on intra-operative X-ray images. Performing these steps manually however is prone to intra-rater/inter-rater variability and increases task complexity for the surgeon. To remedy these issues, we propose an automatic framework for planning and subsequent overlay. We evaluate it on the example of femoral drill site planning for medial patellofemoral ligament reconstruction surgery. A deep multi-task stacked hourglass network is trained on 149 conventional lateral X-ray images to jointly localize two femoral landmarks, to predict a region of interest for the posterior femoral cortex tangent line, and to perform semantic segmentation of the femur, patella, tibia, and fibula with adaptive task complexity weighting. On 38 clinical test images the framework achieves a median localization error of 1.50 mm for the femoral drill site and mean IOU scores of 0.99, 0.97, 0.98, and 0.96 for the femur, patella, tibia, and fibula respectively. The demonstrated approach consistently performs surgical planning at expert-level precision without the need for manual correction.

Image and Video Processing,Computer Vision and Pattern Recognition
Automatic localization of anatomical landmarks in head cine fluoroscopy images via deep learning

Wilbur Ks Fum,Mohammad Nazri Md Shah,Raja Rizal Azman Raja Aman,Khairul Azmi Abd Kadir,Sum Leong,Li Kuo Tan

DOI: https://doi.org/10.1002/mp.17349

2024-08-14

Abstract:Background: Fluoroscopy guided interventions (FGIs) pose a risk of prolonged radiation exposure; personalized patient dosimetry is necessary to improve patient safety during these procedures. However, current FGIs systems do not capture the precise exposure regions of the patient, making it challenging to perform patient-procedure-specific dosimetry. Thus, there is a pressing need to develop approaches to extract and use this information to enable personalized radiation dosimetry for interventional procedures. Purpose: To propose a deep learning (DL) approach for the automatic localization of 3D anatomical landmarks on randomly collimated and magnified 2D head fluoroscopy images. Materials and methods: The model was developed with datasets comprising 800 000 pseudo 2D synthetic images (mixture of vessel-enhanced and non-enhancement), each with 55 annotated anatomical landmarks (two are landmarks for eye lenses), generated from 135 retrospectively collected head computed tomography (CT) volumetric data. Before training, dynamic random cropping was performed to mimic the varied field-size collimation in FGI procedures. Gaussian-distributed additive noise was applied to each individual image to enhance the robustness of the DL model in handling image degradation that may occur during clinical image acquisition in a clinical environment. The model was trained with 629 370 synthetic images for approximately 275 000 iterations and evaluated against a synthetic image test set and a clinical fluoroscopy test set. Results: The model shows good performance in estimating in- and out-of-image landmark positions and shows feasibility to instantiate the skull shape. The model successfully detected 96.4% and 92.5% 2D and 3D landmarks, respectively, within a 10 mm error on synthetic test images. It demonstrated an average of 3.6 ± 2.3 mm mean radial error and successfully detected 96.8% 2D landmarks within 10 mm error on clinical fluoroscopy images. Conclusion: Our deep-learning model successfully localizes anatomical landmarks and estimates the gross shape of skull structures from collimated 2D projection views. This method may help identify the exposure region required for patient-specific organ dosimetry in FGIs procedures.
A new algorithm for isolated electricity supply system control

Konstantin V. Suslov,D. Gerasimov,S. Solodusha

DOI: https://doi.org/10.1109/SEDST.2015.7315177

2015-11-05

Abstract:Many regions in Russia have no centralized electricity supply because of their geographical location. Taking into account variable electricity generation, available energy storage systems, as well as stricter requirements imposed by consumers on power quality and electricity supply reliability, we can say that operating conditions of such systems and their control, including emergency control, represent a difficult problem that needs to be studied. Generation from wind power plants, however, is a vivid example of stochastic operation of generators. The research is aimed at developing algorithms for the construction of automated systems to control active components of the electrical network. The method applied in the research to describe the object of control is based on the universal approach to the mathematical modelling of nonlinear dynamic system of a black-box type represented by the Volterra polynomials of the N-th degree. This makes it possible for the input and output characteristics of the object to obtain an adequate and fast mathematical description. Results of the computational experiment demonstrate the applicability of the mathematical tool to the control of active components of the intelligent power system.
TP53 gene mutation status in pretreatment biopsies of oesophageal adenocarcinoma has no prognostic value.

P. Soontrapornchai,H. Elsaleh,H. Elsaleh,David Joseph,J. Hamdorf,A. House,B. Iacopetta

DOI: https://doi.org/10.1016/S0959-8049(99)00172-0

IF: 10.002

1999-11-01

European Journal of Cancer

Abstract:
Anatomy-guided multimodal registration by learning segmentation without ground truth: Application to intraprocedural CBCT/MR liver segmentation and registration

Bo Zhou,Zachary Augenfeld,Julius Chapiro,S Kevin Zhou,Chi Liu,James S Duncan,S. Kevin Zhou,James S. Duncan

DOI: https://doi.org/10.1016/j.media.2021.102041

IF: 10.9

2021-07-01

Medical Image Analysis

Abstract:<p>Multimodal image registration has many applications in diagnostic medical imaging and image-guided interventions, such as Transcatheter Arterial Chemoembolization (TACE) of liver cancer guided by intraprocedural CBCT and pre-operative MR. The ability to register peri-procedurally acquired diagnostic images into the intraprocedural environment can potentially improve the intra-procedural tumor targeting, which will significantly improve therapeutic outcomes. However, the intra-procedural CBCT often suffers from suboptimal image quality due to lack of signal calibration for Hounsfield unit, limited FOV, and motion/metal artifacts. These non-ideal conditions make standard intensity-based multimodal registration methods infeasible to generate correct transformation across modalities. While registration based on anatomic structures, such as segmentation or landmarks, provides an efficient alternative, such anatomic structure information is not always available. One can train a deep learning-based anatomy extractor, but it requires large-scale manual annotations on specific modalities, which are often extremely time-consuming to obtain and require expert radiological readers. To tackle these issues, we leverage annotated datasets already existing in a source modality and propose an anatomy-preserving domain adaptation to segmentation network (APA2Seg-Net) for learning segmentation without target modality ground truth. The segmenters are then integrated into our anatomy-guided multimodal registration based on the robust point matching machine. Our experimental results on in-house TACE patient data demonstrated that our APA2Seg-Net can generate robust CBCT and MR liver segmentation, and the anatomy-guided registration framework with these segmenters can provide high-quality multimodal registrations.</p>

engineering, biomedical,computer science, interdisciplinary applications, artificial intelligence,radiology, nuclear medicine & medical imaging
Automatic image registration on intraoperative CBCT compared to Surface Matching registration on preoperative CT for spinal navigation: accuracy and workflow

Henrik Frisk,Gustav Burström,Oscar Persson,Victor Gabriel El-Hajj,Luisa Coronado,Susanne Hager,Erik Edström,Adrian Elmi-Terander

DOI: https://doi.org/10.1007/s11548-024-03076-4

2024-02-21

International Journal of Computer Assisted Radiology and Surgery

Abstract:Spinal navigation solutions have been slower to develop compared to cranial ones. To facilitate greater adoption and use of spinal navigation, the relatively cumbersome registration processes need to be improved upon. This study aims to validate a new solution for automatic image registration and compare it to a traditional Surface Matching method.

engineering, biomedical,radiology, nuclear medicine & medical imaging,surgery
An automated framework for pediatric hip surveillance and severity assessment using radiographs

Van Khanh Lam,Elizabeth Fischer,Kochai Jawad,Sean Tabaie,Kevin Cleary,Syed Muhammad Anwar

DOI: https://doi.org/10.1007/s11548-024-03254-4

2024-09-16

Abstract:Purpose: Hip dysplasia is the second most common orthopedic condition in children with cerebral palsy (CP) and may result in disability and pain. The migration percentage (MP) is a widely used metric in hip surveillance, calculated based on an anterior-posterior pelvis radiograph. However, manual quantification of MP values using hip X-ray scans in current standard practice has challenges including being time-intensive, requiring expert knowledge, and not considering human bias. The purpose of this study is to develop a machine learning algorithm to automatically quantify MP values using a hip X-ray scan, and hence provide an assessment for severity, which then can be used for surveillance, treatment planning, and management. Methods: X-ray scans from 210 patients were curated, pre-processed, and manually annotated at our clinical center. Several machine learning models were trained using pre-trained weights from Inception ResNet-V2, VGG-16, and VGG-19, with different strategies (pre-processing, with and without region of interest (ROI) detection, with and without data augmentation) to find an optimal model for automatic hip landmarking. The predicted landmarks were then used by our geometric algorithm to quantify the MP value for the input hip X-ray scan. Results: The pre-trained VGG-19 model, fine-tuned with additional custom layers, outputted the lowest mean squared error values for both train and test data, when ROI cropped images were used along with data augmentation for model training. The MP value calculated by the algorithm was compared to manual ground truth labels from our orthopedic fellows using the hip screen application for benchmarking. Conclusion: The results showed the feasibility of the machine learning model in automatic hip landmark detection for reliably quantifying MP value from hip X-ray scans. The algorithm could be used as an accurate and reliable tool in orthopedic care for diagnosing, severity assessment, and hence treatment and surgical planning for hip displacement.
2D/3D registration based on biplanar X-ray and CT images for surgical navigation

Demin Yang,Haochen Shi,Bolun Zeng,Xiaojun Chen

DOI: https://doi.org/10.1016/j.cmpb.2024.108444

Abstract:Background and objectives: Image-based 2D/3D registration is a crucial technology for fluoroscopy-guided surgical interventions. However, traditional registration methods relying on a single X-ray image into surgical navigation systems. This study proposes a novel 2D/3D registration approach utilizing biplanar X-ray images combined with computed tomography (CT) to significantly reduce registration and navigation errors. The method is successfully implemented in a surgical navigation system, enhancing its precision and reliability. Methods: First, we simultaneously register the frontal and lateral X-ray images with the CT image, enabling mutual complementation and more precise localization. Additionally, we introduce a novel similarity measure for image comparison, providing a more robust cost function for the optimization algorithm. Furthermore, a multi-resolution strategy is employed to enhance registration efficiency. Lastly, we propose a more accurate coordinate transformation method, based on projection and 3D reconstruction, to improve the precision of surgical navigation systems. Results: We conducted registration and navigation experiments using pelvic, spinal, and femur phantoms. The navigation results demonstrated that the feature registration errors (FREs) in the three experiments were 0.505±0.063 mm, 0.515±0.055 mm, and 0.577±0.056 mm, respectively. Compared to the point-to-point (PTP) registration method based on anatomical landmarks, our method reduced registration errors by 31.3%, 23.9%, and 26.3%, respectively. Conclusion: The results demonstrate that our method significantly reduces registration and navigation errors, highlighting its potential for application across various anatomical sites. Our code is available at: https://github.com/SJTUdemon/2D-3D-Registration.

Analysis of posterior capsule opacification.

Automating Linear and Angular Measurements for the Hip and Knee After Computed Tomography: Validation of a Three-Stage Deep Learning and Computer Vision-Based Pipeline for Pathoanatomic Assessment

Fully automated 2D-3D registration and verification

Automatic 2D-3D Registration without Contrast Agent during Neurovascular Interventions

Machine learning for automated and real-time two-dimensional to three-dimensional registration of the spine using a single radiograph

Automated Morphometric Analysis of the Hip Joint on MRI from the German National Cohort Study

Automatic registration with continuous pose updates for marker-less surgical navigation in spine surgery

Fast and Automatic Periacetabular Osteotomy Fragment Pose Estimation Using Intraoperatively Implanted Fiducials and Single-View Fluoroscopy

Fiducial-Free 2D/3D Registration for Robot-Assisted Femoroplasty

Towards automatic initialization of registration algorithms using simulated endoscopy images

Utility of a novel integrated deep convolutional neural network for the segmentation of hip joint from computed tomography images in the preoperative planning of total hip arthroplasty

[Nine cases of bladder cancer occurring in occupational dye users].

Multi-task Localization and Segmentation for X-ray Guided Planning in Knee Surgery

Automatic localization of anatomical landmarks in head cine fluoroscopy images via deep learning

A new algorithm for isolated electricity supply system control

TP53 gene mutation status in pretreatment biopsies of oesophageal adenocarcinoma has no prognostic value.

Anatomy-guided multimodal registration by learning segmentation without ground truth: Application to intraprocedural CBCT/MR liver segmentation and registration

Automatic image registration on intraoperative CBCT compared to Surface Matching registration on preoperative CT for spinal navigation: accuracy and workflow

An automated framework for pediatric hip surveillance and severity assessment using radiographs

2D/3D registration based on biplanar X-ray and CT images for surgical navigation