Abstract:In recent years, the radiofrequency ablation (RFA) therapy has become a widely accepted minimal invasive treatment for liver tumor patients. However, it is challenging for doctors to precisely and efficiently perform the percutaneous tumor punctures under free-breathing conditions. This is because the traditional RFA is based on the 2D CT Image information, the missing spatial and dynamic information is dependent on surgeons' experience. This paper presents a novel quantitative and intuitive surgical navigation modality for percutaneous respiratory tumor puncture via augmented virtual reality, which is to achieve the augmented visualization of the pre-operative virtual planning information precisely being overlaid on intra-operative surgical scenario. In the pre-operation stage, we first combine the signed distance field of feasible structures (like liver and tumor) where the puncture path can go through and unfeasible structures (like large vessels and ribs) where the needle is not allowed to go through to quantitatively generate the 3D feasible region for percutaneous puncture. Then we design three constraints according to the RFA specialists consensus to automatically determine the optimal puncture trajectory. In the intra-operative stage, we first propose a virtual-real alignment method to precisely superimpose the virtual information on surgical scenario. Then, a user-friendly collaborative holographic interface is designed for real-time 3D respiratory tumor puncture navigation, which can effectively assist surgeons fast and accurately locating the target step-by step. The validation of our system is performed on static abdominal phantom and in vivo beagle dogs with artificial lesion. Experimental results demonstrate that the accuracy of the proposed planning strategy is better than the manual planning sketched by experienced doctors. Besides, the proposed holographic navigation modality can effectively reduce the needle adjustment for precise puncture as well. Our system shows its clinical feasibility to provide the quantitative planning of optimal needle path and intuitive in situ holographic navigation for percutaneous tumor ablation without surgeons' experience-dependence and reduce the times of needle adjustment. The proposed augmented virtual reality navigation system can effectively improve the precision and reliability in percutaneous tumor ablation and has the potential to be used for other surgical navigation tasks.

Investigating the accuracy of machine vision and augmented reality in percutaneous computed tomography-guided interventions: A phantom study

Augmented Reality-Assisted CT-Guided Puncture: A Phantom Study

Puncture Accuracy of Robot-Assisted CT-Based Punctures in Interventional Radiology: An Ex Vivo Study

Evaluation of an augmented reality navigational guidance platform for percutaneous procedures in a cadaver model

A Coordinate Positioning Puncture Method under Robot-Assisted CT-guidance: Phantom and Animal Experiments.

Improving puncture accuracy in percutaneous CT-guided needle insertion with wireless inertial measurement unit: a phantom study

Towards quantitative and intuitive percutaneous tumor puncture via augmented virtual reality

Performance Comparison of Augmented Reality Versus Ultrasound Guidance for Puncture: A Phantom Study

Accuracy and Efficiency of an Infrared Based Positioning and Tracking System for Image-Guided Intervention

Phantom and Animal Study of a Robot-Assisted, CT-Guided Targeting System using Image-Only Navigation for Stereotactic Needle Insertion without Positional Sensors

Evaluation of robotic-assisted navigation system for CT-guided thoracic and abdominal lesion puncture: A prospective clinical study

Research on Accuracy of Augmented Reality Surgical Navigation System Based on Multi-View Virtual and Real Registration Technology.

Mixed reality navigation system for ultrasound-guided percutaneous punctures: a pre-clinical evaluation

Evaluation of the Access Cube Patient-Mounted Navigation System for CT-Guided Percutaneous Needle Placement-A Phantom Study

Noncontact measurement of puncture needle angle using augmented reality technology in computed tomography-guided biopsy: stereotactic coordinate design and accuracy evaluation

Robot-Assisted Needle Insertion for CT-Guided Puncture: Experimental Study with a Phantom and Animals

Low-dose CT fluoroscopy-guided interventional minimally invasive robot

Robotic Needle Insertion With 2D Ultrasound–3D CT Fusion Guidance

Investigating uncertainty in augmented reality enhanced renal navigation using in vitro patient-specific tissue-mimicking phantoms

Computed tomography and structured light imaging guided orthopedic navigation puncture system: effective reduction of intraoperative image drift and mismatch

Collecting System Percutaneous Access Using MR-assisted Guidance:First Human Phantom Experience