Antibiotic use and the risk of flare of inflammatory bowel disease.

F. Aberra,C. Brensinger,W. Bilker,G. Lichtenstein,J. Lewis

DOI: https://doi.org/10.1016/S1542-3565(05)00020-0

IF: 13.576

2005-05-01

Clinical Gastroenterology and Hepatology

Abstract:

What problem does this paper attempt to address?

Augmented reality calibration using feature triangulation iteration-based registration for surgical navigation

Long Shao,Shuo Yang,Tianyu Fu,Yucong Lin,Haixiao Geng,Danni Ai,Jingfan Fan,Hong Song,Tao Zhang,Jian Yang

DOI: https://doi.org/10.1016/j.compbiomed.2022.105826

Abstract:Background: Marker-based augmented reality (AR) calibration methods for surgical navigation often require a second computed tomography scan of the patient, and their clinical application is limited due to high manufacturing costs and low accuracy. Methods: This work introduces a novel type of AR calibration framework that combines a Microsoft HoloLens device with a single camera registration module for surgical navigation. A camera is used to gather multi-view images of a patient for reconstruction in this framework. A shape feature matching-based search method is proposed to adjust the size of the reconstructed model. The double clustering-based 3D point cloud segmentation method and 3D line segment detection method are also proposed to extract the corner points of the image marker. The corner points are the registration data of the image marker. A feature triangulation iteration-based registration method is proposed to quickly and accurately calibrate the pose relationship between the image marker and the patient in the virtual and real space. The patient model after registration is wirelessly transmitted to the HoloLens device to display the AR scene. Results: The proposed approach was used to conduct accuracy verification experiments on the phantoms and volunteers, which were compared with six advanced AR calibration methods. The proposed method obtained average fusion errors of 0.70 ± 0.16 and 0.91 ± 0.13 mm in phantom and volunteer experiments, respectively. The fusion accuracy of the proposed method is the highest among all comparison methods. A volunteer liver puncture clinical simulation experiment was also conducted to show the clinical feasibility. Conclusions: Our experiments proved the effectiveness of the proposed AR calibration method, and revealed a considerable potential for improving surgical performance.
Semi-Automatic Infrared Calibration for Augmented Reality Systems in Surgery

Hisham Iqbal,Ferdinando Rodriguez y Baena

DOI: https://doi.org/10.1109/IROS47612.2022.9982215

2024-05-03

Abstract:Augmented reality (AR) has the potential to improve the immersion and efficiency of computer-assisted orthopaedic surgery (CAOS) by allowing surgeons to maintain focus on the operating site rather than external displays in the operating theatre. Successful deployment of AR to CAOS requires a calibration that can accurately calculate the spatial relationship between real and holographic objects. Several studies attempt this calibration through manual alignment or with additional fiducial markers in the surgical scene. We propose a calibration system that offers a direct method for the calibration of AR head-mounted displays (HMDs) with CAOS systems, by using infrared-reflective marker-arrays widely used in CAOS. In our fast, user-agnostic setup, a HoloLens 2 detected the pose of marker arrays using infrared response and time-of-flight depth obtained through sensors onboard the HMD. Registration with a commercially available CAOS system was achieved when an IR marker-array was visible to both devices. Study tests found relative-tracking mean errors of 2.03 mm and 1.12° when calculating the relative pose between two static marker-arrays at short ranges. When using the calibration result to provide in-situ holographic guidance for a simulated wire-insertion task, a pre-clinical test reported mean errors of 2.07 mm and 1.54° when compared to a pre-planned trajectory.

Robotics
Quantitative determination of the HIV protease inhibitor atazanavir (BMS-232632) in human plasma by liquid chromatography-tandem mass spectrometry following automated solid-phase extraction.

A. Schuster,S. Burzawa,M. Jemal,E. Loizillon,Philippe Couerbe,D. Whigan

DOI: https://doi.org/10.1016/S1570-0232(03)00063-1

2003-05-25

Abstract:
Cognitive rehearsal in the treatment of obesity: a comparison against cue avoidance and social pressure.

G. Bennett

DOI: https://doi.org/10.1016/0306-4603(86)90051-1

Abstract:
Moving-Tolerant Augmented Reality Surgical Navigation System Using Autostereoscopic Three-Dimensional Image Overlay

Cong Ma,Guowen Chen,Xinran Zhang,Guochen Ning,Hongen Liao

DOI: https://doi.org/10.1109/jbhi.2018.2885378

IF: 7.7

2019-01-01

IEEE Journal of Biomedical and Health Informatics

Abstract:Augmented reality (AR) surgical navigation systems based on image overlay have been used in minimally invasive surgery. However, conventional systems still suffer from a limited viewing zone, a shortage of intuitive three-dimensional (3D) image guidance and cannot be moved freely. To fuse the 3-D overlay image with the patient in situ, it is essential to track the overlay device while it is moving. A direct line-of-sight should be maintained between the optical markers and the tracker camera. In this study, we propose a moving-tolerant AR surgical navigation system using autostereoscopic image overlay, which can avoid the use of the optical tracking system during the intraoperative period. The system captures binocular image sequences of environmental change in the operation room to locate the overlay device, rather than tracking the device directly. Therefore, it is no longer required to maintain a direct line-of-sight between the tracker and the tracked devices. The movable range of the system is also not limited by the scope of the tracker camera. Computer simulation experiments demonstrate the reliability of the proposed moving-tolerant AR surgical navigation system. We also fabricate a computer-generated integral photography-based 3-D overlay AR system to validate the feasibility of the proposed moving-tolerant approach. Qualitative and quantitative experiments demonstrate that the proposed system can always fuse the 3-D image with the patient, thus, increasing the feasibility and reliability of traditional 3-D overlay image AR surgical navigation systems.
Visualization, Registration and Tracking Techniques for Augmented Reality Guided Surgery: a Review

Longfei Ma,Tianqi Huang,Jie Wang,Hongen Liao

DOI: https://doi.org/10.1088/1361-6560/acaf23

2023-01-01

Abstract:Augmented reality (AR) surgical navigation has developed rapidly in recent years. This paper reviews and analyzes the visualization, registration, and tracking techniques used in AR surgical navigation systems, as well as the application of these AR systems in different surgical fields. The types of AR visualization are divided into two categories of in situ visualization and non in situ visualization. The rendering contents of AR visualization are various. The registration methods include manual registration, point-based registration, surface registration, marker-based registration, and calibration-based registration. The tracking methods consist of self-localization, tracking with integrated cameras, external tracking, and hybrid tracking. Moreover, we describe the applications of AR in surgical fields. However, most AR applications were evaluated through model experiments and animal experiments, and there are relatively few clinical experiments, indicating that the current AR navigation methods are still in the early stage of development. Finally, we summarize the contributions and challenges of AR in the surgical fields, as well as the future development trend. Despite the fact that AR-guided surgery has not yet reached clinical maturity, we believe that if the current development trend continues, it will soon reveal its clinical utility.
Identifying sources of nitrogen to Hanalei Bay, Kauai, utilizing the nitrogen isotope signature of macroalgae.

E. Derse,K. Knee,S. Wankel,C. Kendall,C. Berg,A. Paytan

DOI: https://doi.org/10.1021/ES0700449

2007-06-19

Abstract:Sewage effluent, storm runoff, discharge from polluted rivers, and inputs of groundwater have all been suggested as potential sources of land derived nutrients into Hanalei Bay, Kauai. We determined the nitrogen isotopic signatures (delta(15)N) of different nitrate sources to Hanalei Bay along with the isotopic signature recorded by 11 species of macroalgal collected in the Bay. The macroalgae integrate the isotopic signatures of the nitrate sources over time, thus these data along with the nitrate to dissolved inorganic phosphate molar ratios (N:P) of the macroalgae were used to determine the major nitrate source to the bay ecosystem and which of the macro-nutrients is limiting algae growth, respectively. Relatively low delta(15)N values (average -0.5% per hundred) were observed in all algae collected throughout the Bay; implicating fertilizer, rather than domestic sewage, as an important external source of nitrogen to the coastal water around Hanalei. The N:P ratio in the algae compared to the ratio in the Bay waters imply that the Hanalei Bay coastal ecosystem is nitrogen limited and thus, increased nitrogen input may potentially impact this coastal ecosystem and specifically the coral reefs in the Bay. Identifying the major source of nutrient loading to the Bay is important for risk assessment and potential remediation plans.
Real-Time Computer-Generated Integral Imaging and 3d Image Calibration for Augmented Reality Surgical Navigation

Junchen Wang,Hideyuki Suenaga,Hongen Liao,Kazuto Hoshi,Liangjing Yang,Etsuko Kobayashi,Ichiro Sakuma

DOI: https://doi.org/10.1016/j.compmedimag.2014.11.003

IF: 7.422

2015-01-01

Computerized Medical Imaging and Graphics

Abstract:Autostereoscopic 3D image overlay for augmented reality (AR) based surgical navigation has been studied and reported many times. For the purpose of surgical overlay, the 3D image is expected to have the same geometric shape as the original organ, and can be transformed to a specified location for image overlay. However, how to generate a 3D image with high geometric fidelity and quantitative evaluation of 3D image's geometric accuracy have not been addressed. This paper proposes a graphics processing unit (GPU) based computer-generated integral imaging pipeline for real-time autostereoscopic 3D display, and an automatic closed-loop 3D image calibration paradigm for displaying undistorted 3D images. Based on the proposed methods, a novel AR device for 3D image surgical overlay is presented, which mainly consists of a 3D display, an AR window, a stereo camera for 3D measurement, and a workstation for information processing. The evaluation on the 3D image rendering performance with 2560×1600 elemental image resolution shows the rendering speeds of 50–60 frames per second (fps) for surface models, and 5–8 fps for large medical volumes. The evaluation of the undistorted 3D image after the calibration yields sub-millimeter geometric accuracy. A phantom experiment simulating oral and maxillofacial surgery was also performed to evaluate the proposed AR overlay device in terms of the image registration accuracy, 3D image overlay accuracy, and the visual effects of the overlay. The experimental results show satisfactory image registration and image overlay accuracy, and confirm the system usability.
An Accurate 3D Augmented Reality Navigation System with Enhanced Autostereoscopic Display for Oral and Maxillofacial Surgery

Boxuan Han,Ruiyang Li,Tianqi Huang,Longfei Ma,Hanying Liang,Xinran Zhang,Hongen Liao

DOI: https://doi.org/10.1002/rcs.2404

2022-01-01

International Journal of Medical Robotics and Computer Assisted Surgery

Abstract:Background Oral and maxillofacial surgery demands high precision navigation to achieve optimal surgical outcomes. Augmented reality (AR) has been a promising solution for intuitive and accurate guidance, whereas existing systems have room for improvement. Methods We propose a high quality and accurate in situ AR navigation system. Enhanced image quality is achieved by deploying eye tracking in lenticular-based autostereoscopic display. Viewpoint tracking and optical tracking are integrated to assure accurate in situ images. Results The proposed system can provide in situ AR images in real-time, with a viewing angle of 59.5 degrees x 49.1 degrees, 3D image resolution of 0.35 x 0.21 mm, and image accuracy of 0.99 +/- 0.70 mm. A maxillary drilling experiment obtains average position error of 1.12 +/- 0.30 mm and localization time of 8.7 +/- 3.9 s, significantly better than conventional 2D navigation system. Conclusions The proposed system can display high-quality AR images and therefore reduce positioning error and operating time.
A practical marker-less image registration method for augmented reality oral and maxillofacial surgery

Junchen Wang,Yu Shen,Shuo Yang

DOI: https://doi.org/10.1007/s11548-019-01921-5

2019-03-01

International Journal of Computer Assisted Radiology and Surgery

Abstract:BackgroundImage registration lies in the core of augmented reality (AR), which aligns the virtual scene with the reality. In AR surgical navigation, the performance of image registration is vital to the surgical outcome.MethodsThis paper presents a practical marker-less image registration method for AR-guided oral and maxillofacial surgery where a virtual scene is generated and mixed with reality to guide surgical operation or provide surgical outcome visualization in the manner of video see-through overlay. An intraoral 3D scanner is employed to acquire the patient’s teeth shape model intraoperatively. The shape model is then registered with a custom-made stereo camera system using a novel 3D stereo matching algorithm and with the patient’s CT-derived 3D model using an iterative closest point scheme, respectively. By leveraging the intraoral 3D scanner, the CT space and the stereo camera space are associated so that surrounding anatomical models and virtual implants could be overlaid on the camera’s view to achieve AR surgical navigation.ResultsJaw phantom experiments were performed to evaluate the target registration error of the overlay, which yielded an average error of less than 0.50 mm with the time cost less than 0.5 s. Volunteer trial was also conducted to show the clinical feasibility.ConclusionsThe proposed registration method does not rely on any external fiducial markers attached to the patient. It performs automatically so as to maintain a correct AR scene, overcoming the misalignment difficulty caused by patient’s movement. Therefore, it is noninvasive and practical in oral and maxillofacial surgery.

engineering, biomedical,radiology, nuclear medicine & medical imaging,surgery
Unified Calibration Technique for Augmented-Reality Ultrasound-Guided Interventions

E. Chen,Joeana Cambranis Romero,Daniel R. Allen,T. Peters

DOI: https://doi.org/10.1109/MetroXRAINE54828.2022.9967585

2022-10-26

Abstract:Accurate spatial calibration for mobile imaging modality is the essential and enabling technology for augmented-reality based surgical navigation systems. Despite years of research, spatial calibration for surgical camera and freehand ultrasound remains areas of active research. In this paper, we present a unified spatial calibration framework for ultrasound probe calibration and camera hand-eye calibration using the same mathematical principle. By treating spatial calibration as a registration problem between paired points and lines, our framework provides i) efficient solutions with guaranteed convergence properties, and ii) based on error propagation model, a set of heuristic rules for fiducial placements that leads to accurate calibration consistently. Monte Carlo simulation demonstrated that accuracy camera hand-eye calibration (≈ 5 pixel) is possible with the Microsoft HoloLens 2 using as few as 6 fiducial measurements, and accurate ultrasound probe calibration can be consistently obtained using as few as 12 fiducial measurements.

Medicine,Computer Science,Engineering
Automatic Fast-Registration Surgical Navigation System Using Depth Camera and Integral Videography 3D Image Overlay

Cong Ma,Guowen Chen,Hongen Liao

DOI: https://doi.org/10.1007/978-3-319-43775-0_36

2016-01-01

Abstract:We propose an automatic fast-registration augmented reality (AR) surgical navigation system for minimally invasive surgery. The system integrates a fast-registration technique with three-dimensional (3D) integral videography (IV) image overlay. The detailed anatomic information generated by IV technique is superimposed to the patient using 3D autostereoscopic images, which reproduce motion parallax with naked eyes. To reduce the patient-3D overlay image registration time and achieve automatic execution, we integrate a 3D image overlay system with a real-time patient tracking system, which utilizes particle filter algorithm and depth camera. Experimental results showed that the system can lower the registration time and the can reach up to 10 frames per second (fps). The 3D overlay image to the patient registration average error is 1.88 mm, with standard deviation of 0.72 mm. Further work for improvement of the depth camera acquisition accuracy and tracking algorithm makes this system more feasible and practical.
Calibration of RGBD camera and cone-beam CT for 3D intra-operative mixed reality visualization

Sing Chun Lee,Bernhard Fuerst,Javad Fotouhi,Marius Fischer,Greg Osgood,Nassir Navab

DOI: https://doi.org/10.1007/s11548-016-1396-1

2016-04-08

International Journal of Computer Assisted Radiology and Surgery

Abstract:PurposeThis work proposes a novel algorithm to register cone-beam computed tomography (CBCT) volumes and 3D optical (RGBD) camera views. The co-registered real-time RGBD camera and CBCT imaging enable a novel augmented reality solution for orthopedic surgeries, which allows arbitrary views using digitally reconstructed radiographs overlaid on the reconstructed patient’s surface without the need to move the C-arm.MethodsAn RGBD camera is rigidly mounted on the C-arm near the detector. We introduce a calibration method based on the simultaneous reconstruction of the surface and the CBCT scan of an object. The transformation between the two coordinate spaces is recovered using Fast Point Feature Histogram descriptors and the Iterative Closest Point algorithm.ResultsSeveral experiments are performed to assess the repeatability and the accuracy of this method. Target registration error is measured on multiple visual and radio-opaque landmarks to evaluate the accuracy of the registration. Mixed reality visualizations from arbitrary angles are also presented for simulated orthopedic surgeries.ConclusionTo the best of our knowledge, this is the first calibration method which uses only tomographic and RGBD reconstructions. This means that the method does not impose a particular shape of the phantom. We demonstrate a marker-less calibration of CBCT volumes and 3D depth cameras, achieving reasonable registration accuracy. This design requires a one-time factory calibration, is self-contained, and could be integrated into existing mobile C-arms to provide real-time augmented reality views from arbitrary angles.

engineering, biomedical,radiology, nuclear medicine & medical imaging,surgery
Augmented Reality Surgical Navigation System Integrated with Deep Learning

Shin-Yan Chiou,Li-Sheng Liu,Chia-Wei Lee,Dong-Hyun Kim,Mohammed A. Al-masni,Hao-Li Liu,Kuo-Chen Wei,Jiun-Lin Yan,Pin-Yuan Chen

DOI: https://doi.org/10.3390/bioengineering10050617

IF: 5.046

2023-05-20

Bioengineering

Abstract:Most current surgical navigation methods rely on optical navigators with images displayed on an external screen. However, minimizing distractions during surgery is critical and the spatial information displayed in this arrangement is non-intuitive. Previous studies have proposed combining optical navigation systems with augmented reality (AR) to provide surgeons with intuitive imaging during surgery, through the use of planar and three-dimensional imagery. However, these studies have mainly focused on visual aids and have paid relatively little attention to real surgical guidance aids. Moreover, the use of augmented reality reduces system stability and accuracy, and optical navigation systems are costly. Therefore, this paper proposed an augmented reality surgical navigation system based on image positioning that achieves the desired system advantages with low cost, high stability, and high accuracy. This system also provides intuitive guidance for the surgical target point, entry point, and trajectory. Once the surgeon uses the navigation stick to indicate the position of the surgical entry point, the connection between the surgical target and the surgical entry point is immediately displayed on the AR device (tablet or HoloLens glasses), and a dynamic auxiliary line is shown to assist with incision angle and depth. Clinical trials were conducted for EVD (extra-ventricular drainage) surgery, and surgeons confirmed the system’s overall benefit. A “virtual object automatic scanning” method is proposed to achieve a high accuracy of 1 ± 0.1 mm for the AR-based system. Furthermore, a deep learning-based U-Net segmentation network is incorporated to enable automatic identification of the hydrocephalus location by the system. The system achieves improved recognition accuracy, sensitivity, and specificity of 99.93%, 93.85%, and 95.73%, respectively, representing a significant improvement from previous studies.
Research on Stereo 3D Display for Augmented Reality Surgical Navigation

Lixi Chen,Wei Fang,Zhan Teng

DOI: https://doi.org/10.1109/ROBIO55434.2022.10011711

2022-12-05

Abstract:Limitations exist in the application of surgical robots in clinical practice such as doctors' limited field of vision, lack of depth information, and the need to constantly switch the field of vision in the process of surgery, which affects the efficiency of surgery. In this paper, research on stereo 3D display for augmented reality (AR) surgical navigation is carried out to address the issues, which combines the technology of AR to overlay the virtual 3D model with the actual image of the operation area, providing doctors and surgical assistants with a more intuitive display method of the lesion location of patients during the operation. The stereo 3D display is presented in detail, including the theoretical research, the algorithm model, the AR effect test, and the positioning error analysis. The simulation and experiments are conducted to evaluate the performance of the stereo 3D display, which verified the practicability and effectiveness of the system and showed that the system can correctly realize pose estimation, virtual model projection, and presentation of AR effect.

Medicine,Engineering,Computer Science
A Visual-Inertial Fusion Based Tracking System For Mobile Augmented Reality

cheng lin,lianghao wang,dongxiao li,ming zhang

DOI: https://doi.org/10.1109/icspcc.2015.7338954

2015-01-01

Abstract:Recently, smart phones are usually equipped with cameras and motion sensors. This means that mobile phones have become good platforms to deploy augmented reality (AR) applications. We propose a new tracking system for AR which uses inertial measurement units (gyroscope, accelerometer and magnetic field sensor) combined with a camera to automatically detect and track a dominant plane in the scene without prior knowledge about the environment. Meanwhile, it also estimates the pose of the device, so the rendered virtual objects can be correctly overplayed on the real view. While tracking the plane and computing the camera pose with respect to the scene, the solution also needs to construct and update the map of the scene, which consists of keyframes and keypoints in our scenario. Finally, we implement our system and test its performance on Android smart phones. Our experimental results show that the system can achieve real-time and drift-free performance and the tracking is quite accurate and robust.
Augmented-Reality Surgical Navigation System for Better Healthcare Visualization

Boyu Zhang,Longfei Ma,Xiaofeng Qu,Xinran Zhang,Hongen Liao

DOI: https://doi.org/10.1007/978-981-10-9038-7_149

2019-01-01

Abstract:Nowadays, good medical services are located in the high-level hospitals. The uneven regional distribution and the unbalanced medical quality between different hospitals bring obstacles to patients for better healthcare. In the community hospital, surgeons may lack advanced surgical skills. Considering the clinical needs, we present an augmented-reality (AR) navigation system using 3-D image overlay technology for better healthcare visualization. Autostereoscopic 3-D images of anatomic structures, which are reproduced by employing integral videography technology, are superimposed on the patient via a half-silvered mirror to form an AR navigation scene. The proposed system can generate the vivid autostereoscopic 3-D medical images and realize in situ image overlay, which eliminates the hand-eye coordination problem. By using our system, surgeons can intuitively observe the operative area, the marked high-risky tissue, surgical tools and surgical planning pathway, which make the surgical operation more convenient and intuitive. To consider the demands of clinical applications, we design a new semi-streamlined prototype combining adjustment mechanism and servomotors, which can broaden the visual field. Results illustrate that the navigation system can enhance the surgeons’ operation of the facilitation, as well as the design is more integrated and commercialized, which are more suitable for clinical applications. It is advanced to realize remote visual display and intuitive guidance to solve the uneven distribution of medical resources. What’s more, the system can be used for surgical skill training under the guidance of the 3-D images. Thus, the AR system is beneficial to healthcare, especially in the resource-scare communities.
Spreading messages

Ching-Lueh Chang,Y. Lyuu

DOI: https://doi.org/10.1016/j.tcs.2009.03.032

IF: 1.002

2008-06-27

Theoretical Computer Science

Abstract:
Augmented Reality Navigation for Minimally Invasive Knee Surgery Using Enhanced Arthroscopy.

Fang Chen,Xiwen Cui,Boxuan Han,Jia Liu,Xinran Zhang,Hongen Liao

DOI: https://doi.org/10.1016/j.cmpb.2021.105952

IF: 6.1

2021-01-01

Computer Methods and Programs in Biomedicine

Abstract:PURPOSE:During the minimally invasive knee surgery, surgeons insert surgical instruments and arthroscopy through small incisions, and implement treatment assisted by 2D arthroscopic images. However, this 2D arthroscopic navigation faces several problems. Firstly, the guidance information is displayed on a screen away from the surgical area, which makes hand/eye coordination difficult. Secondly, the small incision limits the surgeons to view the internal knee structures only from an arthroscopic camera. In addition, arthroscopic images commonly appear obscure visions.METHODS:To solve these problems, we proposed a novel in-situ augmented reality navigation system with the enhanced arthroscopic information. Firstly, intraoperative anatomical locations were obtained by using arthroscopic images and arthroscopy calibration. Secondly, tissue properties-based model deformation method was proposed to update the 3D preoperative knee model with anatomical location information. Then, the updated model was further rendered with glasses-free real 3D display for achieving the global in-situ augmented reality view. In addition, virtual arthroscopic images were generated from the updated preoperative model to provide the anatomical information of the operation area.RESULTS:Experimental results demonstrated that virtual arthroscopic images could reflect the correct structure information with a mean error of 0.32 mm. Compared with 2D arthroscopic navigation, the proposed augmented reality navigation reduced the targeting errors by 2.10 mm and 2.70 mm for the experiments of knee phantom and in-vitro swine knee, respectively.CONCLUSION:Our navigation method is helpful for minimally invasive knee surgery since it can provide the global in-situ information and detail anatomical information.
STTAR: Surgical Tool Tracking Using Off-the-Shelf Augmented Reality Head-Mounted Displays

Alejandro Martin-Gomez,Haowei Li,Tianyu Song,Sheng Yang,Guangzhi Wang,Hui Ding,Nassir Navab,Zhe Zhao,Mehran Armand

DOI: https://doi.org/10.1109/TVCG.2023.3238309

Abstract:The use of Augmented Reality (AR) for navigation purposes has shown beneficial in assisting physicians during the performance of surgical procedures. These applications commonly require knowing the pose of surgical tools and patients to provide visual information that surgeons can use during the performance of the task. Existing medical-grade tracking systems use infrared cameras placed inside the Operating Room (OR) to identify retro-reflective markers attached to objects of interest and compute their pose. Some commercially available AR Head-Mounted Displays (HMDs) use similar cameras for self-localization, hand tracking, and estimating the objects' depth. This work presents a framework that uses the built-in cameras of AR HMDs to enable accurate tracking of retro-reflective markers without the need to integrate any additional electronics into the HMD. The proposed framework can simultaneously track multiple tools without having previous knowledge of their geometry and only requires establishing a local network between the headset and a workstation. Our results show that the tracking and detection of the markers can be achieved with an accuracy of 0.09±0.06 mm on lateral translation, 0.42 ±0.32 mm on longitudinal translation and 0.80 ±0.39° for rotations around the vertical axis. Furthermore, to showcase the relevance of the proposed framework, we evaluate the system's performance in the context of surgical procedures. This use case was designed to replicate the scenarios of k-wire insertions in orthopedic procedures. For evaluation, seven surgeons were provided with visual navigation and asked to perform 24 injections using the proposed framework. A second study with ten participants served to investigate the capabilities of the framework in the context of more general scenarios. Results from these studies provided comparable accuracy to those reported in the literature for AR-based navigation procedures.

Antibiotic use and the risk of flare of inflammatory bowel disease.

Augmented reality calibration using feature triangulation iteration-based registration for surgical navigation

Semi-Automatic Infrared Calibration for Augmented Reality Systems in Surgery

Quantitative determination of the HIV protease inhibitor atazanavir (BMS-232632) in human plasma by liquid chromatography-tandem mass spectrometry following automated solid-phase extraction.

Cognitive rehearsal in the treatment of obesity: a comparison against cue avoidance and social pressure.

Moving-Tolerant Augmented Reality Surgical Navigation System Using Autostereoscopic Three-Dimensional Image Overlay

Visualization, Registration and Tracking Techniques for Augmented Reality Guided Surgery: a Review

Identifying sources of nitrogen to Hanalei Bay, Kauai, utilizing the nitrogen isotope signature of macroalgae.

Real-Time Computer-Generated Integral Imaging and 3d Image Calibration for Augmented Reality Surgical Navigation

An Accurate 3D Augmented Reality Navigation System with Enhanced Autostereoscopic Display for Oral and Maxillofacial Surgery

A practical marker-less image registration method for augmented reality oral and maxillofacial surgery

Unified Calibration Technique for Augmented-Reality Ultrasound-Guided Interventions

Automatic Fast-Registration Surgical Navigation System Using Depth Camera and Integral Videography 3D Image Overlay

Calibration of RGBD camera and cone-beam CT for 3D intra-operative mixed reality visualization

Augmented Reality Surgical Navigation System Integrated with Deep Learning

Research on Stereo 3D Display for Augmented Reality Surgical Navigation

A Visual-Inertial Fusion Based Tracking System For Mobile Augmented Reality

Augmented-Reality Surgical Navigation System for Better Healthcare Visualization

Spreading messages

Augmented Reality Navigation for Minimally Invasive Knee Surgery Using Enhanced Arthroscopy.

STTAR: Surgical Tool Tracking Using Off-the-Shelf Augmented Reality Head-Mounted Displays