A novel hybrid technology for remediation of molasses-based raw effluents.

A. Verma,C. Raghukumar,C. G. Naik

DOI: https://doi.org/10.1016/j.biortech.2010.10.112

IF: 11.4

2011-02-01

Bioresource Technology

Abstract:

What problem does this paper attempt to address?

Augmented reality in the operating room: a clinical feasibility study

Cyrill Dennler,David E. Bauer,Anne-Gita Scheibler,José Spirig,Tobias Götschi,Philipp Fürnstahl,Mazda Farshad

DOI: https://doi.org/10.1186/s12891-021-04339-w

IF: 2.562

2021-05-18

BMC Musculoskeletal Disorders

Abstract:Abstract Background Augmented Reality (AR) is a rapidly emerging technology finding growing acceptance and application in different fields of surgery. Various studies have been performed evaluating the precision and accuracy of AR guided navigation. This study investigates the feasibility of a commercially available AR head mounted device during orthopedic surgery. Methods Thirteen orthopedic surgeons from a Swiss university clinic performed 25 orthopedic surgical procedures wearing a holographic AR headset (HoloLens, Microsoft, Redmond, WA, USA) providing complementary three-dimensional, patient specific anatomic information. The surgeon’s experience of using the device during surgery was recorded using a standardized 58-item questionnaire grading different aspects on a 100-point scale with anchor statements. Results Surgeons were generally satisfied with image quality (85 ± 17 points) and accuracy of the virtual objects (84 ± 19 point). Wearing the AR device was rated as fairly comfortable (79 ± 13 points). Functionality of voice commands (68 ± 20 points) and gestures (66 ± 20 points) provided less favorable results. The greatest potential in the use of the AR device was found for surgical correction of deformities (87 ± 15 points). Overall, surgeons were satisfied with the application of this novel technology (78 ± 20 points) and future access to it was demanded (75 ± 22 points). Conclusion AR is a rapidly evolving technology with large potential in different surgical settings, offering the opportunity to provide a compact, low cost alternative requiring a minimum of infrastructure compared to conventional navigation systems. While surgeons where generally satisfied with image quality of the here tested head mounted AR device, some technical and ergonomic shortcomings were pointed out. This study serves as a proof of concept for the use of an AR head mounted device in a real-world sterile setting in orthopedic surgery.

orthopedics,rheumatology
Virtual Loupes: A Pilot Study on the Use of Video Passthrough Augmented Reality in Plastic Surgery

Waylon Zeng,Cory Ilo,Douglas Bowman,James Thompson

DOI: https://doi.org/10.1177/15533506241265544

2024-07-26

Abstract:Background: Plastic surgeons use loupes or operative microscope to aid in tissue dissection and anastomosis of structures. These devices have their own limitations in areas of visualization and weight. Current uses of augmented and virtual reality in surgery have been limited to operative planning and simulation. We present a proof of concept that harnesses video passthrough AR technology to augment the capabilities of loupes. Methods: We first evaluated methods of gaze-based eye tracking to enable digital magnification. Using the Varjo XR-1 mixed reality headset, we compared discrete zoom through displayed pop-up menu vs continuous zoom through eye winking. Six participants were recruited to perform skin suturing simulation and completed a survey and interview. Next we assessed the performance and limitations of AR digital magnification. Varjo XR-3 was utilized to address the hardware limitations. Participants performed anastomotic suturing tasks with progressively finer suture, then completed a survey and interview. Findings: There was no strong preference between zoom methods, although participants felt the discrete zoom was easier to use. Participants had difficulty determining depth and visualizing the suture due to limitations of digital magnification. Using Wilcoxon rank sum test to examine differences in system usability scale, the Phase 2 user experience had significant difference in percentile distribution (P 0.0390). Conclusion: Virtual loupes may be a valuable tool for plastic surgeons, with potential for variable magnification and advanced visualization. Improvements in the hardware yielded higher ratings of system usability and user experience. Further development is needed to address the limitations of existing devices.
979 Enhancing Surgical Training Through Augmented Reality: A Pilot Study on the Use of the Microsoft HoloLens for Live-Streaming from Theatre

R D Patel,S Patrick,G Hanibal,R Murphy Lonergan,A Naparus,B Bartholomew

DOI: https://doi.org/10.1093/bjs/znae163.643

2024-07-01

Abstract:Abstract Aim Reduced theatre exposure for trainees and students is increasingly detrimental to the surgical workforce. One potential solution is live-streaming from the operating theatre - the Microsoft HoloLens, a mixed-reality headset, facilitates immersive two-way audio and video stream from the perspective of the surgeon. This pilot explores the use of the HoloLens to facilitate trainees’ operative exposure. Method Patient operation (BCC removal with rotational flap) was live streamed to an audience of trainees using the HoloLens device and platform Remote Assist. This activity was incorporated into an existing course on plastic surgery aimed at postgraduates. Written consent was gained and later verified from the patient, to live-stream the procedure for educational purposes. Recording was prohibited. Evaluation of the experience was obtained from the surgeon and observers (n=8) via a post-procedure focus group and anonymous written feedback. Qualitative analysis of feedback was performed by OpenAI GPT. Results Observers cited that learning was facilitated by excellent image and audio quality, close communication with the surgeon and improved visibility of the procedure from the operator’s perspective. They also referenced interactive audience discussion and increased comfort as benefits over scrubbed theatre time. Learning was disrupted by technical delays and hardware unreliability. The device also blighted the surgeon’s visual field, comfort, and initial confidence in theatre. Conclusions Overall, we demonstrate the value of the HoloLens in increasing surgical exposure, with myriad of observer perceived benefits, likely at the surgeon’s expense.
From microscope to head-mounted display: integrating hand tracking into microsurgical augmented reality

El Chemaly, Trishia,Athayde Neves, Caio,Fu, Fanrui,Hargreaves, Brian,Blevins, Nikolas H.

DOI: https://doi.org/10.1007/s11548-024-03224-w

2024-08-21

International Journal of Computer Assisted Radiology and Surgery

Abstract:The operating microscope plays a central role in middle and inner ear procedures that involve working within tightly confined spaces under limited exposure. Augmented reality (AR) may improve surgical guidance by combining preoperative computed tomography (CT) imaging that can provide precise anatomical information, with intraoperative microscope video feed. With current technology, the operator must manually interact with the AR interface using a computer. The latter poses a disruption in the surgical flow and is suboptimal for maintaining the sterility of the operating environment. The purpose of this study was to implement and evaluate free-hand interaction concepts leveraging hand tracking and gesture recognition as an attempt to reduce the disruption during surgery and improve human-computer interaction.

engineering, biomedical,radiology, nuclear medicine & medical imaging,surgery
[Therapy of hyperuricemia in gout; physiological principles].

J. Frézal

Abstract:
Intraoperative Augmented Reality in Microsurgery for Intracranial Arteriovenous Malformation: A Case Report and Literature Review

Chi-Ruei Li,Chiung-Chyi Shen,Meng-Yin Yang,Yuang-Seng Tsuei,Chung-Hsin Lee

DOI: https://doi.org/10.3390/brainsci13040653

2023-04-13

Abstract:Background: Intracranial arteriovenous malformations (AVMs) are lesions containing complex vessels with a lack of buffering capillary architecture which might result in hemorrhagic cerebrovascular accidents (CVAs). Intraoperative navigation can improve resection rates and functional preservation in patients with lesions in eloquent areas, but current systems have limitations that can distract the operator. Augmented Reality (AR) surgical technology can reduce these distractions and provide real-time information regarding vascular morphology and location. Methods: In this case report, an adult patient was admitted to the emergency department after a fall, and diagnostic imaging revealed a Spetzler-Martin grade I AVM in the right parietal region with evidence of rupture. The patient underwent a stereotactic microsurgical resection with assistance from augmented reality technology, which allowed for a hologram of the angioarchitecture to be projected onto the cortical surface, aiding in the recognition of the angiographic anatomy during surgery. Results: The patient's postoperative recovery went smoothly. At 6-month follow-up, the patient had remained in stable condition, experiencing complete relief from his previous symptoms. The follow-up examination also revealed complete obliteration of the AVMs without any remaining pathological vascular structure. Conclusions: AR-assisted microsurgery makes both the dissection and resection steps safer and more delicate. As several innovations are occurring in AR technology today, it is likely that this novel technique will be increasingly adopted in both surgical applications and education. Although certain limitations exist, this technique may still become more efficient and precise as this novel technology its continues to develop further.
Surgical Training Using Augmented Reality-Based Optical Head-Mounted Displays: A Pilot Study

Seon Min Jung,Chang Myeon Song,Kyung Tae,Byung Ju Yi,Yong Bae Ji

DOI: https://doi.org/10.1177/01455613241226831

2024-02-13

Ear Nose & Throat Journal

Abstract:Ear, Nose &Throat Journal, Ahead of Print. While the educational benefits of the modern techniques such as virtual reality (VR) or augmented reality (AR) have been suggested, there is still a lack of reports on actual surgeons' experiences. In this study, we evaluated the effectiveness of a holographic AR-based surgical training in tonsillectomy. Two otolaryngologists, 1 trainee and 1 instructor, performed 5 tonsillectomies using an AR headset (HoloLens 2, Microsoft, USA). The trainee wore the AR headset to share the surgical view through front camera while the instructor remotely accessed the device using the Microsoft Teams program and provided real-time guidance. The AR-based surgical training offered several advantages, including direct real-time guidance for the trainee and clear instructions without disturbing the surgical process. However, there were also drawbacks, such as the front camera not always matching the trainee's view and some difficulty with focusing, depending on the depth of the oral cavity. Our study suggests that AR devices are a feasible and alternative method for surgical training. With the ability to provide clear guidance, even from a distance, this technology has the potential to revolutionize surgical training in the future.

otorhinolaryngology
More than meets the eye: Augmented reality in surgical oncology

Kavita Prasad,Carly Fassler,Alexis Miller,Marina Aweeda,Sumit Pruthi,Joseph C. Fusco,Bruce Daniel,Michael Miga,Jie Ying Wu,Michael C. Topf

DOI: https://doi.org/10.1002/jso.27790

2024-08-22

Journal of Surgical Oncology

Abstract:Background and Objectives In the field of surgical oncology, there has been a desire for innovative techniques to improve tumor visualization, resection, and patient outcomes. Augmented reality (AR) technology superimposes digital content onto the real‐world environment, enhancing the user's experience by blending digital and physical elements. A thorough examination of AR technology in surgical oncology has yet to be performed. Methods A scoping review of intraoperative AR in surgical oncology was conducted according to the guidelines and recommendations of The Preferred Reporting Items for Systematic Review and Meta‐analyzes Extension for Scoping Reviews (PRISMA‐ScR) framework. All original articles examining the use of intraoperative AR during surgical management of cancer were included. Exclusion criteria included virtual reality applications only, preoperative use only, fluorescence, AR not specific to surgical oncology, and study design (reviews, commentaries, abstracts). Results A total of 2735 articles were identified of which 83 were included. Most studies (52) were performed on animals or phantom models, while the remaining included patients. A total of 1112 intraoperative AR surgical cases were performed across the studies. The most common anatomic site was brain (20 articles), followed by liver (16), renal (9), and head and neck (8). AR was most often used for intraoperative navigation or anatomic visualization of tumors or critical structures but was also used to identify osteotomy or craniotomy planes. Conclusions AR technology has been applied across the field of surgical oncology to aid in localization and resection of tumors.

oncology,surgery
Feasibility of using a low-cost head-mounted augmented reality device in the operating room

Pieter L Kubben,Remir S N Sinlae

DOI: https://doi.org/10.4103/sni.sni_228_18

2019-02-28

Abstract:Background: Augmented reality (AR) has great potential for improving image-guided neurosurgical procedures, but until recently, hardware was mostly custom-made and difficult to distribute. Currently, commercially available low-cost AR devices offer great potential for neurosurgery, but reports on technical feasibility are lacking. The goal of this pilot study is to evaluate the feasibility of using a low-cost commercially available head-mounted holographic AR device (the Microsoft Hololens) in the operating room. The Hololens is operated by performing specific hand gestures, which are recognized by the built-in camera of the device. This would allow the neurosurgeon to control the device "touch free" even while wearing a sterile surgical outfit. Methods: The Hololens was tested in an operating room under two lighting conditions (general background theatre lighting only; and general background theatre lighting and operating lights) and wearing different surgical gloves (both bright and dark). All required hand gestures were performed, and voice recognition was evaluated against background noise consisting of two nurses talking at conversational speech level. Results: Wearing comfort was sufficient, with and without regular glasses. All gestures were correctly classified regardless of lighting conditions or the sort of sterile gloves. Voice recognition was good. The visibility of the holograms was good if the device was configured to use high brightness for display. Conclusions: We demonstrate that using a commercially available low-cost head-mounted holographic AR device is feasible in a sterile surgical setting, under different lighting conditions and using different surgical gloves. Given the availability of freely available software for application development, neurosurgery can benefit from new opportunities for image-guided surgery.
Leveraging the Apple Ecosystem: Easy Viewing and Sharing of Three-dimensional Perforator Visualizations via iPad/iPhone-based Augmented Reality

Fabian N Necker,David J Cholok,Mohammed S Shaheen,Marc J Fischer,Kyle Gifford,Trishia El Chemaly,Christoph W Leuze,Michael Scholz,Bruce L Daniel,Arash Momeni

DOI: https://doi.org/10.1097/GOX.0000000000005940

2024-07-01

Abstract:We introduce a novel technique using augmented reality (AR) on smartphones and tablets, making it possible for surgeons to review perforator anatomy in three dimensions on the go. Autologous breast reconstruction with abdominal flaps remains challenging due to the highly variable anatomy of the deep inferior epigastric artery. Computed tomography angiography has mitigated some but not all challenges. Previously, volume rendering and different headsets were used to enable better three-dimensional (3D) review for surgeons. However, surgeons have been dependent on others to provide 3D imaging data. Leveraging the ubiquity of Apple devices, our approach permits surgeons to review 3D models of deep inferior epigastric artery anatomy segmented from abdominal computed tomography angiography directly on their iPhone/iPad. Segmentation can be performed in common radiology software. The models are converted to the universal scene description zipped format, which allows immediate use on Apple devices without third-party software. They can be easily shared using secure, Health Insurance Portability and Accountability Act-compliant sharing services already provided by most hospitals. Surgeons can simply open the file on their mobile device to explore the images in 3D using "object mode" natively without additional applications or can switch to AR mode to pin the model in their real-world surroundings for intuitive exploration. We believe patient-specific 3D anatomy models are a powerful tool for intuitive understanding and communication of complex perforator anatomy and would be a valuable addition in routine clinical practice and education. Using this one-click solution on existing devices that is simple to implement, we hope to streamline the adoption of AR models by plastic surgeons.
Augmented Reality (AR) for Surgical Robotic and Autonomous Systems: State of the Art, Challenges, and Solutions

Jenna Seetohul,Mahmood Shafiee,Konstantinos Sirlantzis

DOI: https://doi.org/10.3390/s23136202

IF: 3.9

2023-07-07

Sensors

Abstract:Despite the substantial progress achieved in the development and integration of augmented reality (AR) in surgical robotic and autonomous systems (RAS), the center of focus in most devices remains on improving end-effector dexterity and precision, as well as improved access to minimally invasive surgeries. This paper aims to provide a systematic review of different types of state-of-the-art surgical robotic platforms while identifying areas for technological improvement. We associate specific control features, such as haptic feedback, sensory stimuli, and human–robot collaboration, with AR technology to perform complex surgical interventions for increased user perception of the augmented world. Current researchers in the field have, for long, faced innumerable issues with low accuracy in tool placement around complex trajectories, pose estimation, and difficulty in depth perception during two-dimensional medical imaging. A number of robots described in this review, such as Novarad and SpineAssist, are analyzed in terms of their hardware features, computer vision systems (such as deep learning algorithms), and the clinical relevance of the literature. We attempt to outline the shortcomings in current optimization algorithms for surgical robots (such as YOLO and LTSM) whilst providing mitigating solutions to internal tool-to-organ collision detection and image reconstruction. The accuracy of results in robot end-effector collisions and reduced occlusion remain promising within the scope of our research, validating the propositions made for the surgical clearance of ever-expanding AR technology in the future.

engineering, electrical & electronic,chemistry, analytical,instruments & instrumentation
An augmented reality and high-speed optical tracking system for laparoscopic surgery

Nati Nawawithan,Jeff Young,Patric Bettati,Armand P Rathgeb,Kelden T Pruitt,Jordan Frimpter,Henry Kim,Jonathan Yu,Davis Driver,Amanuel Shiferaw,Aditi Chaudhari,Brett A Johnson,Jeffrey Gahan,James Yu,Baowei Fei

DOI: https://doi.org/10.1117/12.3008448

Abstract:While minimally invasive laparoscopic surgery can help reduce blood loss, reduce hospital time, and shorten recovery time compared to open surgery, it has the disadvantages of limited field of view and difficulty in locating subsurface targets. Our proposed solution applies an augmented reality (AR) system to overlay pre-operative images, such as those from magnetic resonance imaging (MRI), onto the target organ in the user's real-world environment. Our system can provide critical information regarding the location of subsurface lesions to guide surgical procedures in real time. An infrared motion tracking camera system was employed to obtain real-time position data of the patient and surgical instruments. To perform hologram registration, fiducial markers were used to track and map virtual coordinates to the real world. In this study, phantom models of each organ were constructed to test the reliability and accuracy of the AR-guided laparoscopic system. Root mean square error (RMSE) was used to evaluate the targeting accuracy of the laparoscopic interventional procedure. Our results demonstrated a registration error of 2.42 ± 0.79 mm and a procedural targeting error of 4.17 ± 1.63 mm using our AR-guided laparoscopic system that will be further refined for potential clinical procedures.
A City Naturalist's Musings

R. Fitter

DOI: https://doi.org/10.1038/175654a0

IF: 64.8

Nature

Abstract:
Exploring the potential role for extended reality in Mohs micrographic surgery

Anika Pulumati,Yanci A. Algarin,Dana Jaalouk,Melanie Hirsch,Keyvan Nouri

DOI: https://doi.org/10.1007/s00403-023-02804-1

2024-01-10

Archives of Dermatological Research

Abstract:Mohs micrographic surgery (MMS) is a cornerstone of dermatological practice. Virtual reality (VR) and augmented reality (AR) technology, initially used for entertainment, have entered healthcare, offering real-time data overlaying a surgeon's view. This paper explores potential applications of VR and AR in MMS, emphasizing their advantages and limitations. We aim to identify research gaps to facilitate innovation in dermatological surgery. We conducted a PubMed search using the following: "augmented reality" OR "virtual reality" AND "Mohs" or "augmented reality" OR "virtual reality" AND "surgery." Inclusion criteria were peer-reviewed articles in English discussing these technologies in medical settings. We excluded non-peer-reviewed sources, non-English articles, and those not addressing these technologies in a medical context. VR alleviates patient anxiety and enhances patient satisfaction while serving as an educational tool. It also aids physicians by providing realistic surgical simulations. On the other hand, AR assists in real-time lesion analysis, optimizing incision planning, and refining margin control during surgery. Both of these technologies offer remote guidance for trainee residents, enabling real-time learning and oversight and facilitating synchronous teleconsultations. These technologies may transform dermatologic surgery, making it more accessible and efficient. However, further research is needed to validate their effectiveness, address potential challenges, and optimize seamless integration. All in all, AR and VR enhance real-world environments with digital data, offering real-time surgical guidance and medical insights. By exploring the potential integration of these technologies in MMS, our study identifies avenues for further research to thoroughly understand the role of these technologies to redefine dermatologic surgery, elevating precision, surgical outcomes, and patient experiences.

dermatology
Complex Craniofacial Cases through Augmented Reality Guidance in Surgical Oncology: A Technical Report

Alessandro Tel,Luca Raccampo,Shankeeth Vinayahalingam,Stefania Troise,Vincenzo Abbate,Giovanni Dell’Aversana Orabona,Salvatore Sembronio,Massimo Robiony

DOI: https://doi.org/10.3390/diagnostics14111108

IF: 3.6

2024-05-28

Diagnostics

Abstract:Augmented reality (AR) is a promising technology to enhance image guided surgery and represents the perfect bridge to combine precise virtual planning with computer-aided execution of surgical maneuvers in the operating room. In craniofacial surgical oncology, AR brings to the surgeon's sight a digital, three-dimensional representation of the anatomy and helps to identify tumor boundaries and optimal surgical paths. Intraoperatively, real-time AR guidance provides surgeons with accurate spatial information, ensuring accurate tumor resection and preservation of critical structures. In this paper, the authors review current evidence of AR applications in craniofacial surgery, focusing on real surgical applications, and compare existing literature with their experience during an AR and navigation guided craniofacial resection, to subsequently analyze which technological trajectories will represent the future of AR and define new perspectives of application for this revolutionizing technology.

medicine, general & internal
Telestration with augmented reality for visual presentation of intraoperative target structures in minimally invasive surgery: a randomized controlled study

C Wild,F Lang,A S Gerhäuser,M W Schmidt,K F Kowalewski,J Petersen,H G Kenngott,B P Müller-Stich,F Nickel

DOI: https://doi.org/10.1007/s00464-022-09158-1

Abstract:Aims: In minimally invasive surgery (MIS), intraoperative guidance has been limited to verbal communication without direct visual guidance. Communication issues and mistaken instructions in training procedures can hinder correct identification of anatomical structures on the MIS screen. The iSurgeon system was developed to provide visual guidance in the operating room by telestration with augmented reality (AR). Methods: Laparoscopic novices (n = 60) were randomized in two groups in a cross-over design: group 1 trained only with verbal guidance first and then with additional telestration with AR on the operative screen and vice versa for group 2. Training consisted of laparoscopic basic training and subsequently a specifically designed training course, including a porcine laparoscopic cholecystectomy (LC). Outcome included time needed for training, performance with Global Operative Assessment of Laparoscopic Skills (GOALS), and Objective Structured Assessment of Technical Skills (OSATS) score for LC, complications, and subjective workload (NASA-TLX questionnaire). Results: Telestration with AR led to significantly faster total training time (1163 ± 275 vs. 1658 ± 375 s, p < 0.001) and reduced error rates. LC on a porcine liver was performed significantly better (GOALS 21 ± 5 vs. 18 ± 4, p < 0.007 and OSATS 67 ± 11 vs. 61 ± 8, p < 0.015) and with less complications (13.3% vs. 40%, p < 0.020) with AR. Subjective workload and stress were significantly reduced during training with AR (33.6 ± 12.0 vs. 30.6 ± 12.9, p < 0.022). Conclusion: Telestration with AR improves training success and safety in MIS. The next step will be the clinical application of telestration with AR and the development of a mobile version for remote guidance.
Spreading messages

Ching-Lueh Chang,Y. Lyuu

DOI: https://doi.org/10.1016/j.tcs.2009.03.032

IF: 1.002

2008-06-27

Theoretical Computer Science

Abstract:
Real-time Geometry-Aware Augmented Reality in Minimally Invasive Surgery

Long Chen,Wen Tang,Nigel W. John

DOI: https://doi.org/10.48550/arXiv.1708.01234

2017-08-04

Abstract:The potential of Augmented Reality (AR) technology to assist minimally invasive surgeries (MIS) lies in its computational performance and accuracy in dealing with challenging MIS scenes. Even with the latest hardware and software technologies, achieving both real-time and accurate augmented information overlay in MIS is still a formidable task. In this paper, we present a novel real-time AR framework for MIS that achieves interactive geometric aware augmented reality in endoscopic surgery with stereo views. Our framework tracks the movement of the endoscopic camera and simultaneously reconstructs a dense geometric mesh of the MIS scene. The movement of the camera is predicted by minimising the re-projection error to achieve a fast tracking performance, while the 3D mesh is incrementally built by a dense zero mean normalised cross correlation stereo matching method to improve the accuracy of the surface reconstruction. Our proposed system does not require any prior template or pre-operative scan and can infer the geometric information intra-operatively in real-time. With the geometric information available, our proposed AR framework is able to interactively add annotations, localisation of tumours and vessels, and measurement labelling with greater precision and accuracy compared with the state of the art approaches.

Computer Vision and Pattern Recognition
Workflow assessment of an augmented reality application for planning of perforator flaps in plastic reconstructive surgery: Game or game changer?

Matthias Fabian Berger,Raimund Winter,Alexandru-Cristian Tuca,Birgit Michelitsch,Bernhard Schenkenfelder,Robert Hartmann,Michael Giretzlehner,Gernot Reishofer,Lars-Peter Kamolz,David Benjamin Lumenta

DOI: https://doi.org/10.1177/20552076231173554

2023-01-01

Digital Health

Abstract:Objective In contrast to the rising amount of financial investments for research and development in medical technology worldwide is the lack of usability and clinical readiness of the produced systems. We evaluated an augmented reality (AR) setup under development for preoperative perforator vessel mapping for elective autologous breast reconstruction. Methods In this grant-supported research pilot, we used magnetic resonance angiography data (MR-A) of the trunk to superimpose the scans on the corresponding patients with hands-free AR goggles to identify regions-of-interest for surgical planning. Perforator location was assessed using MR-A imaging (MR-A projection) and Doppler ultrasound data (3D distance) and confirmed intraoperatively in all cases. We evaluated usability (System Usability Scale, SUS), data transfer load and documented personnel hours for software development, correlation of image data, as well as processing duration to clinical readiness (time from MR-A to AR projections per scan). Results All perforator locations were confirmed intraoperatively, and we found a strong correlation between MR-A projection and 3D distance measurements (Spearman r = 0.894). The overall usability (SUS) was 67 ± 10 (=moderate to good). The presented setup for AR projections took 173 min to clinical readiness (=availability on AR device per patient). Conclusion In this pilot, we calculated development investments based on project-approved grant-funded personnel hours with a moderate to good usability outcome resulting from some limitations: assessment was based on one-time testing with no previous training, a time lag of AR visualizations on the body and difficulties in spatial AR orientation. The use of AR systems can provide new opportunities for future surgical planning, but has more potential for educational (e.g., patient information) or training purposes of medical under- and postgraduates (spatial recognition of imaging data associated with anatomical structures and operative planning). We expect future usability improvements with refined user interfaces, faster AR hardware and artificial intelligence-enhanced visualization techniques.

public, environmental & occupational health,health care sciences & services,medical informatics,health policy & services
The Reconstructive Metaverse – Collaboration in Real-Time Shared Mixed Reality Environments for Microsurgical Reconstruction

Fabian N. Necker,David J. Cholok,Mohammed S. Shaheen,Marc J. Fischer,Kyle Gifford,Trishia El Chemaly,Christoph W. Leuze,Michael Scholz,Bruce L. Daniel,Arash Momeni

DOI: https://doi.org/10.1177/15533506241262946

2024-06-22

Surgical Innovation

Abstract:Surgical Innovation, Ahead of Print. Plastic surgeons routinely use 3D-models in their clinical practice, from 3D-photography and surface imaging to 3D-segmentations from radiological scans. However, these models continue to be viewed on flattened 2D screens that do not enable an intuitive understanding of 3D-relationships and cause challenges regarding collaboration with colleagues. The Metaverse has been proposed as a new age of applications building on modern Mixed Reality headset technology that allows remote collaboration on virtual 3D-models in a shared physical-virtual space in real-time. We demonstrate the first use of the Metaverse in the context of reconstructive surgery, focusing on preoperative planning discussions and trainee education. Using a HoloLens headset with the Microsoft Mesh application, we performed planning sessions for 4 DIEP-flaps in our reconstructive metaverse on virtual patient-models segmented from routine CT angiography. In these sessions, surgeons discuss perforator anatomy and perforator selection strategies whilst comprehensively assessing the respective models. We demonstrate the workflow for a one-on-one interaction between an attending surgeon and a trainee in a video featuring both viewpoints as seen through the headset. We believe the Metaverse will provide novel opportunities to use the 3D-models that are already created in everyday plastic surgery practice in a more collaborative, immersive, accessible, and educational manner.

surgery

A novel hybrid technology for remediation of molasses-based raw effluents.

Augmented reality in the operating room: a clinical feasibility study

Virtual Loupes: A Pilot Study on the Use of Video Passthrough Augmented Reality in Plastic Surgery

979 Enhancing Surgical Training Through Augmented Reality: A Pilot Study on the Use of the Microsoft HoloLens for Live-Streaming from Theatre

From microscope to head-mounted display: integrating hand tracking into microsurgical augmented reality

[Therapy of hyperuricemia in gout; physiological principles].

Intraoperative Augmented Reality in Microsurgery for Intracranial Arteriovenous Malformation: A Case Report and Literature Review

Surgical Training Using Augmented Reality-Based Optical Head-Mounted Displays: A Pilot Study

More than meets the eye: Augmented reality in surgical oncology

Feasibility of using a low-cost head-mounted augmented reality device in the operating room

Leveraging the Apple Ecosystem: Easy Viewing and Sharing of Three-dimensional Perforator Visualizations via iPad/iPhone-based Augmented Reality

Augmented Reality (AR) for Surgical Robotic and Autonomous Systems: State of the Art, Challenges, and Solutions

An augmented reality and high-speed optical tracking system for laparoscopic surgery

A City Naturalist's Musings

Exploring the potential role for extended reality in Mohs micrographic surgery

Complex Craniofacial Cases through Augmented Reality Guidance in Surgical Oncology: A Technical Report

Telestration with augmented reality for visual presentation of intraoperative target structures in minimally invasive surgery: a randomized controlled study

Spreading messages

Real-time Geometry-Aware Augmented Reality in Minimally Invasive Surgery

Workflow assessment of an augmented reality application for planning of perforator flaps in plastic reconstructive surgery: Game or game changer?

The Reconstructive Metaverse – Collaboration in Real-Time Shared Mixed Reality Environments for Microsurgical Reconstruction