Magnetic Resonance Imaging and Diffusion-Weighted Imaging in Categorization of Uterine Sarcoma : Correlation with Pathological Findings

Guofu Zhang,He Zhang,X. Tian

Abstract:

What problem does this paper attempt to address?

Multispecialty Enterprise Imaging Workgroup Consensus on Interactive Multimedia Reporting Current State and Road to the Future: HIMSS-SIIM Collaborative White Paper

Christopher J. Roth,David A. Clunie,David J. Vining,Seth J. Berkowitz,Alejandro Berlin,Jean-Pierre Bissonnette,Shawn D. Clark,Toby C. Cornish,Monief Eid,Cree M. Gaskin,Alexander K. Goel,Genevieve C. Jacobs,David Kwan,Damien M. Luviano,Morgan P. McBee,Kelly Miller,Abdul Moiz Hafiz,Ceferino Obcemea,Anil V. Parwani,Veronica Rotemberg,Elliot L. Silver,Erik S. Storm,James E. Tcheng,Karen S. Thullner,Les R. Folio

DOI: https://doi.org/10.1007/s10278-021-00450-5

IF: 4.903

2021-06-15

Journal of Digital Imaging

Abstract:Abstract Diagnostic and evidential static image, video clip, and sound multimedia are captured during routine clinical care in cardiology, dermatology, ophthalmology, pathology, physiatry, radiation oncology, radiology, endoscopic procedural specialties, and other medical disciplines. Providers typically describe the multimedia findings in contemporaneous electronic health record clinical notes or associate a textual interpretative report. Visual communication aids commonly used to connect, synthesize, and supplement multimedia and descriptive text outside medicine remain technically challenging to integrate into patient care. Such beneficial interactive elements may include hyperlinks between text, multimedia elements, alphanumeric and geometric annotations, tables, graphs, timelines, diagrams, anatomic maps, and hyperlinks to external educational references that patients or provider consumers may find valuable. This HIMSS-SIIM Enterprise Imaging Community workgroup white paper outlines the current and desired clinical future state of interactive multimedia reporting (IMR). The workgroup adopted a consensus definition of IMR as “interactive medical documentation that combines clinical images, videos, sound, imaging metadata, and/or image annotations with text, typographic emphases, tables, graphs, event timelines, anatomic maps, hyperlinks, and/or educational resources to optimize communication between medical professionals, and between medical professionals and their patients.” This white paper also serves as a precursor for future efforts toward solving technical issues impeding routine interactive multimedia report creation and ingestion into electronic health records.

radiology, nuclear medicine & medical imaging
A patient-centric distribution architecture for medical image sharing

Liviu Constantinescu,Jinman Kim,Ashnil Kumar,Daiki Haraguchi,Lingfeng Wen,Dagan Feng

DOI: https://doi.org/10.1186/2047-2501-1-3

2013-01-10

Abstract:Over the past decade, rapid development of imaging technologies has resulted in the introduction of improved imaging devices, such as multi-modality scanners that produce combined positron emission tomography-computed tomography (PET-CT) images. The adoption of picture archiving and communication systems (PACS) in hospitals have dramatically improved the ability to digitally share medical image studies via portable storage, mobile devices and the Internet. This has in turn led to increased productivity, greater flexibility, and improved communication between hospital staff, referring physicians, and outpatients. However, many of these sharing and viewing capabilities are limited to proprietary vendor-specific applications. Furthermore, there are still interoperability and deployment issues which reduce the rate of adoption of such technologies, thus leaving many stakeholders, particularly outpatients and referring physicians, with access to only traditional still images with no ability to view or interpret the data in full. In this paper, we present a distribution architecture for medical image display across numerous devices and media, which uses a preprocessor and an in-built networking framework to improve compatibility and promote greater accessibility of medical data. Our INVOLVE2 system consists of three main software modules: 1) a preprocessor, which collates and converts imaging studies into a compressed and distributable format; 2) a PACS-compatible workflow for self-managing distribution of medical data, e.g. via CD USB, network etc; 3) support for potential mobile and web-based data access. The focus of this study was on cultivating patient-centric care, by allowing outpatient users to comfortably access and interpret their own data. As such, the image viewing software included on our cross-platform CDs was designed with a simple and intuitive user-interface (UI) for use by outpatients and referring physicians. Furthermore, digital image access via mobile devices or web-based access enables users to engage with their data in a convenient and user-friendly way. We evaluated the INVOLVE2 system using a pilot deployment in a hospital environment.
Thermodynamic efficiency in nonlinear biochemical reactions.

J. Ross,M. Schell

DOI: https://doi.org/10.1146/ANNUREV.BB.16.060187.002153

Annual Review of Biophysics and Biophysical Chemistry

Abstract:PERSPECTIVES AND OVERVIEW •••.....•••.....•.• 401 Dissipation in Chemical Reactions . . ... ... 402 EFFICIENCY OF THE UTILIZATION OF ATP: PROTON PUMPS 404 Model of a Proton Pump 405 Response of the Steady-State Mode to a Single Impulse Perturbation. . . . . . . . ..... . . . . . . . . . . 408 Comparison of Efficiency in the Steady-State Mode and in the Oscillatory Mode ..... 409
Design of a robot-assisted system for transforaminal percutaneous endoscopic lumbar surgeries: study protocol

Ning Fan,Shuo Yuan,Peng Du,Wenyi Zhu,Liang Li,Yong Hai,Hui Ding,Guangzhi Wang,Lei Zang

DOI: https://doi.org/10.1186/s13018-020-02003-y

IF: 2.6

2020-01-01

Journal of Orthopaedic Surgery and Research

Abstract:Background Transforaminal percutaneous endoscopic lumbar surgeries (PELS) for lumbar disc herniation and spinal stenosis are growing in popularity. However, there are some problems in the establishment of the working channel and foraminoplasty such as nerve and blood vessel injuries, more radiation exposure, and steeper learning curve. Rapid technological advancements have allowed robotic technology to assist surgeons in improving the accuracy and safety of surgeries. Therefore, the purpose of this study is to develop a robot-assisted system for transforaminal PELS, which can provide navigation and foraminoplasty. Methods The robot-assisted system consists of three systems: preoperative planning system, navigation system, and foraminoplasty system. In the preoperative planning system, 3D visualization of the surgical segment and surrounding tissues are realized using the multimodal image fusion technique of computed tomography and magnetic resonance imaging, and the working channel planning is carried out to reduce the risk for injury to vital blood vessels and nerves. In the navigation system, the robot can obtain visual perception ability from a visual receptor and automatically adjust the robotic platform and robot arm to the appropriate positions according to the patient’s position and preoperative plan. In addition, the robot can automatically register the surgical levels through intraoperative fluoroscopy. After that, the robot will provide navigation using the 6 degree-of-freedom (DOF) robot arm according to the preoperative planning system and guide the surgeon to complete the establishment of the working channel. In the foraminoplasty system, according to the foraminoplasty planning in the preoperative planning system, the robot performs foraminoplasty automatically using the high speed burr at the end of the robot arm. The system can provide real-time feedback on the working status of the bur through multi-mode sensors such as multidimensional force, position, and acceleration. Finally, a prototype of the system is constructed and performance tests are conducted. Discussion Our study will develop a robot-assisted system to perform transforaminal PELS, and this robot-assisted system can also be used for other percutaneous endoscopic spinal surgeries such as interlaminar PELS and percutaneous endoscopic cervical and thoracic surgeries through further research. The development of this robot-assisted system can be of great significance. First, the robot can improve the accuracy and efficiency of endoscopic spinal surgeries. In addition, it can avoid multiple intraoperative fluoroscopies, minimize exposure to both patients and the surgical staff, shorten the operative time, and improve the learning curve of beginners, which is beneficial to the popularization of percutaneous endoscopic spinal surgeries.
A Hybrid-Layered System for Image-Guided Navigation and Robot Assisted Spine Surgery

Suhail Ansari T,Vivek Maik,Minhas Naheem,Keerthi Ram,Manojkumar Lakshmanan,Mohanasankar Sivaprakasam

DOI: https://doi.org/10.1109/SII58957.2024.10417647

2024-06-07

Abstract:In response to the growing demand for precise and affordable solutions for Image-Guided Spine Surgery (IGSS), this paper presents a comprehensive development of a Robot-Assisted and Navigation-Guided IGSS System. The endeavor involves integrating cutting-edge technologies to attain the required surgical precision and limit user radiation exposure, thereby addressing the limitations of manual surgical methods. We propose an IGSS workflow and system architecture employing a hybrid-layered approach, combining modular and integrated system architectures in distinctive layers to develop an affordable system for seamless integration, scalability, and reconfigurability. We developed and integrated the system and extensively tested it on phantoms and cadavers. The proposed system's accuracy using navigation guidance is 1.020 mm, and robot assistance is 1.11 mm on phantoms. Observing a similar performance in cadaveric validation where 84% of screw placements were grade A, 10% were grade B using navigation guidance, 90% were grade A, and 10% were grade B using robot assistance as per the Gertzbein-Robbins scale, proving its efficacy for an IGSS. The evaluated performance is adequate for an IGSS and at par with the existing systems in literature and those commercially available. The user radiation is lower than in the literature, given that the system requires only an average of 3 C-Arm images per pedicle screw placement and verification

Robotics,Systems and Control
A Hybrid-Layered System for Image-Guided Navigation and Robot Assisted Spine Surgeries

Suhail Ansari T,Vivek Maik,Minhas Naheem,Keerthi Ram,Manojkumar Lakshmanan,Mohanasankar Sivaprakasam

2024-06-07

Abstract:In response to the growing demand for precise and affordable solutions for Image-Guided Spine Surgery (IGSS), this paper presents a comprehensive development of a Robot-Assisted and Navigation-Guided IGSS System. The endeavor involves integrating cutting-edge technologies to attain the required surgical precision and limit user radiation exposure, thereby addressing the limitations of manual surgical methods. We propose an IGSS workflow and system architecture employing a hybrid-layered approach, combining modular and integrated system architectures in distinctive layers to develop an affordable system for seamless integration, scalability, and reconfigurability. We developed and integrated the system and extensively tested it on phantoms and cadavers. The proposed system's accuracy using navigation guidance is 1.02 0.34 mm, and robot assistance is 1.11 0.49 mm on phantoms. Observing a similar performance in cadaveric validation where 84% of screw placements were grade A, 10% were grade B using navigation guidance, 90% were grade A, and 10% were grade B using robot assistance as per the Gertzbein-Robbins scale, proving its efficacy for an IGSS. The evaluated performance is adequate for an IGSS and at par with the existing systems in literature and those commercially available. The user radiation is lower than in the literature, given that the system requires only an average of 3 C-Arm images per pedicle screw placement and verification.

Robotics,Image and Video Processing,Systems and Control
GUI-based Pedicle Screw Planning on Fluoroscopic Images Utilizing Vertebral Segmentation

Vivek Maik,Aparna Purayath,Durga R,Manojkumar Lakshmanan,Mohanasankar Sivaprakasm

2024-07-11

Abstract:The proposed work establishes a novel Graphical User Interface (GUI) framework, primarily designed for intraoperative pedicle screw planning. Current planning workflow in Image Guided Surgeries primarily relies on pre-operative CT planning. Intraoperative CT planning can be time-consuming and expensive and thus is not a common practice. In situations where efficiency and cost-effectiveness are paramount, planning to utilize fluoroscopic images acquired for image registration emerges as the optimal choice. The methodology proposed in this study employs a simulated 3D pedicle screw to calculate its coronal and sagittal projections for pedicle screw planning using anterior-posterior (AP) and lateral (LP) images. The initialization and placement of pedicle screw is computed by utilizing the bounding box of vertebral segmentation, which is obtained by the application of enhanced YOLOv5. The GUI front end includes functionality that allows surgeons or medical practitioners to efficiently choose, set up, and dynamically maneuver the pedicle screw on AP and LP images. This is based on a novel feature called synchronous planning, which involves correlating pedicle screws from the coronal and sagittal planes. This correlation utilizes projective correspondence to ensure that any movement of the pedicle screw in either the AP or LP image will be reflected in the other image. The proposed GUI framework is a time-efficient and cost-effective tool for synchronizing and planning the movement of pedicle screws during intraoperative surgical procedures.

Image and Video Processing,Computer Vision and Pattern Recognition
Application of KinectTM and wireless technology for patient data recording and viewing system in the course of surgery

Aira Patrice R. Ong,Nilo T. Bugtai,Luis Miguel M. Aldaba,Astrid Valeska H. Madrangca,Giselle V. Que,Miles Frederick L. Que,Kean Anderson. S. Tan

DOI: https://doi.org/10.1063/1.4976789

2017-01-01

AIP Conference Proceedings

Abstract:In modern operating room (OR) conditions, a patient’s computed tomography (CT) or magnetic resonance imaging (MRI) scans are some of the most important resources during surgical procedures. In practice, the surgeon is impelled to scrub out and back in every time he needs to scroll through scan images in mid-operation. To prevent leaving the operating table, many surgeons rely on assistants or nurses and give instructions to manipulate the computer for them, which can be cumbersome and frustrating. As a motivation for this study, the use of touchless (non-contact) gesture-based interface in medical practice is incorporated to have aseptic interactions with the computer systems and with the patient’s data. The system presented in this paper is composed of three main parts: the Trek Ai-Ball Camera, the Microsoft Kinect™, and the computer software. The incorporation of these components and the developed software allows the user to perform 13 hand gestures, which have been tested to be 100 percent accurate. Based on the results of the tests performed on the system performance, the conclusions made regarding the time efficiency of the viewing system, the quality and the safety of the recording system has gained positive feedback from consulting doctors.
Image guided interpedicular screw placement simulation system for training and skill evaluation. Proof of concept

José Rubén Huerta Osnaya,Vicente Gonzalez Carranza,Fernando Chico-Ponce de León,Fernando Perez Escamirosa,Daniel Lorias-Espinoza

DOI: https://doi.org/10.1016/j.wneu.2024.05.087

IF: 2.21

2024-05-20

World Neurosurgery

Abstract:Introduction Present work introduces SpineST-01 system, an image guided vertebrae cannulation training system. During task execution, the computer calculates performance based metrics displaying different visual perspectives (LV, AV, APV) with the position of the instrument inside it. Finally, a report with the metrics is generated as performance feedback. Methods A training box holds a 3D printed spine section. The computer works with two orthogonal disposed cameras, tracking passive markers placed on the instrument. Eight metrics were proposed to evaluate the surgical task's execution performance. A preliminary study, with 25 participants divided into three groups: 12 Novices, 10 intermediates and 3 Experts, was conducted to determine the feasibility of the system to evaluate and assess the performance differences of each group using Kruskal-Wallis analysis and U Mann-Whitney. In both, Kruskal-Wallis analysis and U Mann-Whitney, a p-value ≤0.05 was considered statistically significant. Results When comparing Experts vs Novices and the three groups, the statistical analysis showed significant differences in six of the eight metrics. (Axial angle error (°), Lateral angle error (°), Average Speed ( mm/s ), Progress between shots ( mm ), Time (s), Shots) The metrics that did not show any statistically significant difference were time between shots (s), and speed between shots (mm/s). As well the average result comparison placed the Experts as the best performance group. Conclusion On the SpineST-01 presentation, initial testing demonstrated potential for the system to practice image guided cannulation task on lumbar vertebrae. Results show objective differences between Experts, Intermediates, and Novices on the proposed metrics. Making this system a feasible option for developing basic navigation system skills, without the risk of radiation exposure and objectively evaluate task performance.

surgery,clinical neurology
Preliminary design and evaluation of a remote tele-mentoring system for minimally invasive surgery

Dehlela Shabir,Nihal Abdurahiman,Jhasketan Padhan,Malek Anbatawi,May Trinh,Shidin Balakrishnan,Abdulla Al-Ansari,Elias Yaacoub,Zhigang Deng,Aiman Erbad,Amr Mohammed,Nikhil V. Navkar

DOI: https://doi.org/10.1007/s00464-022-09164-3

2022-03-04

Surgical Endoscopy

Abstract:Abstract Background Tele-mentoring during surgery facilitates the transfer of surgical knowledge from a mentor (specialist surgeon) to a mentee (operating surgeon). The aim of this work is to develop a tele-mentoring system tailored for minimally invasive surgery (MIS) where the mentor can remotely demonstrate to the mentee the required motion of the surgical instruments. Methods A remote tele-mentoring system is implemented that generates visual cues in the form of virtual surgical instrument motion overlaid onto the live view of the operative field. The technical performance of the system is evaluated in a simulated environment, where the operating room and the central location of the mentor were physically located in different countries and connected over the internet. In addition, a user study was performed to assess the system as a mentoring tool. Results On average, it took 260 ms to send a view of the operative field of 1920 × 1080 resolution from the operating room to the central location of the mentor and an average of 132 ms to receive the motion of virtual surgical instruments from the central location to the operating room. The user study showed that it is feasible for the mentor to demonstrate and for the mentee to understand and replicate the motion of surgical instruments. Conclusion The work demonstrates the feasibility of transferring information over the internet from a mentor to a mentee in the form of virtual surgical instruments. Their motion is overlaid onto the live view of the operative field enabling real-time interactions between both the surgeons.
Curriculum-based neurosurgery digital library

Jean-Philippe Langevin,Thai Dang,David Kon,Monica Sapo,Ulrich Batzdorf,Neil Martin

DOI: https://doi.org/10.1227/NEU.0b013e3181f07c7e

IF: 5.315

Neurosurgery

Abstract:Background: Recent work-hour restrictions and the constantly evolving body of knowledge are challenging the current ways of teaching neurosurgery residents. Objective: To develop a curriculum-based digital library of multimedia content to face the challenges in neurosurgery education. Method: We used the residency program curriculum developed by the Congress of Neurological Surgeons to structure the library and Microsoft Sharepoint as the user interface. Results: This project led to the creation of a user-friendly and searchable digital library that could be accessed remotely and throughout the hospital, including the operating rooms. Conclusion: The electronic format allows standardization of the content and transformation of the operating room into a classroom. This in turn facilitates the implementation of a curriculum within the training program and improves teaching efficiency. Future work will focus on evaluating the efficacy of the library as a teaching tool for residents.
A Hot-Vent Gastropod with Iron Sulfide Dermal Sclerites

A. Warén,S. Bengtson,S. Goffredi,C. V. Van Dover

DOI: https://doi.org/10.1126/SCIENCE.1087696

IF: 56.9

2003-11-07

Science

Abstract:1, C and D). The dominant crystalline mineral phase is pyrite, whereas greigite, the sulfide analog of magnetite, is present in lower proportions and accounts for the ferrimagnetism. The interior of the sclerites is penetrated by a pulp of pedal tissue that extends almost to the tip. Between the pulp and the outer mineralized layers there is a tough, laminated, organic layer, histologically indistinguishable from molluscan conchiolin. The conchiolin is studded with minute (typically about 1 m in diameter) iron sulfide granules and finely dispersed iron sulfur compounds; these minerals are more common in the outer layers of the conchiolin. Where the sclerite surface is overlain by adjacent sclerites, the sclerites are covered by a coat of bacteria (Fig. 1C; fig. S2G). Iron sulfide as a skeletal material is not known in metazoans (4), although accumulations of metal sulfides occur in animal tissues
3 D interactive surgical visualization system 2 3 D Interactive Surgical Visualization System using Mobile Spatial Information Acquisition and Autostereoscopic Display

Zhencheng Fan,Yitong Weng,Guowen Chen,Hongen Liao

2017-01-01

Abstract:Three-dimensional (3D) visualization of preoperative and intraoperative medical information becomes more and more important in minimally invasive surgery. We develop a 3D interactive surgical visualization system using mobile spatial information acquisition and autostereoscopic display for surgeons to observe surgical target intuitively. The spatial information of regions of interest (ROIs) is captured by the mobile device and transferred to a server for further image processing. Triangular patches of intraoperative data with texture are calculated with a dimension-reduced triangulation algorithm and a projection-weighted mapping algorithm. A point cloud selection-based warm-start iterative closest point (ICP) algorithm is also developed for fusion of the reconstructed 3D intraoperative image and the preoperative image. The fusion images are rendered for 3D autostereoscopic display using integral videography (IV) technology. Moreover, 3D visualization of medical image corresponding to observer’s viewing direction is updated automatically using mutual information registration method. Experimental results show that the spatial position error between * Corresponding author. Tel.: +86 10-62793759; fax: +86 10-62795002. E-mail address: liao@tsinghua.edu.cn 3D interactive surgical visualization system 3 the IV-based 3D autostereoscopic fusion image and the actual object was 0.38±0.92 mm (n=5). The system can be utilized in telemedicine, operating education, surgical planning, navigation, etc. to acquire spatial information conveniently and display surgical information intuitively. PACS(optional, as per journal): 75.40.-s; 71.20.LP
Anatomically Integrated In-Place Visualization of Patient Data for Cooperative Tasks with a Case Study on a Neurosurgical Ward

Dmitri Presnov,Julia Kurz,Judith Willkomm,Johannes Dillmann,Daniel Alt,Robert Zilke,Veit Braun,Cornelius Schubert,Andreas Kolb

DOI: https://doi.org/10.1177/14604582231171878

2023-05-05

Health Informatics Journal

Abstract:Health Informatics Journal, Volume 29, Issue 2, April-June 2023. The workflow in modern hospitals entails that the medical treatment of a patient is distributed between several physicians and nurses. This leads to intensive cooperation, which takes place under particular time pressure and requires efficient conveyance of relevant patient-related medical data to colleagues. This requirement is difficult to achieve with traditional data representation approaches. In this paper, we introduce a novel concept of anatomically integrated in-place visualization designed to engage with cooperative tasks on a neurosurgical ward by using a virtual patient's body as spatial representation of visually encoded abstract medical data. Based on the findings of our field studies, we provide a set of formal requirements and procedures for this kind of visual encoding. Moreover, we implemented a prototype on a mobile device that supports the diagnosis of spinal disc herniation and has been evaluated by 10 neurosurgeons. The physicians have assessed the proposed concept as beneficial, especially emphasizing the advantages of the anatomical integration such as intuitiveness and a better data availability due to providing all information at a glance. Particularly, four of nine respondents have stressed solely benefits of the concept, other four have mentioned benefits with some limitations and only one person has seen no benefits.

health care sciences & services,medical informatics
Endoscopic Endonasal Approach in the Smart Cyber Operating Theater (SCOT): Preliminary Clinical Application

Toshihiro Ogiwara,Tetsuya Goto,Yu Fujii,Takuya Nakamura,Yota Suzuki,Yoshiki Hanaoka,Kiyoshi Ito,Tetsuyoshi Horiuchi,Kazuhiro Hongo

DOI: https://doi.org/10.1016/j.wneu.2020.12.114

Abstract:Background: A next-generation networked operating room, Smart Cyber Operating Theater (SCOT), has been developed in cooperation with medical engineers that integrates standalone medical devices, including intraoperative magnetic resonance imaging (MRI) using the OPeLiNK communication interface. Here, we report the application of this newly developed advanced type of operating theater for the endoscopic endonasal approach (EEA), along with an evaluation of our initial experiences. Methods: The study population consisted of 18 patients with parasellar tumor. All patients underwent surgery via the EEA in SCOT. During all procedures, various types of intraoperative information, including electrophysiologic monitoring, anatomic orientation with navigation system, intraoperative MRI, and endoscopic images of the operative field, were collected and stored by OPeLiNK. Furthermore, the intraoperative information was shared with the surgical strategy desk, where a senior neurosurgeon can direct and manage the surgical procedure in real-time. Results: We successfully completed the surgical procedures in SCOT in all cases. Using OPeLiNK, operators in SCOT were able to share various data, such as images obtained intraoperatively and surgical instrument position from navigation systems, as well as images of the surgical field, with senior neurosurgeons at the surgical strategy desk in all cases. Surgically relevant information from these sources was transmitted through an application and displayed to all surgical staff. The necessary nuances were reflected in the surgical procedures. Conclusions: SCOT, which is considered an innovative operation system in neurosurgery, enables both quality and safety in the EEA. Furthermore, the use of SCOT may also contribute to the education of young neurosurgeons.
IMHOTEP - Virtual Reality Framework for Surgical Applications

Micha Pfeiffer,Hannes Kenngott,Anas Preukschas,Matthias Huber,Lisa Bettscheider,Beat Müller-Stich,Stefanie Speidel

DOI: https://doi.org/10.48550/arXiv.1803.08264

IF: 6.4588

2018-03-22

Human-Computer Interaction

Abstract:Purpose: The data which is available to surgeons before, during and after surgery is steadily increasing in quantity as well as diversity. When planning a patient's treatment, this large amount of information can be difficult to interpret. To aid in processing the information, new methods need to be found to present multi-modal patient data, ideally combining textual, imagery, temporal and 3D data in a holistic and context-aware system. Methods: We present an open-source framework which allows handling of patient data in a virtual reality (VR) environment. By using VR technology, the workspace available to the surgeon is maximized and 3D patient data is rendered in stereo, which increases depth perception. The framework organizes the data into workspaces and contains tools which allow users to control, manipulate and enhance the data. Due to the framework's modular design, it can easily be adapted and extended for various clinical applications. Results: The framework was evaluated by clinical personnel (77 participants). The majority of the group stated that a complex surgical situation is easier to comprehend by using the framework, and that it is very well suited for education. Furthermore, the application to various clinical scenarios - including the simulation of excitation-propagation in the human atrium - demonstrated the framework's adaptability. As a feasibility study, the framework was used during the planning phase of the surgical removal of a large central carcinoma from a patient's liver. Conclusion: The clinical evaluation showed a large potential and high acceptance for the VR environment in a medical context. The various applications confirmed that the framework is easily extended and can be used in real-time simulation as well as for the manipulation of complex anatomical structures.
3D Interactive Surgical Visualization System Using Mobile Spatial Information Acquisition and Autostereoscopic Display

Zhencheng Fan,Yitong Weng,Guowen Chen,Hongen Liao

DOI: https://doi.org/10.1016/j.jbi.2017.05.014

IF: 8

2017-01-01

Journal of Biomedical Informatics

Abstract:Three-dimensional (3D) visualization of preoperative and intraoperative medical information becomes more and more important in minimally invasive surgery. We develop a 3D interactive surgical visualization system using mobile spatial information acquisition and autostereoscopic display for surgeons to observe surgical target intuitively. The spatial information of regions of interest (ROIs) is captured by the mobile device and transferred to a server for further image processing. Triangular patches of intraoperative data with texture are calculated with a dimension-reduced triangulation algorithm and a projection-weighted mapping algorithm. A point cloud selection-based warm-start iterative closest point (ICP) algorithm is also developed for fusion of the reconstructed 3D intraoperative image and the preoperative image. The fusion images are rendered for 3D autostereoscopic display using integral videography (IV) technology. Moreover, 3D visualization of medical image corresponding to observer's viewing direction is updated automatically using mutual information registration method. Experimental results show that the spatial position error between the IV-based 3D autostereoscopic fusion image and the actual object was 0.38±0.92mm (n=5). The system can be utilized in telemedicine, operating education, surgical planning, navigation, etc. to acquire spatial information conveniently and display surgical information intuitively.
Three-Dimensional Visual Patient Based on Electronic Medical Diagnostic Records.

Liehang Shi,Jianyong Sun,Yuanyuan Yang,Tonghui Ling,Mingqing Wang,Yiping Gu,Zhiming Yang,Yanqing Hua,Jianguo Zhang

DOI: https://doi.org/10.1109/jbhi.2017.2702201

IF: 7.7

2018-01-01

IEEE Journal of Biomedical and Health Informatics

Abstract:OBJECTIVE:an innovative concept and method is introduced to use a 3-D anatomical graphic pattern called visual patient (VP) visually to index, represent, and render the medical diagnostic records (MDRs) of a patient, so that a doctor can quickly learn the current and historical medical status of the patient by manipulating VP. The MDRs can be imaging diagnostic reports and DICOM images, laboratory reports and clinical summaries which can have clinical information relating to medical status of human organs or body parts. METHODS:the concept and method included three steps. First, a VP data model called visual index object (VIO) and a VP graphic model called visual anatomic object (VAO) were introduced. Second, a series of processing methods of parsing and extracting key information from MDRs were used to fill the attributes of the VIO model of a patient. Third, a VP system (VPS) was designed to map VIO to VAO, to create a VP instance for each patient. RESULTS:a prototype VPS has been implemented in a simulated hospital PACS/RIS integrated environment. Two evaluation results showed that more than 70% participating radiologists would like to use the VPS in their radiological imaging tasks, and the efficiency of using VPS to review the tested patients' MDRs was 2.24 times higher than that of using PACS/RIS, while the average accuracy by using PACS/RIS was better than that by using VPS; however, this difference was only about 4%. CONCLUSION:the developed VPS can show the medical status of patient organs/sub-organs with 3-D anatomical graphic pattern and will be welcomed by radiologists with better efficiency in reviewing the patients' MDRs and with acceptable accuracy. SIGNIFICANCE:the VP introduces a new way for medical professionals to access and interact with a huge amount of patient records with better efficiency in the big data era.
A mixed reality telemedicine system for collaborative ultrasound diagnostics and ultrasound-guided interventions

Stefan Maas,Peter Kopacsi,Peter Kovacs,Arnaud Bosteels

DOI: https://doi.org/10.33393/ao.2022.2394

2022-04-20

AboutOpen

Abstract:In acute care settings (emergency room [ER], intensive care unit [ICU], operating room [OR]), it is common for inexperienced physicians to have problems making an ultrasound (US) diagnosis, so they have to consult an expert. In this article, we would like to present a methodology by which geographically independent expert physicians can engage during an US examination through virtual and augmented reality. The expert can view the set-up and the US images obtained by the examiner and discuss the clinical case over video chat. In turn, s/he can advise on the proper positioning of the US transducer on the patient with the help of a virtual US transducer. This technology can be used to obtain experts’ opinion from a remote location, whether it is inside a hospital or many miles away. Similarly, it can be used for distant training; whatever the indication, it will lead to improved care. We discuss two different use cases inside an ER: US for a Focused Assessment with Sonography in Trauma (FAST) examination and US for the insertion of a central venous catheter (CVC). Currently, we position this technology to Technology Readiness Level 2, as the concept is formulated and the practical application is identified. The basic properties of algorithms are defined and the basic principles are coded. We performed experiments with parts of the technology in an artificial environment. We asked a doctor, Arnaud Bosteels, to review this method and create this article together.
[Telenavigation and expert consultation using a stereotaxic surgical videoserver]

A Wagner,J Kremser,F Watzinger,I Friede,M Truppe,R Ewers

DOI: https://doi.org/10.1007/PL00014560

Abstract:The exponential increase of medical information creates a need for new methods in the visualization of medical imaging modalities for diagnosis and therapy. In this sense, visualization includes the display of medical image data and image-guided stereotaxic navigation as well as the advice of an expert. The Artma Virtual Patient System enables a remote expert to observe the surgical procedure via the Internet and interactively modify the interoperative visualization from the remote location. The expert in the remote location receives the planning data almost in real time over TCP/IP from a stereotaxic videoserver. In addition to live video streaming, stereotaxic navigation data are sent over the network as rigid body coordinates. The expert modifies the surgical simulation on the remote computer and the modified operating plan is sent back to the operating site. By teleconsulting, the composite images and overlapping graphics--instruments, target structures, landmarks, contour--can be seen in affiliated clinics with the possibility of interactive graphical assistance. With this image fusion technology the knowledge of a remote expert is included in virtual data structures and visualized by the overlay with live video data (augmented reality) in real time during surgery.

Magnetic Resonance Imaging and Diffusion-Weighted Imaging in Categorization of Uterine Sarcoma : Correlation with Pathological Findings

Multispecialty Enterprise Imaging Workgroup Consensus on Interactive Multimedia Reporting Current State and Road to the Future: HIMSS-SIIM Collaborative White Paper

A patient-centric distribution architecture for medical image sharing

Thermodynamic efficiency in nonlinear biochemical reactions.

Design of a robot-assisted system for transforaminal percutaneous endoscopic lumbar surgeries: study protocol

A Hybrid-Layered System for Image-Guided Navigation and Robot Assisted Spine Surgery

A Hybrid-Layered System for Image-Guided Navigation and Robot Assisted Spine Surgeries

GUI-based Pedicle Screw Planning on Fluoroscopic Images Utilizing Vertebral Segmentation

Application of KinectTM and wireless technology for patient data recording and viewing system in the course of surgery

Image guided interpedicular screw placement simulation system for training and skill evaluation. Proof of concept

Preliminary design and evaluation of a remote tele-mentoring system for minimally invasive surgery

Curriculum-based neurosurgery digital library

A Hot-Vent Gastropod with Iron Sulfide Dermal Sclerites

3 D interactive surgical visualization system 2 3 D Interactive Surgical Visualization System using Mobile Spatial Information Acquisition and Autostereoscopic Display

Anatomically Integrated In-Place Visualization of Patient Data for Cooperative Tasks with a Case Study on a Neurosurgical Ward

Endoscopic Endonasal Approach in the Smart Cyber Operating Theater (SCOT): Preliminary Clinical Application

IMHOTEP - Virtual Reality Framework for Surgical Applications

3D Interactive Surgical Visualization System Using Mobile Spatial Information Acquisition and Autostereoscopic Display

Three-Dimensional Visual Patient Based on Electronic Medical Diagnostic Records.

A mixed reality telemedicine system for collaborative ultrasound diagnostics and ultrasound-guided interventions

[Telenavigation and expert consultation using a stereotaxic surgical videoserver]