Abstract:Background Visualizing and comprehending 3-dimensional (3D) neuroanatomy is challenging. Cadaver dissection is limited by low availability, high cost, and the need for specialized facilities. New technologies, including 3D rendering of neuroimaging, 3D pictures, and 3D videos, are filling this gap and facilitating learning, but they also have limitations. This proof-of-concept study explored the feasibility of combining the spatial accuracy of 3D reconstructed neuroimaging data with realistic texture and fine anatomical details from 3D photogrammetry to create high-fidelity cadaveric neurosurgical simulations. Methods Four fixed and injected cadaver heads underwent neuroimaging. To create 3D virtual models, surfaces were rendered using magnetic resonance imaging (MRI) and computed tomography (CT) scans, and segmented anatomical structures were created. A stepwise pterional craniotomy procedure was performed with synchronous neuronavigation and photogrammetry data collection. All points acquired in 3D navigational space were imported and registered in a 3D virtual model space. A novel machine learning-assisted monocular-depth estimation tool was used to create 3D reconstructions of 2-dimensional (2D) photographs. Depth maps were converted into 3D mesh geometry, which was merged with the 3D virtual model’s brain surface anatomy to test its accuracy. Quantitative measurements were used to validate the spatial accuracy of 3D reconstructions of different techniques. Results Successful multilayered 3D virtual models were created using volumetric neuroimaging data. The monocular-depth estimation technique created qualitatively accurate 3D representations of photographs. When 2 models were merged, 63% of surface maps were perfectly matched (mean [SD] deviation 0.7 ± 1.9 mm; range −7 to 7 mm). Maximal distortions were observed at the epicenter and toward the edges of the imaged surfaces. Virtual 3D models provided accurate virtual measurements (margin of error <1.5 mm) as validated by cross-measurements performed in a real-world setting. Conclusion The novel technique of co-registering neuroimaging and photogrammetry-based 3D models can (1) substantially supplement anatomical knowledge by adding detail and texture to 3D virtual models, (2) meaningfully improve the spatial accuracy of 3D photogrammetry, (3) allow for accurate quantitative measurements without the need for actual dissection, (4) digitalize the complete surface anatomy of a cadaver, and (5) be used in realistic surgical simulations to improve neurosurgical education.

Interactive Manipulation and Visualization of 3D Brain MRI for Surgical Training

Visualization of Three Dimensional Brain Atlases for Image Guided Neurosurgery

Visualizing MRI Deep Learning Segmentation Algorithms using 3D Printing

A Virtual Brain for Stereotactic Planning and Supporting Neurosurgery.

Interactive quantitative measurement of blood vessel of brain and human skeleton visualization from non-enhanced MR angiography and CT data

Design and Implementation of Three Dimensional Visualization and Analysis System of Medical Images

BrainTrain: brain simulator for medical VR application

MRI Head Space-based Segmentation for Object Based Volume Visualization

Image segmentation and 3D visualization for MRI mammography

Application of Medical Image 3D Visualization Web Platform in Auxiliary Diagnosis and Preoperative Planning

An efficient computerized decision support system for the analysis and 3D visualization of brain tumor

A Tool for Interactive Data Visualization: Application to Over 10,000 Brain Imaging and Phantom MRI Data Sets

Interactive and Intelligent Approach for Brain Extraction from High-Resolution Volumetric MR Neuroimages

3D Modeling and Advanced Visualization of the Pediatric Brain, Neck, and Spine

Design and Realization of a Medical Images Three-dimensional Visualization System

Preliminary application of mxed reality in neurosurgery: Development and evaluation of a new intraoperative procedure

Real-Time Visualization and Interaction of Three-dimensional Human CT Images.

Reconstruction of Brain Tissue Surface Based on Three-Dimensional Tl-weighted MRI Images

An image analysis system for brain surgery assistant robot

3D Brainformer: 3D Fusion Transformer for Brain Tumor Segmentation

Development and Validation of a Novel Methodological Pipeline to Integrate Neuroimaging and Photogrammetry for Immersive 3D Cadaveric Neurosurgical Simulation