Abstract:Background Visualizing and comprehending 3-dimensional (3D) neuroanatomy is challenging. Cadaver dissection is limited by low availability, high cost, and the need for specialized facilities. New technologies, including 3D rendering of neuroimaging, 3D pictures, and 3D videos, are filling this gap and facilitating learning, but they also have limitations. This proof-of-concept study explored the feasibility of combining the spatial accuracy of 3D reconstructed neuroimaging data with realistic texture and fine anatomical details from 3D photogrammetry to create high-fidelity cadaveric neurosurgical simulations. Methods Four fixed and injected cadaver heads underwent neuroimaging. To create 3D virtual models, surfaces were rendered using magnetic resonance imaging (MRI) and computed tomography (CT) scans, and segmented anatomical structures were created. A stepwise pterional craniotomy procedure was performed with synchronous neuronavigation and photogrammetry data collection. All points acquired in 3D navigational space were imported and registered in a 3D virtual model space. A novel machine learning-assisted monocular-depth estimation tool was used to create 3D reconstructions of 2-dimensional (2D) photographs. Depth maps were converted into 3D mesh geometry, which was merged with the 3D virtual model’s brain surface anatomy to test its accuracy. Quantitative measurements were used to validate the spatial accuracy of 3D reconstructions of different techniques. Results Successful multilayered 3D virtual models were created using volumetric neuroimaging data. The monocular-depth estimation technique created qualitatively accurate 3D representations of photographs. When 2 models were merged, 63% of surface maps were perfectly matched (mean [SD] deviation 0.7 ± 1.9 mm; range −7 to 7 mm). Maximal distortions were observed at the epicenter and toward the edges of the imaged surfaces. Virtual 3D models provided accurate virtual measurements (margin of error <1.5 mm) as validated by cross-measurements performed in a real-world setting. Conclusion The novel technique of co-registering neuroimaging and photogrammetry-based 3D models can (1) substantially supplement anatomical knowledge by adding detail and texture to 3D virtual models, (2) meaningfully improve the spatial accuracy of 3D photogrammetry, (3) allow for accurate quantitative measurements without the need for actual dissection, (4) digitalize the complete surface anatomy of a cadaver, and (5) be used in realistic surgical simulations to improve neurosurgical education.

A New Paradigm for Ultra-High Definition Photography in Surgical Neuroanatomy

Advance and Prospect for Three-Dimensional Super-Resolution Microscopy

Photogrammetry scans for neuroanatomy education - a new multi-camera system: technical note

Foundations and guidelines for high-quality three-dimensional models using photogrammetry: A technical note on the future of neuroanatomy education

Anatomic Depth Estimation and 3-Dimensional Reconstruction of Microsurgical Anatomy Using Monoscopic High-Definition Photogrammetry and Machine Learning

Construction of Neuroanatomical Volumetric Models Using 3-Dimensional Scanning Techniques: Technical Note and Applications

A Narrative Review on 3D Visualization Techniques in Neurosurgical Education, Simulation and Planning

3D Modeling and Advanced Visualization of the Pediatric Brain, Neck, and Spine

Advanced 3D Visualization and 3D Printing in Radiology

Intraoperative Videogrammetry and Photogrammetry for Photorealistic Neurosurgical 3-Dimensional Models Generated Using Operative Microscope: Technical Note

Current and Future Photography Techniques in Aesthetic Surgery

Improving Microscopic Imaging in Otology and Neurotology

Breaking boundaries in neurosurgery through art and technology: A historical perspective

3D Reconstruction and Segmentation of Dissection Photographs for MRI-free Neuropathology

Development and Validation of a Novel Methodological Pipeline to Integrate Neuroimaging and Photogrammetry for Immersive 3D Cadaveric Neurosurgical Simulation

Narrative review of patient-specific 3D visualization and reality technologies in skull base neurosurgery: enhancements in surgical training, planning, and navigation

Machine learning of dissection photographs and surface scanning for quantitative 3D neuropathology

Ex vivo 3D scanning and specimen mapping in anatomic pathology

Use of 3-Dimensional Modeling and Augmented/Virtual Reality Applications in Microsurgical Neuroanatomy Training

Three-Dimensional Microscopy by Milling with Ultraviolet Excitation

Radiologically derived 3D virtual models for neurosurgical planning