Abstract:In neurosurgery, the precise diagnosis and treatment of tumor diseases are challenging to realize. Current clinical diagnoses lack fast and accurate intraoperative information. Therefore, the development of new methods and techniques to assist neurosurgeons intraoperatively is necessary. Optical diagnosis is a promising method to provide accurate information about biological tissues in a short time. Therefore, in this study, we proposed a dual-modality optical diagnostic method through point-to-face registration fusion in the optical system. We incorporated quantitative autofluorescence spectroscopy and optical coherence tomography (OCT) and evaluated our methods in an animal model. Methods: A mouse model consisting of 16 nude mice was built by injecting the mouse brains with human glioma cells. Preoperative bioluminescence imaging was used to evaluate the growth states of tumors and locate the tumor sites. Quantitative autofluorescence spectroscopy, which provided local biochemical information with single-point detection, and OCT, which provided relatively global structural information with en face mapping scanning, were combined using the point-to-face registration fusion method to provide precise diagnostic information for identifying the brain tumors. Postoperative pathology was performed to evaluate the sensitivity and specificity of optical diagnosis. Results: Ex vivo quantitative autofluorescence spectroscopy and OCT imaging were first performed in eight mice to acquire the optimal measuring parameters for tumor staging and identification. We then performed in vivo quantitative autofluorescence spectroscopy and OCT imaging. The results showed that tumor staging could be realized through quantitative autofluorescence spectroscopy, and fusion images could be used to precisely identify tumors. The autofluorescence spectral map, OCT en face map, and fused diagnostic map had average sensitivities of 91.7%, 86.1%, and 95.9% and specificities of 93.2%, 96.0%, and 88.7%, respectively, for tumor identification. Conclusion: The dual-modality optical point-to-face registration fusion method and system we proposed could provide both biochemical information and structural information. The in vivo experimental results validated that the sensitivity (95.9%) of the fused map was higher than that of either single diagnostic modality (86.1% or 91.7%). Tumor staging was realized through quantitative autofluorescence spectroscopy. The proposed method will be applicable to future intelligent theranostic systems and improve many clinical neurosurgeries.

Tissue characterization based on the analysis on i3DUS data for diagnosis support in neurosurgery

Context aware decision support in neurosurgical oncology based on an efficient classification of endomicroscopic data

Dual-modality Optical Diagnosis for Precise in Vivo Identification of Tumors in Neurosurgery

Automatic Tissue Differentiation Based on Confocal Endomicroscopic Images for Intraoperative Guidance in Neurosurgery

3MT-Net: A Multi-modal Multi-task Model for Breast Cancer and Pathological Subtype Classification Based on a Multicenter Study

Towards Safe and Collaborative Robotic Ultrasound Tissue Scanning in Neurosurgery

Non-rigid registration of 3D ultrasound for neurosurgery using automatic feature detection and matching

Evaluation of MRI to Ultrasound Registration Methods for Brain Shift Correction: The CuRIOUS2018 Challenge

Dense Error Map Estimation for MRI-Ultrasound Registration in Brain Tumor Surgery Using Swin UNETR

An efficient computerized decision support system for the analysis and 3D visualization of brain tumor

Toward intraoperative tissue classification: exploiting signal feedback from an ultrasonic aspirator for brain tissue differentiation

Intelligent analysis technique of medical imaging assisted accurate diagnosis and treatment for neurosurgery

FocalErrorNet: Uncertainty-aware focal modulation network for inter-modal registration error estimation in ultrasound-guided neurosurgery

Identifying Visible Tissue in Intraoperative Ultrasound Images during Brain Surgery: A Method and Application

Towards an Efficient Computational Framework for Guiding Surgical Resection through Intra-operative Endo-microscopic Pathology.

Towards multi-modal anatomical landmark detection for ultrasound-guided brain tumor resection with contrastive learning

Intraoperative ultrasound and magnetic resonance comparative analysis in brain tumor surgery: a valuable tool to flatten ultrasound's learning curve

Collaborative Robotic Ultrasound Tissue Scanning for Surgical Resection Guidance in Neurosurgery

A computer-aided diagnosis system for brain tumors based on artificial intelligence algorithms

Automatic brain tumor segmentation in 2D intra-operative ultrasound images using MRI tumor annotations

Automated robotic intraoperative ultrasound for brain surgery