Abstract:In neurosurgery, the precise diagnosis and treatment of tumor diseases are challenging to realize. Current clinical diagnoses lack fast and accurate intraoperative information. Therefore, the development of new methods and techniques to assist neurosurgeons intraoperatively is necessary. Optical diagnosis is a promising method to provide accurate information about biological tissues in a short time. Therefore, in this study, we proposed a dual-modality optical diagnostic method through point-to-face registration fusion in the optical system. We incorporated quantitative autofluorescence spectroscopy and optical coherence tomography (OCT) and evaluated our methods in an animal model. Methods: A mouse model consisting of 16 nude mice was built by injecting the mouse brains with human glioma cells. Preoperative bioluminescence imaging was used to evaluate the growth states of tumors and locate the tumor sites. Quantitative autofluorescence spectroscopy, which provided local biochemical information with single-point detection, and OCT, which provided relatively global structural information with en face mapping scanning, were combined using the point-to-face registration fusion method to provide precise diagnostic information for identifying the brain tumors. Postoperative pathology was performed to evaluate the sensitivity and specificity of optical diagnosis. Results: Ex vivo quantitative autofluorescence spectroscopy and OCT imaging were first performed in eight mice to acquire the optimal measuring parameters for tumor staging and identification. We then performed in vivo quantitative autofluorescence spectroscopy and OCT imaging. The results showed that tumor staging could be realized through quantitative autofluorescence spectroscopy, and fusion images could be used to precisely identify tumors. The autofluorescence spectral map, OCT en face map, and fused diagnostic map had average sensitivities of 91.7%, 86.1%, and 95.9% and specificities of 93.2%, 96.0%, and 88.7%, respectively, for tumor identification. Conclusion: The dual-modality optical point-to-face registration fusion method and system we proposed could provide both biochemical information and structural information. The in vivo experimental results validated that the sensitivity (95.9%) of the fused map was higher than that of either single diagnostic modality (86.1% or 91.7%). Tumor staging was realized through quantitative autofluorescence spectroscopy. The proposed method will be applicable to future intelligent theranostic systems and improve many clinical neurosurgeries.

Intelligent analysis technique of medical imaging assisted accurate diagnosis and treatment for neurosurgery

39.3: Invited Paper: Intelligent Analysis and Display of Medical Images for Guiding Precise Diagnosis and Treatment

Application of Machine Learning in Intelligent Medical Image Diagnosis and Construction of Intelligent Service Process

Deep Learning for Accurate Diagnosis of Liver Tumor Based on Magnetic Resonance Imaging and Clinical Data

The clinical application of intraoperative MRI

Application and Development of Artificial Intelligence-based Medical Imaging Diagnostic Assistance System

Application of Multimodal Neuroimaging in the Treatment of Neurological Patients

Tissue characterization based on the analysis on i3DUS data for diagnosis support in neurosurgery

Application of Multimodal Image Fusion Technology in Brain Tumor Surgical Procedure

Intelligent medical detection and diagnosis assisted by deep learning

Dual-modality Optical Diagnosis for Precise in Vivo Identification of Tumors in Neurosurgery

Application of deep-learning based computer vision in medical image analysis

Intelligent medical image recognition : progress and prospect

Application of Artificial Intelligence Technology in Medical Imaging

Advancement in brain tumour detection using deep learning technique

NeuroIGN: Explainable Multimodal Image-Guided System for Precise Brain Tumor Surgery

Application of Multimodal Fusion Technology in Image Analysis of Pretreatment Examination of Patients with Spinal Injury

AI in spotting high-risk characteristics of medical imaging and molecular pathology

Research progress in the application status and development trend of artificial intelligence in the diagnosis and treatment of spinal disease

Intelligent Diagnosis Method of MRI Brain Image Using Parallel Self-Organizing Feature Maps Neural Network

A Comprehensive Survey on Brain Tumor Diagnosis Using Deep Learning and Emerging Hybrid Techniques with Multi-modal MR Image