Neuronal ATP receptors and their mechanism of action.

P. Illés,W. Nörenberg

DOI: https://doi.org/10.1016/0165-6147(93)90030-N

1993-02-01

Abstract:

What problem does this paper attempt to address?

Analysis of Intraoperative Microscopy Imaging Techniques and Their Future Applications

Huiling Zhan,Chen Sun,Mingyu Xu,Tianyi Luo,Guangxing Wang,Gangqin Xi,Zhiyi Liu,Shuangmu Zhuo

DOI: https://doi.org/10.3389/fphy.2022.991279

IF: 3.718

2022-01-01

Frontiers in Physics

Abstract:During tumor resection, doctors use intraoperative biopsies to determine the tumor margin. However, the pathological procedures of traditional diagnostic methods, such as imprint cytology and frozen section analysis, are complicated and time-consuming. As this is not conducive to surgeries, their applications are limited to a large extent. Therefore, novel fast microscopy imaging technologies with resolutions comparable to those of pathological tissue sections are necessary. Stimulated Raman scattering (SRS), photoacoustic microscopy (PAM), multiphoton microscopy (MPM), and optical coherence microscopy (OCM) exhibit the advantages of high spatial resolution, large imaging depth, avoiding damage to biological tissues, label-free detection, and the availability of biochemical information of tissues. Additionally, they are superior to intraoperative biopsies owing to their fast imaging speeds. Therefore, they possess broad application prospects in tumor resection surgeries and the diagnosis of other diseases. This study briefly introduces the basic principles, structural characteristics, advantages and disadvantages, and the existing research status of SRS, PAM, MPM, and OCM in biomedicine. Furthermore, we propose a multi-mode hybrid detection technology that can be used for surgeries. The combination of the proposed technology with deep learning-based artificial intelligence can form the basis for intraoperative diagnosis in the future.
Real-time Image Guidance for Brain Tumor Surgery Through Stimulated Raman Scattering Microscopy

J. Nicole Bentley,Minbiao Ji,X. Sunney Xie,Daniel A. Orringer

DOI: https://doi.org/10.1586/14737140.2013.877844

2014-01-01

Expert Review of Anticancer Therapy

Abstract:Brain tumor surgery is one of the key factors in prolonging survival in patients with low- and high-grade gliomas. However, resections of these infiltrative lesions have historically been limited by the inability to accurately detect tumor margins. New methods in microscopy and dye injection have enabled more complete resections, but continue to lack biochemical specificity or high-resolution image acquisition. Stimulated Raman scattering microscopy represents an improvement over past techniques in the ability to differentiate intraparenchymal tissues on the basis of biochemical attributes, and is available for use in real-time, a feature that facilitates its translation to the surgical setting.
Rapid, Label-Free Detection of Brain Tumors with Stimulated Raman Scattering Microscopy

Minbiao Ji,Daniel A. Orringer,Christian W. Freudiger,Shakti Ramkissoon,Xiaohui Liu,Darryl Lau,Alexandra J. Golby,Isaiah Norton,Marika Hayashi,Nathalie Y. R. Agar,Geoffrey S. Young,Cathie Spino,Sandro Santagata,Sandra Camelo-Piragua,Keith L. Ligon,Oren Sagher,X. Sunney Xie

DOI: https://doi.org/10.1126/scitranslmed.3005954

IF: 17.1

2013-01-01

Science Translational Medicine

Abstract:Surgery is an essential component in the treatment of brain tumors. However, delineating tumor from normal brain remains a major challenge. We describe the use of stimulated Raman scattering (SRS) microscopy for differentiating healthy human and mouse brain tissue from tumor-infiltrated brain based on histoarchitectural and biochemical differences. Unlike traditional histopathology, SRS is a label-free technique that can be rapidly performed in situ. SRS microscopy was able to differentiate tumor from nonneoplastic tissue in an infiltrative human glioblastoma xenograft mouse model based on their different Raman spectra. We further demonstrated a correlation between SRS and hematoxylin and eosin microscopy for detection of glioma infiltration (κ = 0.98). Finally, we applied SRS microscopy in vivo in mice during surgery to reveal tumor margins that were undetectable under standard operative conditions. By providing rapid intraoperative assessment of brain tissue, SRS microscopy may ultimately improve the safety and accuracy of surgeries where tumor boundaries are visually indistinct.
Novel rapid intraoperative qualitative tumor detection by a residual convolutional neural network using label-free stimulated Raman scattering microscopy

David Reinecke,Niklas von Spreckelsen,Christian Mawrin,Adrian Ion-Margineanu,Gina Fürtjes,Stephanie T. Jünger,Florian Khalid,Christian W. Freudiger,Marco Timmer,Maximilian I. Ruge,Roland Goldbrunner,Volker Neuschmelting

DOI: https://doi.org/10.1186/s40478-022-01411-x

2022-08-07

Acta Neuropathologica Communications

Abstract:Determining the presence of tumor in biopsies and the decision-making during resections is often dependent on intraoperative rapid frozen-section histopathology. Recently, stimulated Raman scattering microscopy has been introduced to rapidly generate digital hematoxylin-and-eosin-stained-like images (stimulated Raman histology) for intraoperative analysis. To enable intraoperative prediction of tumor presence, we aimed to develop a new deep residual convolutional neural network in an automated pipeline and tested its validity. In a monocentric prospective clinical study with 94 patients undergoing biopsy, brain or spinal tumor resection, Stimulated Raman histology images of intraoperative tissue samples were obtained using a fiber-laser-based stimulated Raman scattering microscope. A residual network was established and trained in ResNetV50 to predict three classes for each image: (1) tumor, (2) non-tumor, and (3) low-quality. The residual network was validated on images obtained in three small random areas within the tissue samples and were blindly independently reviewed by a neuropathologist as ground truth. 402 images derived from 132 tissue samples were analyzed representing the entire spectrum of neurooncological surgery. The automated workflow took in a mean of 240 s per case, and the residual network correctly classified tumor (305/326), non-tumorous tissue (49/67), and low-quality (6/9) images with an inter-rater agreement of 89.6% (κ = 0.671). An excellent internal consistency was found among the random areas with 90.2% (Cα = 0.942) accuracy. In conclusion, the novel stimulated Raman histology-based residual network can reliably detect the microscopic presence of tumor and differentiate from non-tumorous brain tissue in resection and biopsy samples within 4 min and may pave a promising way for an alternative rapid intraoperative histopathological decision-making tool.

neurosciences
Instant Diagnosis of Gastroscopic Biopsy Via Deep-Learned Single-Shot Femtosecond Stimulated Raman Histology

Zhijie Liu,Wei Su,Jianpeng Ao,Min Wang,Qiuli Jiang,Jie He,Hua Gao,Shu Lei,Jinshan Nie,Xuefeng Yan,Xiaojing Guo,Pinghong Zhou,Hao Hu,Minbiao Ji

DOI: https://doi.org/10.1038/s41467-022-31339-8

IF: 16.6

2022-01-01

Nature Communications

Abstract:Gastroscopic biopsy provides the only effective method for gastric cancer diagnosis, but the gold standard histopathology is time-consuming and incompatible with gastroscopy. Conventional stimulated Raman scattering (SRS) microscopy has shown promise in label-free diagnosis on human tissues, yet it requires the tuning of picosecond lasers to achieve chemical specificity at the cost of time and complexity. Here, we demonstrate that single-shot femtosecond SRS (femto-SRS) reaches the maximum speed and sensitivity with preserved chemical resolution by integrating with U-Net. Fresh gastroscopic biopsy is imaged in <60 s, revealing essential histoarchitectural hallmarks perfectly agreed with standard histopathology. Moreover, a diagnostic neural network (CNN) is constructed based on images from 279 patients that predicts gastric cancer with accuracy >96%. We further demonstrate semantic segmentation of intratumor heterogeneity and evaluation of resection margins of endoscopic submucosal dissection (ESD) tissues to simulate rapid and automated intraoperative diagnosis. Our method holds potential for synchronizing gastroscopy and histopathological diagnosis.
Nimg-18. Rapid Intraoperative Differentiation Of Primary Cns Lymphoma From Common Cns Tumors Using Stimulated Raman Histology And Deep Learning

David Reinecke,Nader Maroouf,Daniel Alber,Andrew Smith,Todd C Hollon,Volker Neuschmelting,John G Golfinos,Daniel A Orringer

DOI: https://doi.org/10.1093/neuonc/noae165.0784

2024-11-29

Neuro-Oncology

Abstract:Accurate intraoperative diagnosis is crucial for decision-making during tumor surgery and stereotactic-guided biopsies. Differentiating between primary CNS lymphoma (PCNSL) and non-PCNSL entities such as gliomas and metastatic cancers presents significant challenges due to overlapping histomorphological features, time constraints, and the differing further therapy strategies required. Our study utilized deep learning and stimulated Raman histology (SRH) to address this challenge. We imaged unprocessed, label-free tissue samples intraoperatively using a portable Raman scattering microscope, generating virtual H&E-like images within less than five minutes. Our training set comprised over 54,000 SRH tumor patch images, including various brain tumors. We developed a deep learning pipeline utilizing a ResNet-50 feature extractor and the BYOL (Bootstrap Your Own Latent) self-supervised learning algorithm. We trained a binary linear classifier to distinguish between PCNSL and non-PCNSL entities. Data were collected from New York University (NYU), the University of Cologne (UKK), and the University of Michigan (UM), including 263 SRH whole slide images from 177 patients sourced from surgical resections and stereotactic-guided biopsies. In an international bicentric test cohort (N = 100, NYU and UKK), the model achieved an overall accuracy of 91.1%, an area under the receiver operating characteristic curve (AUROC) of 0.983, a sensitivity of 89.3%, and a specificity of 100% compared to the final formalin-fixed, paraffin-embedded-based diagnosis. Our algorithm can accurately extract typical histomorphological features to help differentiate between PCNSL and non-PCNSL tumors. These results underscore the potential of deep learning models to enhance the accuracy of intraoperative diagnoses for PCNSL and non-PCNSL entities, thereby improving intraoperative decision-making and further treatment strategies by supporting neuropathologists and surgeons.

oncology,clinical neurology
Randomized controlled trial of high-dose sublingual immunotherapy to treat seasonal allergic rhinitis.

Helen E. Smith,P. White,I. Annila,J. Poole,C. André,A. Frew

DOI: https://doi.org/10.1016/J.JACI.2004.06.058

IF: 14.29

2004-10-01

Journal of Allergy and Clinical Immunology

Abstract:
OpenSRH: optimizing brain tumor surgery using intraoperative stimulated Raman histology

Cheng Jiang,Asadur Chowdury,Xinhai Hou,Akhil Kondepudi,Christian W. Freudiger,Kyle Conway,Sandra Camelo-Piragua,Daniel A. Orringer,Honglak Lee,Todd C. Hollon

DOI: https://doi.org/10.48550/arXiv.2206.08439

2022-11-02

Abstract:Accurate intraoperative diagnosis is essential for providing safe and effective care during brain tumor surgery. Our standard-of-care diagnostic methods are time, resource, and labor intensive, which restricts access to optimal surgical treatments. To address these limitations, we propose an alternative workflow that combines stimulated Raman histology (SRH), a rapid optical imaging method, with deep learning-based automated interpretation of SRH images for intraoperative brain tumor diagnosis and real-time surgical decision support. Here, we present OpenSRH, the first public dataset of clinical SRH images from 300+ brain tumors patients and 1300+ unique whole slide optical images. OpenSRH contains data from the most common brain tumors diagnoses, full pathologic annotations, whole slide tumor segmentations, raw and processed optical imaging data for end-to-end model development and validation. We provide a framework for patch-based whole slide SRH classification and inference using weak (i.e. patient-level) diagnostic labels. Finally, we benchmark two computer vision tasks: multiclass histologic brain tumor classification and patch-based contrastive representation learning. We hope OpenSRH will facilitate the clinical translation of rapid optical imaging and real-time ML-based surgical decision support in order to improve the access, safety, and efficacy of cancer surgery in the era of precision medicine. Dataset access, code, and benchmarks are available at <a class="link-external link-http" href="http://opensrh.mlins.org" rel="external noopener nofollow">this http URL</a>.

Image and Video Processing,Computer Vision and Pattern Recognition,Machine Learning
Virtual formalin-fixed and paraffin-embedded staining of fresh brain tissue via stimulated Raman CycleGAN model

Zhijie Liu,Lingchao Chen,Haixia Cheng,Jianpeng Ao,Ji Xiong,Xing Liu,Yaxin Chen,Ying Mao,Minbiao Ji

DOI: https://doi.org/10.1126/sciadv.adn3426

IF: 13.6

2024-03-28

Science Advances

Abstract:Intraoperative histology is essential for surgical guidance and decision-making. However, frozen-sectioned hematoxylin and eosin (H&E) staining suffers from degraded accuracy, whereas the gold-standard formalin-fixed and paraffin-embedded (FFPE) H&E is too lengthy for intraoperative use. Stimulated Raman scattering (SRS) microscopy has shown rapid histology of brain tissue with lipid/protein contrast but is challenging to yield images identical to nucleic acid–/protein-based FFPE stains interpretable to pathologists. Here, we report the development of a semi-supervised stimulated Raman CycleGAN model to convert fresh-tissue SRS images to H&E stains using unpaired training data. Within 3 minutes, stimulated Raman virtual histology (SRVH) results that matched perfectly with true H&E could be generated. A blind validation indicated that board-certified neuropathologists are able to differentiate histologic subtypes of human glioma on SRVH but hardly on conventional SRS images. SRVH may provide intraoperative diagnosis superior to frozen H&E in both speed and accuracy, extendable to other types of solid tumors.

multidisciplinary sciences
In vivo Dilatation of the Fetal and Postnatal Ductus Arteriosus by Inhibition of Phosphodiesterase 3 in Rats

K. Toyoshima,K. Momma,S. Imamura,T. Nakanishi

DOI: https://doi.org/10.1159/000089954

2006-06-01

Neonatology

Abstract:Background: Clinically, it appears that phosphodiesterase 3 (PDE 3) inhibitors, which are used for acute cardiac failure in premature infants, dilate the ductus arteriosus (DA). Objectives: To clarify the ductus-dilating effects of PDE 3 inhibitors in near-term rat pups and their differential effects in near-term and preterm fetal rats, in in vivo studies. Methods: The in vivo ductal diameter of rat pups and fetuses was measured using a rapid whole-body freezing method, by cutting on a freezing microtome and measuring with a microscope and micrometer. Eight to twenty pups and fetuses were studied in each group. Milrinone and amrinone (specific inhibitors of PDE 3) were injected into 1-hour-old pups and the DA was studied 0.5 and 1 h later. The differential effects of these PDE 3 inhibitors on the near-term and preterm ductus were studied by injecting indomethacin (10 mg/kg) and PDE 3 inhibitors into 21D (21st day of pregnancy: term-21.5 days) and 19D dams and studying the fetal ductus 4 and 8 h later. Results: Milrinone and amrinone dilated the postnatal ductus dose-dependently. Large doses of these drugs dilated it completely, and clinically equivalent doses dilated it minimally. Milrinone and amrinone prevented constriction of the fetal ductus by indomethacin. Their ductus-dilating effects were more potent in the preterm than in the near-term fetuses, and clinically equivalent doses of these PDE 3 inhibitors dilated preterm ductus completely. Conclusion: In rats, PDE 3 inhibitors reopen the constricted postnatal DA slightly. PDE 3 inhibitors dilate the fetal DA constricted with indomethacin effectively and more sensitively in preterm than in near-term fetuses.
Stimulated Raman Scattering Microscopy Enables Gleason Scoring of Prostate Core Needle Biopsy by a Convolutional Neural Network

Jianpeng Ao,Xiaoguang Shao,Zhijie Liu,Qiang Liu,Jun Xia,Yongheng Shi,Lin Qi,Jiahua Pan,Minbiao Ji

DOI: https://doi.org/10.1158/0008-5472.can-22-2146

IF: 11.2

2023-01-01

Cancer Research

Abstract:AbstractFocal therapy (FT) has been proposed as an approach to eradicate clinically significant prostate cancer while preserving the normal surrounding tissues to minimize treatment-related toxicity. Rapid histology of core needle biopsies is essential to ensure the precise FT for localized lesions and to determine tumor grades. However, it is difficult to achieve both high accuracy and speed with currently available histopathology methods. Here, we demonstrated that stimulated Raman scattering (SRS) microscopy could reveal the largely heterogeneous histologic features of fresh prostatic biopsy tissues in a label-free and near real-time manner. A diagnostic convolutional neural network (CNN) built based on images from 61 patients could classify Gleason patterns of prostate cancer with an accuracy of 85.7%. An additional 22 independent cases introduced as external test dataset validated the CNN performance with 84.4% accuracy. Gleason scores of core needle biopsies from 21 cases were calculated using the deep learning SRS system and showed a 71% diagnostic consistency with grading from three pathologists. This study demonstrates the potential of a deep learning–assisted SRS platform in evaluating the tumor grade of prostate cancer, which could help simplify the diagnostic workflow and provide timely histopathology compatible with FT treatment.Significance:A platform combining stimulated Raman scattering microscopy and a convolutional neural network provides rapid histopathology and automated Gleason scoring on fresh prostate core needle biopsies without complex tissue processing.
Intra-operative Brain Tumor Detection with Deep Learning-Optimized Hyperspectral Imaging

Tommaso Giannantonio,Anna Alperovich,Piercosimo Semeraro,Manfredo Atzori,Xiaohan Zhang,Christoph Hauger,Alexander Freytag,Siri Luthman,Roeland Vandebriel,Murali Jayapala,Lien Solie,Steven de Vleeschouwer

DOI: https://doi.org/10.48550/arXiv.2302.02884

2023-02-06

Image and Video Processing

Abstract:Surgery for gliomas (intrinsic brain tumors), especially when low-grade, is challenging due to the infiltrative nature of the lesion. Currently, no real-time, intra-operative, label-free and wide-field tool is available to assist and guide the surgeon to find the relevant demarcations for these tumors. While marker-based methods exist for the high-grade glioma case, there is no convenient solution available for the low-grade case; thus, marker-free optical techniques represent an attractive option. Although RGB imaging is a standard tool in surgical microscopes, it does not contain sufficient information for tissue differentiation. We leverage the richer information from hyperspectral imaging (HSI), acquired with a snapscan camera in the 468-787 nm range, coupled to a surgical microscope, to build a deep-learning-based diagnostic tool for cancer resection with potential for intra-operative guidance. However, the main limitation of the HSI snapscan camera is the image acquisition time, limiting its widespread deployment in the operation theater. Here, we investigate the effect of HSI channel reduction and pre-selection to scope the design space for the development of cheaper and faster sensors. Neural networks are used to identify the most important spectral channels for tumor tissue differentiation, optimizing the trade-off between the number of channels and precision to enable real-time intra-surgical application. We evaluate the performance of our method on a clinical dataset that was acquired during surgery on five patients. By demonstrating the possibility to efficiently detect low-grade glioma, these results can lead to better cancer resection demarcations, potentially improving treatment effectiveness and patient outcome.
Rapid Automated Analysis of Skull Base Tumor Specimens Using Intraoperative Optical Imaging and Artificial Intelligence

Cheng Jiang,Abhishek Bhattacharya,Joseph R. Linzey,Rushikesh S. Joshi,Sung Jik Cha,Sudharsan Srinivasan,Daniel Alber,Akhil Kondepudi,Esteban Urias,Balaji Pandian,Wajd N. Al-Holou,Stephen E. Sullivan,B. Gregory Thompson,Jason A. Heth,Christian W. Freudiger,Siri Sahib S. Khalsa,Donato R. Pacione,John G. Golfinos,Sandra Camelo-Piragua,Daniel A. Orringer,Honglak Lee,Todd C. Hollon

DOI: https://doi.org/10.1227/neu.0000000000001929

IF: 5.315

2022-03-30

Neurosurgery

Abstract:BACKGROUND: Accurate specimen analysis of skull base tumors is essential for providing personalized surgical treatment strategies. Intraoperative specimen interpretation can be challenging because of the wide range of skull base pathologies and lack of intraoperative pathology resources.OBJECTIVE: To develop an independent and parallel intraoperative workflow that can provide rapid and accurate skull base tumor specimen analysis using label-free optical imaging and artificial intelligence.METHODS: We used a fiber laser-based, label-free, nonconsumptive, high-resolution microscopy method (<60 seconds per 1 × 1 mm2), called stimulated Raman histology (SRH), to image a consecutive, multicenter cohort of patients with skull base tumor. SRH images were then used to train a convolutional neural network model using 3 representation learning strategies: cross-entropy, self-supervised contrastive learning, and supervised contrastive learning. Our trained convolutional neural network models were tested on a held-out, multicenter SRH data set.RESULTS: SRH was able to image the diagnostic features of both benign and malignant skull base tumors. Of the 3 representation learning strategies, supervised contrastive learning most effectively learned the distinctive and diagnostic SRH image features for each of the skull base tumor types. In our multicenter testing set, cross-entropy achieved an overall diagnostic accuracy of 91.5%, self-supervised contrastive learning 83.9%, and supervised contrastive learning 96.6%. Our trained model was able to segment tumor-normal margins and detect regions of microscopic tumor infiltration in meningioma SRH images.CONCLUSION: SRH with trained artificial intelligence models can provide rapid and accurate intraoperative analysis of skull base tumor specimens to inform surgical decision-making.

surgery,clinical neurology
Stimulated Raman Scattering Microscopy for Rapid Brain Tumor Histology

Yifan Yang,Lingchao Chen,Minbiao Ji

DOI: https://doi.org/10.1142/s1793545817300105

IF: 2.396

2017-01-01

Journal of Innovative Optical Health Sciences

Abstract:Rapid histology of brain tissues with sufficient diagnostic information has the great potential to aid neurosurgeons during operations. Stimulated Raman Scattering (SRS) microscopy is an emerging label-free imaging technique, with the intrinsic chemical resolutions to delineate brain tumors from normal tissues without the need of time-consuming tissue processing. Growing number of studies have shown SRS as a "virtual histology" tool for rapid diagnosis of various types of brain tumors. In this review, we focus on the basic principles and current developments of SRS microscopy, as well as its applications for brain tumor imaging.
Rapid intraoperative histology of unprocessed surgical specimens via fibre-laser-based stimulated Raman scattering microscopy

Daniel A. Orringer,Balaji Pandian,Yashar S. Niknafs,Todd C. Hollon,Julianne Boyle,Spencer Lewis,Mia Garrard,Shawn L. Hervey-Jumper,Hugh J. L. Garton,Cormac O. Maher,Jason A. Heth,Oren Sagher,D. Andrew Wilkinson,Matija Snuderl,Sriram Venneti,Shakti H. Ramkissoon,Kathryn A. McFadden,Amanda Fisher-Hubbard,Andrew P. Lieberman,Timothy D. Johnson,X. Sunney Xie,Jay K. Trautman,Christian W. Freudiger,Sandra Camelo-Piragua

DOI: https://doi.org/10.1038/s41551-016-0027

IF: 28.1

2017-02-01

Nature Biomedical Engineering

Abstract:Conventional methods for intraoperative histopathologic diagnosis are labour- and time-intensive, and may delay decision-making during brain-tumour surgery. Stimulated Raman scattering (SRS) microscopy, a label-free optical process, has been shown to rapidly detect brain-tumour infiltration in fresh, unprocessed human tissues. Here, we demonstrate the first application of SRS microscopy in the operating room using a portable fibre-laser-based microscope and unprocessed specimens from 101 neurosurgical patients. We also introduce an image-processing method—stimulated Raman histology (SRH)—that leverages SRS images to create virtual haematoxylin-and-eosin-stained slides, revealing essential diagnostic features. In a simulation of intraoperative pathologic consultation in 30 patients, we found a remarkable concordance of SRH and conventional histology for predicting diagnosis (Cohen’s kappa, κ > 0.89), with accuracy exceeding 92%. We also built and validated a multilayer perceptron based on quantified SRH image attributes that predicts brain-tumour subtype with 90% accuracy. Our findings provide insight into how SRH can now be used to improve the surgical care of brain-tumour patients.

engineering, biomedical
SURG-13. STIMULATED RAMAN SCATTERING MICROSCOPY PROVIDES DIAGNOSTIC INTRAOPERATIVE HISTOPATHOLOGIC IMAGES IN BRAIN TUMOR PATIENTS

Daniel A. Orringer,Balaji Pandian,Todd C. Hollon,Yashar S. Niknafs,Julianne Boyle,Spencer Lewis,Shawn L. Hervey-Jumper,Hugh J. L. Garton,Cormac O. Maher,Jason A. Heth,Oren Sagher,Matija Snuderl,Sriram Venneti,Shakti Ramkissoon,Kathryn A. McFadden,Amanda Fisher-Hubbard,Andrew Lieberman,Timothy D. Johnson,X. Sunney Xie,Christian W. Freudiger,Sandra Camelo-Piragua

DOI: https://doi.org/10.1093/neuonc/now212.814

2016-01-01

Neuro-Oncology

Abstract:Accurate histologic information is essential to decision-making during brain tumor surgery. Current methods of intraoperative histopathologic diagnosis are labor intensive, prone to artifacts that complicate interpretation, and may delay surgical care. Stimulated Raman scattering (SRS) microscopy, a label-free optical process, presents an opportunity for rapid intraoperative histopathologic imaging as it has recently been shown to detect brain tumor infiltration in fresh, unprocessed human surgical specimens. Until now, execution of SRS microscopy in a clinical setting has not been possible. Here, we report the first demonstration of SRS microscopy in an operating room using a portable, fully-integrated fiber-laser-based SRS microscope in a series of fresh, unprocessed specimens from 97 neurosurgical patients. Additionally, we leverage 2-channel SRS images to generate virtual hematoxylin and eosin-stained images, revealing microscopic architectural features essential for the diagnosis of human brain tumors. In a simulation of intraoperative pathologic consultation completed by three board-certified neuropathologists, the concordance of SRS- and standard H&E-based methods for predicting diagnosis was nearly perfect (k>0.89) and the accuracy exceeded 92% for both methods. A multi-layer perceptron based on quantified attributes from SRS images was capable of predicting brain tumor subtype with 86.6% accuracy in a test set of 30 patients. SRS microscopy provides a simple, automated method for rapidly providing diagnostic histopathologic images in the operating room, without the need for processing, preparation, and staining tissue specimens in a pathology lab. SRS microscopy may ultimately enable more thorough histologic sampling of brain tumors and meticulous assessment of their interface with surrounding brain tissue during surgery.
High-Precision Intelligent Cancer Diagnosis Method: 2D Raman Figures Combined with Deep Learning

Yafeng Qi,Guochao Zhang,Lin Yang,Bangxu Liu,Hui Zeng,Qi Xue,Dameng Liu,Qingfeng Zheng,Yuhong Liu

DOI: https://doi.org/10.1021/acs.analchem.1c05098

2022-05-03

Abstract:Raman spectroscopy, as a label-free detection technology, has been widely used in tumor diagnosis. However, most tumor diagnosis procedures utilize multivariate statistical analysis methods for classification, which poses a major bottleneck toward achieving high accuracy. Here, we propose a concept called the two-dimensional (2D) Raman figure combined with convolutional neural network (CNN) to improve the accuracy. Two-dimensional Raman figures can be obtained from four transformation methods: spectral recurrence plot (SRP), spectral Gramian angular field (SGAF), spectral short-time Fourier transform (SSTFT), and spectral Markov transition field (SMTF). Two-dimensional CNN models all yield more than 95% accuracy, which is higher than the PCA-LDA method and the Raman-spectrum-CNN method, indicating that 2D Raman figure inputs combined with CNN may be one reason for gaining excellent performances. Among 2D-CNN models, the main difference is the conversion, where SRP is based on the structure of wavenumber series with the best performances (98.9% accuracy, 99.5% sensitivity, 98.3% specificity), followed by SGAF on the wavenumber series, SSTFT on wavenumber and intensity information, and SMTF on wavenumber position information. The inclusion of external information in the conversion may be another reason for improvement in the accuracy. The excellent capability shows huge potential for tumor diagnosis via 2D Raman figures and may be applied in other spectroscopy analytical fields.
Histological diagnosis of unprocessed breast core-needle biopsy via stimulated Raman scattering microscopy and multi-instance learning

Yifan Yang,Zhijie Liu,Jing Huang,Xiangjie Sun,Jianpeng Ao,Bin Zheng,Wanyuan Chen,Zhiming Shao,Hao Hu,Yinlong Yang,Minbiao Ji

DOI: https://doi.org/10.7150/thno.81784

IF: 11.6

2023-01-01

Theranostics

Abstract:Core-needle biopsy (CNB) plays a vital role in the initial diagnosis of breast cancer. However, the complex tissue processing and global shortage of pathologists have hindered traditional histopathology from timely diagnosis on fresh biopsies. In this work, we developed a full digital platform by integrating label-free stimulated Raman scattering (SRS) microscopy with weakly-supervised learning for rapid and automated cancer diagnosis on un-labelled breast CNB. Methods: We first compared the results of SRS imaging with standard hematoxylin and eosin (H&E) staining on adjacent frozen tissue sections. Then fresh unprocessed biopsy tissues were imaged by SRS to reveal diagnostic histoarchitectures. Next, weakly-supervised learning, i.e., the multi-instance learning (MIL) model was conducted to evaluate the ability to differentiate between benign and malignant cases, and compared with the performance of supervised learning model. Finally, gradient-weighted class activation mapping (Grad-CAM) and semantic segmentation were performed to spatially resolve benign/malignant areas with high efficiency. Results: We verified the ability of SRS in revealing essential histological hallmarks of breast cancer in both thin frozen sections and fresh unprocessed biopsy, generating histoarchitectures well correlated with H&E staining. Moreover, we demonstrated that weakly-supervised MIL model could achieve superior classification performance to supervised learnings, reaching diagnostic accuracy of 95% on 61 biopsy specimens. Furthermore, Grad-CAM allowed the trained MIL model to visualize the histological heterogeneity within the CNB. Conclusion: Our results indicate that MIL-assisted SRS microscopy provides rapid and accurate diagnosis on histologically heterogeneous breast CNB, and could potentially help the subsequent management of patients.

medicine, research & experimental
An Intelligent Diagnosis Method of Brain MRI Tumor Segmentation Using Deep Convolutional Neural Network and SVM Algorithm

Wentao Wu,Daning Li,Jiaoyang Du,Xiangyu Gao,Wen Gu,Fanfan Zhao,Xiaojie Feng,Hong Yan

DOI: https://doi.org/10.1155/2020/6789306

IF: 2.809

2020-07-14

Computational and Mathematical Methods in Medicine

Abstract:Among the currently proposed brain segmentation methods, brain tumor segmentation methods based on traditional image processing and machine learning are not ideal enough. Therefore, deep learning-based brain segmentation methods are widely used. In the brain tumor segmentation method based on deep learning, the convolutional network model has a good brain segmentation effect. The deep convolutional network model has the problems of a large number of parameters and large loss of information in the encoding and decoding process. This paper proposes a deep convolutional neural network fusion support vector machine algorithm (DCNN-F-SVM). The proposed brain tumor segmentation model is mainly divided into three stages. In the first stage, a deep convolutional neural network is trained to learn the mapping from image space to tumor marker space. In the second stage, the predicted labels obtained from the deep convolutional neural network training are input into the integrated support vector machine classifier together with the test images. In the third stage, a deep convolutional neural network and an integrated support vector machine are connected in series to train a deep classifier. Run each model on the BraTS dataset and the self-made dataset to segment brain tumors. The segmentation results show that the performance of the proposed model is significantly better than the deep convolutional neural network and the integrated SVM classifier.

mathematical & computational biology
Rapid histology of laryngeal squamous cell carcinoma with deep-learning based stimulated Raman scattering microscopy

Lili Zhang,Yongzheng Wu,Bin Zheng,Lizhong Su,Yuan Chen,Shuang Ma,Qinqin Hu,Xiang Zou,Lie Yao,Yinlong Yang,Liang Chen,Ying Mao,Yan Chen,Minbiao Ji

DOI: https://doi.org/10.7150/thno.32655

IF: 11.6

2019-04-13

Theranostics

Abstract:Maximal resection of tumor while preserving the adjacent healthy tissue is particularly important for larynx surgery, hence precise and rapid intraoperative histology of laryngeal tissue is crucial for providing optimal surgical outcomes. We hypothesized that deep-learning based stimulated Raman scattering (SRS) microscopy could provide automated and accurate diagnosis of laryngeal squamous cell carcinoma on fresh, unprocessed surgical specimens without fixation, sectioning or staining. Methods: We first compared 80 pairs of adjacent frozen sections imaged with SRS and standard hematoxylin and eosin histology to evaluate their concordance. We then applied SRS imaging on fresh surgical tissues from 45 patients to reveal key diagnostic features, based on which we have constructed a deep learning based model to generate automated histologic results. 18,750 SRS fields of views were used to train and cross-validate our 34-layered residual convolutional neural network, which was used to classify 33 untrained fresh larynx surgical samples into normal and neoplasia. Furthermore, we simulated intraoperative evaluation of resection margins on totally removed larynxes. Results: We demonstrated near-perfect diagnostic concordance (Cohen's kappa, κ > 0.90) between SRS and standard histology as evaluated by three pathologists. And deep-learning based SRS correctly classified 33 independent surgical specimens with 100% accuracy. We also demonstrated that our method could identify tissue neoplasia at the simulated resection margins that appear grossly normal with naked eyes. Conclusion: Our results indicated that SRS histology integrated with deep learning algorithm provides potential for delivering rapid intraoperative diagnosis that could aid the surgical management of laryngeal cancer.

Neuronal ATP receptors and their mechanism of action.

Analysis of Intraoperative Microscopy Imaging Techniques and Their Future Applications

Real-time Image Guidance for Brain Tumor Surgery Through Stimulated Raman Scattering Microscopy

Rapid, Label-Free Detection of Brain Tumors with Stimulated Raman Scattering Microscopy

Novel rapid intraoperative qualitative tumor detection by a residual convolutional neural network using label-free stimulated Raman scattering microscopy

Instant Diagnosis of Gastroscopic Biopsy Via Deep-Learned Single-Shot Femtosecond Stimulated Raman Histology

Nimg-18. Rapid Intraoperative Differentiation Of Primary Cns Lymphoma From Common Cns Tumors Using Stimulated Raman Histology And Deep Learning

Randomized controlled trial of high-dose sublingual immunotherapy to treat seasonal allergic rhinitis.

OpenSRH: optimizing brain tumor surgery using intraoperative stimulated Raman histology

Virtual formalin-fixed and paraffin-embedded staining of fresh brain tissue via stimulated Raman CycleGAN model

In vivo Dilatation of the Fetal and Postnatal Ductus Arteriosus by Inhibition of Phosphodiesterase 3 in Rats

Stimulated Raman Scattering Microscopy Enables Gleason Scoring of Prostate Core Needle Biopsy by a Convolutional Neural Network

Intra-operative Brain Tumor Detection with Deep Learning-Optimized Hyperspectral Imaging

Rapid Automated Analysis of Skull Base Tumor Specimens Using Intraoperative Optical Imaging and Artificial Intelligence

Stimulated Raman Scattering Microscopy for Rapid Brain Tumor Histology

Rapid intraoperative histology of unprocessed surgical specimens via fibre-laser-based stimulated Raman scattering microscopy

SURG-13. STIMULATED RAMAN SCATTERING MICROSCOPY PROVIDES DIAGNOSTIC INTRAOPERATIVE HISTOPATHOLOGIC IMAGES IN BRAIN TUMOR PATIENTS

High-Precision Intelligent Cancer Diagnosis Method: 2D Raman Figures Combined with Deep Learning

Histological diagnosis of unprocessed breast core-needle biopsy via stimulated Raman scattering microscopy and multi-instance learning

An Intelligent Diagnosis Method of Brain MRI Tumor Segmentation Using Deep Convolutional Neural Network and SVM Algorithm

Rapid histology of laryngeal squamous cell carcinoma with deep-learning based stimulated Raman scattering microscopy