Context-Free Grammars, Differential Operators and Formal Power Series

William Y. C. Chen

DOI: https://doi.org/10.1016/0304-3975(93)90307-F

IF: 1.002

1993-08-30

Theoretical Computer Science

Abstract:

What problem does this paper attempt to address?

Artificial Classification of Cervical Squamous Lesions in ThinPrep Cytologic Tests Using a Deep Convolutional Neural Network.

Li Liu,Yuanhua Wang,Qiang Ma,Liwen Tan,Yi Wu,Jingjing Xiao

DOI: https://doi.org/10.3892/ol.2020.11974

2020-01-01

Oncology Letters

Abstract:The diagnosis of squamous cell carcinoma requires the accurate classification of cervical squamous lesions in the ThinPrep cytologic test (TCT). It primarily relies on a pathologist's interpretation under a microscope. Deep convolutional neural networks (DCNN) have played an increasingly important role in digital pathology. However, they have not been applied to diverse datasets and externally validated. In the present study, a DCNN model based on VGG16 and an ensemble training strategy (ETS) based on 5-fold cross-validation was employed to automatically classify normal and abnormal cervical squamous cells from a multi-center dataset. First, we collected a dataset comprising 82 TCT samples from four hospitals and fine-tuned our model twice on the dataset with and without the ETS. Then, we compared the classifications obtained from the models with those provided by two skilled pathologists to discriminate the performance of the models in terms of classification accuracy and efficiency. Finally, paired sample t-tests were used to validate the consistency between the classification provided by the proposed methods and that of the pathologists. The results showed that ETS slightly, though not significantly, improved the classification accuracy compared with that of the pathologists: P0=0.387>0.05 (DCNN without ETS vs. DCNN with ETS), P1=0.771>0.05 (DCNN with ETS vs. pathologist 1), P2=0.489>0.05 (DCNN with ETS vs. pathologist 2). The DCNN model was almost 6-fold faster than that of the pathologists. The accuracy of our automated scheme was similar to that of the pathologists, but a higher efficiency in the accurate identification of cervical squamous lesions was provided by the scheme. This result allows for wider and more efficient screening and may provide a replacement for pathologists in the future. Future research should address the viability of the practical implementation of such DCNN models in the laboratory setting.
Interpretable Classification from Skin Cancer Histology Slides Using Deep Learning: A Retrospective Multicenter Study

Peizhen Xie,Ke Zuo,Yu Zhang,Fangfang Li,Mingzhu Yin,Kai Lu

DOI: https://doi.org/10.48550/arXiv.1904.06156

2019-04-12

Abstract:For diagnosing melanoma, hematoxylin and eosin (H&E) stained tissue slides remains the gold standard. These images contain quantitative information in different magnifications. In the present study, we investigated whether deep convolutional neural networks can extract structural features of complex tissues directly from these massive size images in a patched way. In order to face the challenge arise from morphological diversity in histopathological slides, we built a multicenter database of 2241 digital whole-slide images from 1321 patients from 2008 to 2018. We trained both ResNet50 and Vgg19 using over 9.95 million patches by transferring learning, and test performance with two kinds of critical classifications: malignant melanomas versus benign nevi in separate and mixed magnification; and distinguish among nevi in maximum magnification. The CNNs achieves superior performance across both tasks, demonstrating an AI capable of classifying skin cancer in the analysis from histopathological images. For making the classifications reasonable, the visualization of CNN representations is furthermore used to identify cells between melanoma and nevi. Regions of interest (ROI) are also located which are significantly helpful, giving pathologists more support of correctly diagnosis.

Tissues and Organs,Artificial Intelligence
Large Scale Tissue Histopathology Image Classification, Segmentation, and Visualization Via Deep Convolutional Activation Features

Yan Xu,Zhipeng Jia,Liang-Bo Wang,Yuqing Ai,Fang Zhang,Maode Lai,Eric I-Chao Chang

DOI: https://doi.org/10.1186/s12859-017-1685-x

IF: 3.307

2017-01-01

BMC Bioinformatics

Abstract:Background Histopathology image analysis is a gold standard for cancer recognition and diagnosis. Automatic analysis of histopathology images can help pathologists diagnose tumor and cancer subtypes, alleviating the workload of pathologists. There are two basic types of tasks in digital histopathology image analysis: image classification and image segmentation. Typical problems with histopathology images that hamper automatic analysis include complex clinical representations, limited quantities of training images in a dataset, and the extremely large size of singular images (usually up to gigapixels). The property of extremely large size for a single image also makes a histopathology image dataset be considered large-scale, even if the number of images in the dataset is limited. Results In this paper, we propose leveraging deep convolutional neural network (CNN) activation features to perform classification, segmentation and visualization in large-scale tissue histopathology images. Our framework transfers features extracted from CNNs trained by a large natural image database, ImageNet, to histopathology images. We also explore the characteristics of CNN features by visualizing the response of individual neuron components in the last hidden layer. Some of these characteristics reveal biological insights that have been verified by pathologists. According to our experiments, the framework proposed has shown state-of-the-art performance on a brain tumor dataset from the MICCAI 2014 Brain Tumor Digital Pathology Challenge and a colon cancer histopathology image dataset. Conclusions The framework proposed is a simple, efficient and effective system for histopathology image automatic analysis. We successfully transfer ImageNet knowledge as deep convolutional activation features to the classification and segmentation of histopathology images with little training data. CNN features are significantly more powerful than expert-designed features.
Deep Learning Classification of Colorectal Lesions Based on Whole Slide Images

Sergey A. Soldatov,Danil M. Pashkov,Sergey A. Guda,Nikolay S. Karnaukhov,Alexander A. Guda,Alexander V. Soldatov

DOI: https://doi.org/10.3390/a15110398

2022-10-28

Algorithms

Abstract:Microscopic tissue analysis is the key diagnostic method needed for disease identification and choosing the best treatment regimen. According to the Global Cancer Observatory, approximately two million people are diagnosed with colorectal cancer each year, and an accurate diagnosis requires a significant amount of time and a highly qualified pathologist to decrease the high mortality rate. Recent development of artificial intelligence technologies and scanning microscopy introduced digital pathology into the field of cancer diagnosis by means of the whole-slide image (WSI). In this work, we applied deep learning methods to diagnose six types of colon mucosal lesions using convolutional neural networks (CNNs). As a result, an algorithm for the automatic segmentation of WSIs of colon biopsies was developed, implementing pre-trained, deep convolutional neural networks of the ResNet and EfficientNet architectures. We compared the classical method and one-cycle policy for CNN training and applied both multi-class and multi-label approaches to solve the classification problem. The multi-label approach was superior because some WSI patches may belong to several classes at once or to none of them. Using the standard one-vs-rest approach, we trained multiple binary classifiers. They achieved the receiver operator curve AUC in the range of 0.80–0.96. Other metrics were also calculated, such as accuracy, precision, sensitivity, specificity, negative predictive value, and F1-score. Obtained CNNs can support human pathologists in the diagnostic process and can be extended to other cancers after adding a sufficient amount of labeled data.
Convolutional Neural Networks for Classifying Cervical Cancer Types Using Histological Images

Yi-Xin Li,Feng Chen,Jiao-Jiao Shi,Yu-Li Huang,Mei Wang

DOI: https://doi.org/10.1007/s10278-022-00722-8

Abstract:Cervical cancer is the most common cancer among women worldwide. The diagnosis and classification of cancer are extremely important, as it influences the optimal treatment and length of survival. The objective was to develop and validate a diagnosis system based on convolutional neural networks (CNN) that identifies cervical malignancies and provides diagnostic interpretability. A total of 8496 labeled histology images were extracted from 229 cervical specimens (cervical squamous cell carcinoma, SCC, n = 37; cervical adenocarcinoma, AC, n = 8; nonmalignant cervical tissues, n = 184). AlexNet, VGG-19, Xception, and ResNet-50 with five-fold cross-validation were constructed to distinguish cervical cancer images from nonmalignant images. The performance of CNNs was quantified in terms of accuracy, precision, recall, and the area under the receiver operating curve (AUC). Six pathologists were recruited to make a comparison with the performance of CNNs. Guided Backpropagation and Gradient-weighted Class Activation Mapping (Grad-CAM) were deployed to highlight the area of high malignant probability. The Xception model had excellent performance in identifying cervical SCC and AC in test sets. For cervical SCC, AUC was 0.98 (internal validation) and 0.974 (external validation). For cervical AC, AUC was 0.966 (internal validation) and 0.958 (external validation). The performance of CNNs falls between experienced and inexperienced pathologists. Grad-CAM and Guided Gard-CAM ensured diagnoses interpretability by highlighting morphological features of malignant changes. CNN is efficient for histological image classification tasks of distinguishing cervical malignancies from benign tissues and could highlight the specific areas of concern. All these findings suggest that CNNs could serve as a diagnostic tool to aid pathologic diagnosis.
Patch-based Convolutional Neural Network for Whole Slide Tissue Image Classification

Le Hou,Dimitris Samaras,Tahsin M. Kurc,Yi Gao,James E. Davis,Joel H. Saltz

DOI: https://doi.org/10.48550/arXiv.1504.07947

2016-03-09

Abstract:Convolutional Neural Networks (CNN) are state-of-the-art models for many image classification tasks. However, to recognize cancer subtypes automatically, training a CNN on gigapixel resolution Whole Slide Tissue Images (WSI) is currently computationally impossible. The differentiation of cancer subtypes is based on cellular-level visual features observed on image patch scale. Therefore, we argue that in this situation, training a patch-level classifier on image patches will perform better than or similar to an image-level classifier. The challenge becomes how to intelligently combine patch-level classification results and model the fact that not all patches will be discriminative. We propose to train a decision fusion model to aggregate patch-level predictions given by patch-level CNNs, which to the best of our knowledge has not been shown before. Furthermore, we formulate a novel Expectation-Maximization (EM) based method that automatically locates discriminative patches robustly by utilizing the spatial relationships of patches. We apply our method to the classification of glioma and non-small-cell lung carcinoma cases into subtypes. The classification accuracy of our method is similar to the inter-observer agreement between pathologists. Although it is impossible to train CNNs on WSIs, we experimentally demonstrate using a comparable non-cancer dataset of smaller images that a patch-based CNN can outperform an image-based CNN.

Computer Vision and Pattern Recognition
A deep dive into understanding tumor foci classification using multiparametric MRI based on convolutional neural network

Weiwei Zong,Joon K. Lee,Chang Liu,Eric N. Carver,Aharon M. Feldman,Branislava Janic,Mohamed A. Elshaikh,Milan V. Pantelic,David Hearshen,Indrin J. Chetty,Benjamin Movsas,Ning Wen

DOI: https://doi.org/10.1002/mp.14255

IF: 4.506

2020-06-12

Medical Physics

Abstract:<section class="article-section__content"><h3 class="article-section__sub-title section1"> Purpose</h3><p>Deep learning models have had a great success in disease classifications using large data pools of skin cancer images or lung X‐rays. However, data scarcity has been the roadblock of applying deep learning models directly on prostate multiparametric MRI (mpMRI). Although model interpretation has been heavily studied for natural images for the past few years, there has been a lack of interpretation of deep learning models trained on medical images.</p><p>In this paper, an efficient convolutional neural network (CNN) was developed and the model interpretation at various convolutional layers was systematically analyzed to improve the understanding of how CNN interprets multimodality medical images and the predictive powers of features at each layer. The problem of small sample size was addressed by feeding the intermediate features into a traditional classification algorithm known as weighted extreme learning machine (wELM), with imbalanced distribution among output categories taken into consideration.</p></section><section class="article-section__content"><h3 class="article-section__sub-title section1"> Methods</h3><p>The training data collection used a retrospective set of prostate MR studies, from SPIE‐AAPM‐NCI PROSTATEx Challenges held in 2017. Three hundred twenty biopsy samples of lesions from 201 prostate cancer patients were diagnosed and identified as clinically significant (malignant) or not significant (benign). All studies included T2‐weighted (T2W), proton density‐weighted (PD‐W), dynamic contrast enhanced (DCE) and diffusion‐weighted (DW) imaging. After registration and lesion‐based normalization, a CNN with four convolutional layers were developed and trained on 10‐fold cross validation. The features from intermediate layers were then extracted as input to wELM to test the discriminative power of each individual layer. The best performing model from the 10 folds was chosen to be tested on the holdout cohort from two sources. Feature maps after each convolutional layer were then visualized to monitor the trend, as the layer propagated. Scatter plotting was used to visualize the transformation of data distribution. Finally, a class activation map was generated to highlight the region of interest based on the model perspective.</p></section><section class="article-section__content"><h3 class="article-section__sub-title section1"> Results</h3><p>Experimental trials indicated that the best input for CNN was a modality combination of T2W, apparent diffusion coefficient (ADC) and DWIb50. The convolutional features from CNN paired with a weighted extreme learning classifier showed substantial performance compared to a CNN end‐to‐end training model. The feature map visualization reveals similar findings on natural images where lower layers tend to learn lower level features such as edges, intensity changes, etc, while higher layers learn more abstract and task‐related concept such as the lesion region. The generated saliency map revealed that the model was able to focus on the region of interest where the lesion resided and filter out background information, including prostate boundary, rectum, etc.</p></section><section class="article-section__content"><h3 class="article-section__sub-title section1"> Conclusions</h3><p>This work designs a customized workflow for the small and imbalanced data set of prostate mpMRI where features were extracted from a deep learning model and then analyzed by a traditional machine learning classifier. In addition, this work contributes to revealing how deep learning models interpret mpMRI for prostate cancer patients stratification.</p></section>

radiology, nuclear medicine & medical imaging
Digital mammographic tumor classification using transfer learning from deep convolutional neural networks

Benjamin Q. Huynh,Hui Li,Maryellen L. Giger

DOI: https://doi.org/10.1117/1.jmi.3.3.034501

2016-08-22

Journal of Medical Imaging

Abstract:Convolutional neural networks (CNNs) show potential for computer-aided diagnosis (CADx) by learning features directly from the image data instead of using analytically extracted features. However, CNNs are difficult to train from scratch for medical images due to small sample sizes and variations in tumor presentations. Instead, transfer learning can be used to extract tumor information from medical images via CNNs originally pretrained for nonmedical tasks, alleviating the need for large datasets. Our database includes 219 breast lesions (607 full-field digital mammographic images). We compared support vector machine classifiers based on the CNN-extracted image features and our prior computer-extracted tumor features in the task of distinguishing between benign and malignant breast lesions. Five-fold cross validation (by lesion) was conducted with the area under the receiver operating characteristic (ROC) curve as the performance metric. Results show that classifiers based on CNN-extracted features (with transfer learning) perform comparably to those using analytically extracted features [area under the ROC curve [Formula: see text]]. Further, the performance of ensemble classifiers based on both types was significantly better than that of either classifier type alone ([Formula: see text] versus 0.81, [Formula: see text]). We conclude that transfer learning can improve current CADx methods while also providing standalone classifiers without large datasets, facilitating machine-learning methods in radiomics and precision medicine.
Hierarchical Deep Convolutional Neural Networks for Multi-category Diagnosis of Gastrointestinal Disorders on Histopathological Images

Rasoul Sali,Sodiq Adewole,Lubaina Ehsan,Lee A. Denson,Paul Kelly,Beatrice C. Amadi,Lori Holtz,Syed Asad Ali,Sean R. Moore,Sana Syed,Donald E. Brown

DOI: https://doi.org/10.48550/arXiv.2005.03868

2020-08-07

Abstract:Deep convolutional neural networks(CNNs) have been successful for a wide range of computer vision tasks, including image classification. A specific area of the application lies in digital pathology for pattern recognition in the tissue-based diagnosis of gastrointestinal(GI) diseases. This domain can utilize CNNs to translate histopathological images into precise diagnostics. This is challenging since these complex biopsies are heterogeneous and require multiple levels of assessment. This is mainly due to structural similarities in different parts of the GI tract and shared features among different gut diseases. Addressing this problem with a flat model that assumes all classes (parts of the gut and their diseases) are equally difficult to distinguish leads to an inadequate assessment of each class. Since the hierarchical model restricts classification error to each sub-class, it leads to a more informative model than a flat model. In this paper, we propose to apply the hierarchical classification of biopsy images from different parts of the GI tract and the receptive diseases within each. We embedded a class hierarchy into the plain VGGNet to take advantage of its layers' hierarchical structure. The proposed model was evaluated using an independent set of image patches from 373 whole slide images. The results indicate that the hierarchical model can achieve better results than the flat model for multi-category diagnosis of GI disorders using histopathological images.

Image and Video Processing,Machine Learning
Deep learning classification of lung cancer histology using CT images

Tafadzwa L Chaunzwa,Ahmed Hosny,Yiwen Xu,Andrea Shafer,Nancy Diao,Michael Lanuti,David C Christiani,Raymond H Mak,Hugo J W L Aerts

DOI: https://doi.org/10.1038/s41598-021-84630-x

2021-03-09

Abstract:Tumor histology is an important predictor of therapeutic response and outcomes in lung cancer. Tissue sampling for pathologist review is the most reliable method for histology classification, however, recent advances in deep learning for medical image analysis allude to the utility of radiologic data in further describing disease characteristics and for risk stratification. In this study, we propose a radiomics approach to predicting non-small cell lung cancer (NSCLC) tumor histology from non-invasive standard-of-care computed tomography (CT) data. We trained and validated convolutional neural networks (CNNs) on a dataset comprising 311 early-stage NSCLC patients receiving surgical treatment at Massachusetts General Hospital (MGH), with a focus on the two most common histological types: adenocarcinoma (ADC) and Squamous Cell Carcinoma (SCC). The CNNs were able to predict tumor histology with an AUC of 0.71(p = 0.018). We also found that using machine learning classifiers such as k-nearest neighbors (kNN) and support vector machine (SVM) on CNN-derived quantitative radiomics features yielded comparable discriminative performance, with AUC of up to 0.71 (p = 0.017). Our best performing CNN functioned as a robust probabilistic classifier in heterogeneous test sets, with qualitatively interpretable visual explanations to its predictions. Deep learning based radiomics can identify histological phenotypes in lung cancer. It has the potential to augment existing approaches and serve as a corrective aid for diagnosticians.
Exploring the interplay between colorectal cancer subtypes genomic variants and cellular morphology: A deep-learning approach

Hadar Hezi,Daniel Shats,Daniel Gurevich,Yosef E Maruvka,Moti Freiman

DOI: https://doi.org/10.1371/journal.pone.0309380

IF: 3.7

2024-09-10

PLoS ONE

Abstract:Molecular subtypes of colorectal cancer (CRC) significantly influence treatment decisions. While convolutional neural networks (CNNs) have recently been introduced for automated CRC subtype identification using H&E stained histopathological images, the correlation between CRC subtype genomic variants and their corresponding cellular morphology expressed by their imaging phenotypes is yet to be fully explored. The goal of this study was to determine such correlations by incorporating genomic variants in CNN models for CRC subtype classification from H&E images. We utilized the publicly available TCGA-CRC-DX dataset, which comprises whole slide images from 360 CRC-diagnosed patients (260 for training and 100 for testing). This dataset also provides information on CRC subtype classifications and genomic variations. We trained CNN models for CRC subtype classification that account for potential correlation between genomic variations within CRC subtypes and their corresponding cellular morphology patterns. We assessed the interplay between CRC subtypes' genomic variations and cellular morphology patterns by evaluating the CRC subtype classification accuracy of the different models in a stratified 5-fold cross-validation experimental setup using the area under the ROC curve (AUROC) and average precision (AP) as the performance metrics. The CNN models that account for potential correlation between genomic variations within CRC subtypes and their cellular morphology pattern achieved superior accuracy compared to the baseline CNN classification model that does not account for genomic variations when using either single-nucleotide-polymorphism (SNP) molecular features (AUROC: 0.824±0.02 vs. 0.761±0.04, p<0.05, AP: 0.652±0.06 vs. 0.58±0.08) or CpG-Island methylation phenotype (CIMP) molecular features (AUROC: 0.834±0.01 vs. 0.787±0.03, p<0.05, AP: 0.687±0.02 vs. 0.64±0.05). Combining the CNN models account for variations in CIMP and SNP further improved classification accuracy (AUROC: 0.847±0.01 vs. 0.787±0.03, p = 0.01, AP: 0.68±0.02 vs. 0.64±0.05). The improved accuracy of CNN models for CRC subtype classification that account for potential correlation between genomic variations within CRC subtypes and their corresponding cellular morphology as expressed by H&E imaging phenotypes may elucidate the biological cues impacting cancer histopathological imaging phenotypes. Moreover, considering CRC subtypes genomic variations has the potential to improve the accuracy of deep-learning models in discerning cancer subtype from histopathological imaging data.
Context-aware stacked convolutional neural networks for classification of breast carcinomas in whole-slide histopathology images

Babak Ehteshami Bejnordi,Guido Zuidhof,Maschenka Balkenhol,Meyke Hermsen,Peter Bult,Bram van Ginneken,Nico Karssemeijer,Geert Litjens,Jeroen van der Laak

DOI: https://doi.org/10.1117/1.jmi.4.4.044504

2017-12-14

Journal of Medical Imaging

Abstract:Currently, histopathological tissue examination by a pathologist represents the gold standard for breast lesion diagnostics. Automated classification of histopathological whole-slide images (WSIs) is challenging owing to the wide range of appearances of benign lesions and the visual similarity of ductal carcinoma <i>in-situ</i> (DCIS) to invasive lesions at the cellular level. Consequently, analysis of tissue at high resolutions with a large contextual area is necessary. We present context-aware stacked convolutional neural networks (CNN) for classification of breast WSIs into normal/benign, DCIS, and invasive ductal carcinoma (IDC). We first train a CNN using high pixel resolution to capture cellular level information. The feature responses generated by this model are then fed as input to a second CNN, stacked on top of the first. Training of this stacked architecture with large input patches enables learning of fine-grained (cellular) details and global tissue structures. Our system is trained and evaluated on a dataset containing 221 WSIs of hematoxylin and eosin stained breast tissue specimens. The system achieves an AUC of 0.962 for the binary classification of nonmalignant and malignant slides and obtains a three-class accuracy of 81.3% for classification of WSIs into normal/benign, DCIS, and IDC, demonstrating its potential for routine diagnostics.
Pan-cancer computational histopathology reveals mutations, tumor composition and prognosis

Yu Fu,Alexander W. Jung,Ramon Viñas Torne,Santiago Gonzalez,Harald Vöhringer,Artem Shmatko,Lucy R. Yates,Mercedes Jimenez-Linan,Luiza Moore,Moritz Gerstung

DOI: https://doi.org/10.1038/s43018-020-0085-8

IF: 22.7

2020-07-27

Nature Cancer

Abstract:We use deep transfer learning to quantify histopathological patterns across 17,355 hematoxylin and eosin-stained histopathology slide images from 28 cancer types and correlate these with matched genomic, transcriptomic and survival data. This approach accurately classifies cancer types and provides spatially resolved tumor and normal tissue distinction. Automatically learned computational histopathological features correlate with a large range of recurrent genetic aberrations across cancer types. This includes whole-genome duplications, which display universal features across cancer types, individual chromosomal aneuploidies, focal amplifications and deletions, as well as driver gene mutations. There are widespread associations between bulk gene expression levels and histopathology, which reflect tumor composition and enable the localization of transcriptomically defined tumor-infiltrating lymphocytes. Computational histopathology augments prognosis based on histopathological subtyping and grading, and highlights prognostically relevant areas such as necrosis or lymphocytic aggregates. These findings show the remarkable potential of computer vision in characterizing the molecular basis of tumor histopathology.
Convolutional neural network classification of cancer cytopathology images: taking breast cancer as an example

MingXuan Xiao,Yufeng Li,Xu Yan,Min Gao,Weimin Wang

2024-04-12

Abstract:Breast cancer is a relatively common cancer among gynecological cancers. Its diagnosis often relies on the pathology of cells in the lesion. The pathological diagnosis of breast cancer not only requires professionals and time, but also sometimes involves subjective judgment. To address the challenges of dependence on pathologists expertise and the time-consuming nature of achieving accurate breast pathological image classification, this paper introduces an approach utilizing convolutional neural networks (CNNs) for the rapid categorization of pathological images, aiming to enhance the efficiency of breast pathological image detection. And the approach enables the rapid and automatic classification of pathological images into benign and malignant groups. The methodology involves utilizing a convolutional neural network (CNN) model leveraging the Inceptionv3 architecture and transfer learning algorithm for extracting features from pathological images. Utilizing a neural network with fully connected layers and employing the SoftMax function for image classification. Additionally, the concept of image partitioning is introduced to handle high-resolution images. To achieve the ultimate classification outcome, the classification probabilities of each image block are aggregated using three algorithms: summation, product, and maximum. Experimental validation was conducted on the BreaKHis public dataset, resulting in accuracy rates surpassing 0.92 across all four magnification coefficients (40X, 100X, 200X, and 400X). It demonstrates that the proposed method effectively enhances the accuracy in classifying pathological images of breast cancer.

Image and Video Processing,Computer Vision and Pattern Recognition,Machine Learning
Histographs: Graphs in Histopathology

Shrey Gadiya,Deepak Anand,Amit Sethi

DOI: https://doi.org/10.48550/arXiv.1908.05020

2019-08-14

Image and Video Processing

Abstract:Spatial arrangement of cells of various types, such as tumor infiltrating lymphocytes and the advancing edge of a tumor, are important features for detecting and characterizing cancers. However, convolutional neural networks (CNNs) do not explicitly extract intricate features of the spatial arrangements of the cells from histopathology images. In this work, we propose to classify cancers using graph convolutional networks (GCNs) by modeling a tissue section as a multi-attributed spatial graph of its constituent cells. Cells are detected using their nuclei in H&E stained tissue image, and each cell's appearance is captured as a multi-attributed high-dimensional vertex feature. The spatial relations between neighboring cells are captured as edge features based on their distances in a graph. We demonstrate the utility of this approach by obtaining classification accuracy that is competitive with CNNs, specifically, Inception-v3, on two tasks-cancerous versus non-cancerous and in situ versus invasive-on the BACH breast cancer dataset.
Classification of Histopathology Images of Lung Cancer Using Convolutional Neural Network (CNN)

Neha Baranwal,Preethi Doravari,Renu Kachhoria

DOI: https://doi.org/10.48550/arXiv.2112.13553

2021-12-27

Image and Video Processing

Abstract:Cancer is the uncontrollable cell division of abnormal cells inside the human body, which can spread to other body organs. It is one of the non-communicable diseases (NCDs) and NCDs accounts for 71% of total deaths worldwide whereas lung cancer is the second most diagnosed cancer after female breast cancer. Cancer survival rate of lung cancer is only 19%. There are various methods for the diagnosis of lung cancer, such as X-ray, CT scan, PET-CT scan, bronchoscopy and biopsy. However, to know the subtype of lung cancer based on the tissue type H and E staining is widely used, where the staining is done on the tissue aspirated from a biopsy. Studies have reported that the type of histology is associated with prognosis and treatment in lung cancer. Therefore, early and accurate detection of lung cancer histology is an urgent need and as its treatment is dependent on the type of histology, molecular profile and stage of the disease, it is most essential to analyse the histopathology images of lung cancer. Hence, to speed up the vital process of diagnosis of lung cancer and reduce the burden on pathologists, Deep learning techniques are used. These techniques have shown improved efficacy in the analysis of histopathology slides of cancer. Several studies reported the importance of convolution neural networks (CNN) in the classification of histopathological pictures of various cancer types such as brain, skin, breast, lung, colorectal cancer. In this study tri-category classification of lung cancer images (normal, adenocarcinoma and squamous cell carcinoma) are carried out by using ResNet 50, VGG-19, Inception_ResNet_V2 and DenseNet for the feature extraction and triplet loss to guide the CNN such that it increases inter-cluster distance and reduces intra-cluster distance.
Harnessing Deep Learning for Accurate Pathological Assessment of Brain Tumor Cell Types

Chongxuan Tian,Yue Xi,Yuting Ma,Cai Chen,Cong Wu,Kun Ru,Wei Li,Miaoqing Zhao

DOI: https://doi.org/10.1007/s10278-024-01107-9

2024-08-16

Abstract:Primary diffuse central nervous system large B-cell lymphoma (CNS-pDLBCL) and high-grade glioma (HGG) often present similarly, clinically and on imaging, making differentiation challenging. This similarity can complicate pathologists' diagnostic efforts, yet accurately distinguishing between these conditions is crucial for guiding treatment decisions. This study leverages a deep learning model to classify brain tumor pathology images, addressing the common issue of limited medical imaging data. Instead of training a convolutional neural network (CNN) from scratch, we employ a pre-trained network for extracting deep features, which are then used by a support vector machine (SVM) for classification. Our evaluation shows that the Resnet50 (TL + SVM) model achieves a 97.4% accuracy, based on tenfold cross-validation on the test set. These results highlight the synergy between deep learning and traditional diagnostics, potentially setting a new standard for accuracy and efficiency in the pathological diagnosis of brain tumors.
BCCHI-HCNN: Breast Cancer Classification from Histopathological Images Using Hybrid Deep CNN Models

Saroj Kumar Pandey,Yogesh Kumar Rathore,Manoj Kumar Ojha,Rekh Ram Janghel,Anurag Sinha,Ankit Kumar

DOI: https://doi.org/10.1007/s10278-024-01297-2

2024-10-14

Abstract:Breast cancer is the most common cancer in women globally, imposing a significant burden on global public health due to high death rates. Data from the World Health Organization show an alarming annual incidence of nearly 2.3 million new cases, drawing the attention of patients, healthcare professionals, and governments alike. Through the examination of histopathological pictures, this study aims to revolutionize the early and precise identification of breast cancer by utilizing the capabilities of a deep convolutional neural network (CNN)-based model. The model's performance is improved by including numerous classifiers, including support vector machine (SVM), decision tree, and K-nearest neighbors (KNN), using transfer learning techniques. The studies include evaluating two separate feature vectors, one with and one without principal component analysis (PCA). Extensive comparisons are made to measure the model's performance against current deep learning models, including critical metrics such as false positive rate, true positive rate, accuracy, precision, and recall. The data show that the SVM algorithm with PCA features achieves excellent speed and accuracy, with an amazing accuracy of 99.5%. Furthermore, although being somewhat slower than SVM, the decision tree model has the greatest accuracy of 99.4% without PCA. This study suggests a viable strategy for improving early breast cancer diagnosis, opening the path for more effective healthcare treatments and better patient outcomes.
Classification of multi‐feature fusion ultrasound images of breast tumor within category 4 using convolutional neural networks

Pengfei Xu,Jing Zhao,Mingxi Wan,Qing Song,Qiang Su,Diya Wang

DOI: https://doi.org/10.1002/mp.16946

IF: 4.506

2024-03-06

Medical Physics

Abstract:Background Breast tumor is a fatal threat to the health of women. Ultrasound (US) is a common and economical method for the diagnosis of breast cancer. Breast imaging reporting and data system (BI‐RADS) category 4 has the highest false‐positive value of about 30% among five categories. The classification task in BI‐RADS category 4 is challenging and has not been fully studied. Purpose This work aimed to use convolutional neural networks (CNNs) for breast tumor classification using B‐mode images in category 4 to overcome the dependence on operator and artifacts. Additionally, this work intends to take full advantage of morphological and textural features in breast tumor US images to improve classification accuracy. Methods First, original US images coming directly from the hospital were cropped and resized. In 1385 B‐mode US BI‐RADS category 4 images, the biopsy eliminated 503 samples of benign tumor and left 882 of malignant. Then, K‐means clustering algorithm and entropy of sliding windows of US images were conducted. Considering the diversity of different characteristic information of malignant and benign represented by original B‐mode images, K‐means clustering images and entropy images, they are fused in a three‐channel form multi‐feature fusion images dataset. The training, validation, and test sets are 969, 277, and 139. With transfer learning, 11 CNN models including DenseNet and ResNet were investigated. Finally, by comparing accuracy, precision, recall, F1‐score, and area under curve (AUC) of the results, models which had better performance were selected. The normality of data was assessed by Shapiro‐Wilk test. DeLong test and independent t‐test were used to evaluate the significant difference of AUC and other values. False discovery rate was utilized to ultimately evaluate the advantages of CNN with highest evaluation metrics. In addition, the study of anti‐log compression was conducted but no improvement has shown in CNNs classification results. Results With multi‐feature fusion images, DenseNet121 has highest accuracy of 80.22 ± 1.45% compared to other CNNs, precision of 77.97 ± 2.89% and AUC of 0.82 ± 0.01. Multi‐feature fusion improved accuracy of DenseNet121 by 1.87% from classification of original B‐mode images (p

radiology, nuclear medicine & medical imaging
Improving Performance in Colorectal Cancer Histology Decomposition using Deep and Ensemble Machine Learning

Fabi Prezja,Leevi Annala,Sampsa Kiiskinen,Suvi Lahtinen,Timo Ojala,Pekka Ruusuvuori,Teijo Kuopio

DOI: https://doi.org/10.1016/j.heliyon.2024.e37561

2024-09-25

Abstract:In routine colorectal cancer management, histologic samples stained with hematoxylin and eosin are commonly used. Nonetheless, their potential for defining objective biomarkers for patient stratification and treatment selection is still being explored. The current gold standard relies on expensive and time-consuming genetic tests. However, recent research highlights the potential of convolutional neural networks (CNNs) in facilitating the extraction of clinically relevant biomarkers from these readily available images. These CNN-based biomarkers can predict patient outcomes comparably to golden standards, with the added advantages of speed, automation, and minimal cost. The predictive potential of CNN-based biomarkers fundamentally relies on the ability of convolutional neural networks (CNNs) to classify diverse tissue types from whole slide microscope images accurately. Consequently, enhancing the accuracy of tissue class decomposition is critical to amplifying the prognostic potential of imaging-based biomarkers. This study introduces a hybrid Deep and ensemble machine learning model that surpassed all preceding solutions for this classification task. Our model achieved 96.74% accuracy on the external test set and 99.89% on the internal test set. Recognizing the potential of these models in advancing the task, we have made them publicly available for further research and development.

Quantitative Methods,Computer Vision and Pattern Recognition

Context-Free Grammars, Differential Operators and Formal Power Series

Artificial Classification of Cervical Squamous Lesions in ThinPrep Cytologic Tests Using a Deep Convolutional Neural Network.

Interpretable Classification from Skin Cancer Histology Slides Using Deep Learning: A Retrospective Multicenter Study

Large Scale Tissue Histopathology Image Classification, Segmentation, and Visualization Via Deep Convolutional Activation Features

Deep Learning Classification of Colorectal Lesions Based on Whole Slide Images

Convolutional Neural Networks for Classifying Cervical Cancer Types Using Histological Images

Patch-based Convolutional Neural Network for Whole Slide Tissue Image Classification

A deep dive into understanding tumor foci classification using multiparametric MRI based on convolutional neural network

Digital mammographic tumor classification using transfer learning from deep convolutional neural networks

Hierarchical Deep Convolutional Neural Networks for Multi-category Diagnosis of Gastrointestinal Disorders on Histopathological Images

Deep learning classification of lung cancer histology using CT images

Exploring the interplay between colorectal cancer subtypes genomic variants and cellular morphology: A deep-learning approach

Context-aware stacked convolutional neural networks for classification of breast carcinomas in whole-slide histopathology images

Pan-cancer computational histopathology reveals mutations, tumor composition and prognosis

Convolutional neural network classification of cancer cytopathology images: taking breast cancer as an example

Histographs: Graphs in Histopathology

Classification of Histopathology Images of Lung Cancer Using Convolutional Neural Network (CNN)

Harnessing Deep Learning for Accurate Pathological Assessment of Brain Tumor Cell Types

BCCHI-HCNN: Breast Cancer Classification from Histopathological Images Using Hybrid Deep CNN Models

Classification of multi‐feature fusion ultrasound images of breast tumor within category 4 using convolutional neural networks

Improving Performance in Colorectal Cancer Histology Decomposition using Deep and Ensemble Machine Learning