A useful route to (R)- and (S)-tert-leucine.

S. Allenmark,B. Lamm

DOI: https://doi.org/10.1002/1520-636X(2001)13:1<43::AID-CHIR9>3.0.CO;2-G

Chirality

Abstract:Resolution of 1-(2-furyl)-2,2-dimethylpropylamine, an intermediate on a synthetic route to tert-leucine, followed by oxidation of the respective enantiomers, constitutes an interesting and useful strategy to (R)- and (S)-tert-leucine.

What problem does this paper attempt to address?

Deep Learning-Based Semantic Segmentation of Non-Melanocytic Skin Tumors in Whole-Slide Histopathological Images.

Linyan Wang,An Shao,Fengbo Huang,Zhengyun Liu,Yaqi Wang,Xingru Huang,Juan Ye

DOI: https://doi.org/10.1111/exd.14782

2023-01-01

Experimental Dermatology

Abstract:Basal cell carcinoma (BCC) and squamous cell carcinoma (SCC) are the two most common skin cancer and impose a huge medical burden on society. Histopathological examination based on whole-slide images (WSIs) remains to be the confirmatory diagnostic method for skin tumors. Accurate segmentation of tumor tissue in WSIs by deep-learning (DL) models can reduce the workload of pathologists and help surgeons ensure the complete removal of tumors. To accurately segment the tumor areas in WSIs of BCC, SCC and squamous cell papilloma (SCP, homologous to SCC) with robust models. We established a data set (ZJU-NMSC) containing 151 WSIs of BCC, SCC and SCP in total. Seven models were utilized to segment WSIs, including the state-of-the-art model, models proposed by us and other models. Dice score, intersection over union, accuracy, sensitivity and specificity were used to evaluate and compare the performance of different models. Heatmaps and tumor tissue masks were generated to reflect the results of the segmentation. The processing times of models are also recorded and compared. While the dice score of most models is higher than 0.85, deeplab v3+ has the best performance and the corresponding tumor tissue mask is more consistent with the ground truth tumor areas even with complex and small lobular lesions. This study broadens the use of DL-based segmentation models in WSIs of skin tumors in terms of tumor types and computational approaches. Segmenting tumor areas can simplify the process of histopathological inspection and benefit the diagnosis and following management of the diseases in practice.
Deep learning for multi-class semantic segmentation enables colorectal cancer detection and classification in digital pathology images

John-Melle Bokhorst,Iris D. Nagtegaal,Filippo Fraggetta,Simona Vatrano,Wilma Mesker,Michael Vieth,Jeroen van der Laak,Francesco Ciompi

DOI: https://doi.org/10.1038/s41598-023-35491-z

IF: 4.6

2023-05-24

Scientific Reports

Abstract:Abstract In colorectal cancer (CRC), artificial intelligence (AI) can alleviate the laborious task of characterization and reporting on resected biopsies, including polyps, the numbers of which are increasing as a result of CRC population screening programs ongoing in many countries all around the globe. Here, we present an approach to address two major challenges in the automated assessment of CRC histopathology whole-slide images. We present an AI-based method to segment multiple ( $$n=14$$ n = 14 ) tissue compartments in the H &E-stained whole-slide image, which provides a different, more perceptible picture of tissue morphology and composition. We test and compare a panel of state-of-the-art loss functions available for segmentation models, and provide indications about their use in histopathology image segmentation, based on the analysis of (a) a multi-centric cohort of CRC cases from five medical centers in the Netherlands and Germany, and (b) two publicly available datasets on segmentation in CRC. We used the best performing AI model as the basis for a computer-aided diagnosis system that classifies colon biopsies into four main categories that are relevant pathologically. We report the performance of this system on an independent cohort of more than 1000 patients. The results show that with a good segmentation network as a base, a tool can be developed which can support pathologists in the risk stratification of colorectal cancer patients, among other possible uses. We have made the segmentation model available for research use on https://grand-challenge.org/algorithms/colon-tissue-segmentation/ .

multidisciplinary sciences
An interpretable machine learning system for colorectal cancer diagnosis from pathology slides

Pedro C. Neto,Diana Montezuma,Sara P. Oliveira,Domingos Oliveira,João Fraga,Ana Monteiro,João Monteiro,Liliana Ribeiro,Sofia Gonçalves,Stefan Reinhard,Inti Zlobec,Isabel M. Pinto,Jaime S. Cardoso

DOI: https://doi.org/10.1038/s41698-024-00539-4

2024-03-05

npj Precision Oncology

Abstract:Abstract Considering the profound transformation affecting pathology practice, we aimed to develop a scalable artificial intelligence (AI) system to diagnose colorectal cancer from whole-slide images (WSI). For this, we propose a deep learning (DL) system that learns from weak labels, a sampling strategy that reduces the number of training samples by a factor of six without compromising performance, an approach to leverage a small subset of fully annotated samples, and a prototype with explainable predictions, active learning features and parallelisation. Noting some problems in the literature, this study is conducted with one of the largest WSI colorectal samples dataset with approximately 10,500 WSIs. Of these samples, 900 are testing samples. Furthermore, the robustness of the proposed method is assessed with two additional external datasets (TCGA and PAIP) and a dataset of samples collected directly from the proposed prototype. Our proposed method predicts, for the patch-based tiles, a class based on the severity of the dysplasia and uses that information to classify the whole slide. It is trained with an interpretable mixed-supervision scheme to leverage the domain knowledge introduced by pathologists through spatial annotations. The mixed-supervision scheme allowed for an intelligent sampling strategy effectively evaluated in several different scenarios without compromising the performance. On the internal dataset, the method shows an accuracy of 93.44% and a sensitivity between positive (low-grade and high-grade dysplasia) and non-neoplastic samples of 0.996. On the external test samples varied with TCGA being the most challenging dataset with an overall accuracy of 84.91% and a sensitivity of 0.996.

oncology
ColonNet: A novel polyp segmentation framework based on LK-RFB and GPPD

Dong Sui,Weifeng Liu,Yue Zhang,Yang Li,Gongning Luo,Kuanquan Wang,Maozu Guo

DOI: https://doi.org/10.1016/j.compbiomed.2023.107541

IF: 7.7

2023-10-07

Computers in Biology and Medicine

Abstract:Colorectal cancer (CRC) holds the distinction of being the most prevalent malignant tumor affecting the digestive system. It is a formidable global health challenge, as it ranks as the fourth leading cause of cancer-related fatalities around the world. Despite considerable advancements in comprehending and addressing colorectal cancer (CRC), the likelihood of recurring tumors and metastasis remains a major cause of high morbidity and mortality rates during treatment. Currently, colonoscopy is the predominant method for CRC screening . Artificial intelligence has emerged as a promising tool in aiding the diagnosis of polyps, which have demonstrated significant potential. Unfortunately, most segmentation methods face challenges in terms of limited accuracy and generalization to different datasets, especially the slow processing and analysis speed has become a major obstacle. In this study, we propose a fast and efficient polyp segmentation framework based on the Large-Kernel Receptive Field Block (LK-RFB) and Global Parallel Partial Decoder(GPPD). Our proposed ColonNet has been extensively tested and proven effective, achieving a DICE coefficient of over 0.910 and an FPS of over 102 on the CVC-300 dataset. In comparison to the state-of-the-art (SOTA) methods, ColonNet outperforms or achieves comparable performance on five publicly available datasets, establishing a new SOTA. Compared to state-of-the-art methods, ColonNet achieves the highest FPS (over 102 FPS) while maintaining excellent segmentation results, achieving the best or comparable performance on the five public datasets. The code will be released at: https://github.com/SPECTRELWF/ColonNet .

engineering, biomedical,computer science, interdisciplinary applications,mathematical & computational biology,biology
Multi-task learning for tissue segmentation and tumor detection in colorectal cancer histology slides

Lydia A. Schoenpflug,Maxime W. Lafarge,Anja L. Frei,Viktor H. Koelzer

2023-04-06

Abstract:Automating tissue segmentation and tumor detection in histopathology images of colorectal cancer (CRC) is an enabler for faster diagnostic pathology workflows. At the same time it is a challenging task due to low availability of public annotated datasets and high variability of image appearance. The semi-supervised learning for CRC detection (SemiCOL) challenge 2023 provides partially annotated data to encourage the development of automated solutions for tissue segmentation and tumor detection. We propose a U-Net based multi-task model combined with channel-wise and image-statistics-based color augmentations, as well as test-time augmentation, as a candidate solution to the SemiCOL challenge. Our approach achieved a multi-task Dice score of .8655 (Arm 1) and .8515 (Arm 2) for tissue segmentation and AUROC of .9725 (Arm 1) and 0.9750 (Arm 2) for tumor detection on the challenge validation set. The source code for our approach is made publicly available at <a class="link-external link-https" href="https://github.com/lely475/CTPLab_SemiCOL2023" rel="external noopener nofollow">this https URL</a>.

Image and Video Processing,Computer Vision and Pattern Recognition
Deep Learning Classification of Colorectal Lesions Based on Whole Slide Images

Sergey A. Soldatov,Danil M. Pashkov,Sergey A. Guda,Nikolay S. Karnaukhov,Alexander A. Guda,Alexander V. Soldatov

DOI: https://doi.org/10.3390/a15110398

2022-10-28

Algorithms

Abstract:Microscopic tissue analysis is the key diagnostic method needed for disease identification and choosing the best treatment regimen. According to the Global Cancer Observatory, approximately two million people are diagnosed with colorectal cancer each year, and an accurate diagnosis requires a significant amount of time and a highly qualified pathologist to decrease the high mortality rate. Recent development of artificial intelligence technologies and scanning microscopy introduced digital pathology into the field of cancer diagnosis by means of the whole-slide image (WSI). In this work, we applied deep learning methods to diagnose six types of colon mucosal lesions using convolutional neural networks (CNNs). As a result, an algorithm for the automatic segmentation of WSIs of colon biopsies was developed, implementing pre-trained, deep convolutional neural networks of the ResNet and EfficientNet architectures. We compared the classical method and one-cycle policy for CNN training and applied both multi-class and multi-label approaches to solve the classification problem. The multi-label approach was superior because some WSI patches may belong to several classes at once or to none of them. Using the standard one-vs-rest approach, we trained multiple binary classifiers. They achieved the receiver operator curve AUC in the range of 0.80–0.96. Other metrics were also calculated, such as accuracy, precision, sensitivity, specificity, negative predictive value, and F1-score. Obtained CNNs can support human pathologists in the diagnostic process and can be extended to other cancers after adding a sufficient amount of labeled data.
Automated risk classification of colon biopsies based on semantic segmentation of histopathology images

John-Melle Bokhorst,Iris D. Nagtegaal,Filippo Fraggetta,Simona Vatrano,Wilma Mesker,Michael Vieth,Jeroen van der Laak,Francesco Ciompi

DOI: https://doi.org/10.48550/arXiv.2109.07892

2021-09-16

Abstract:Artificial Intelligence (AI) can potentially support histopathologists in the diagnosis of a broad spectrum of cancer types. In colorectal cancer (CRC), AI can alleviate the laborious task of characterization and reporting on resected biopsies, including polyps, the numbers of which are increasing as a result of CRC population screening programs, ongoing in many countries all around the globe. Here, we present an approach to address two major challenges in automated assessment of CRC histopathology whole-slide images. First, we present an AI-based method to segment multiple tissue compartments in the H\&E-stained whole-slide image, which provides a different, more perceptible picture of tissue morphology and composition. We test and compare a panel of state-of-the-art loss functions available for segmentation models, and provide indications about their use in histopathology image segmentation, based on the analysis of a) a multi-centric cohort of CRC cases from five medical centers in the Netherlands and Germany, and b) two publicly available datasets on segmentation in CRC. Second, we use the best performing AI model as the basis for a computer-aided diagnosis system (CAD) that classifies colon biopsies into four main categories that are relevant pathologically. We report the performance of this system on an independent cohort of more than 1,000 patients. The results show the potential of such an AI-based system to assist pathologists in diagnosis of CRC in the context of population screening. We have made the segmentation model available for research use on <a class="link-external link-https" href="https://grand-challenge.org/algorithms/colon-tissue-segmentation/" rel="external noopener nofollow">this https URL</a>.

Image and Video Processing,Computer Vision and Pattern Recognition
SSN: A Stair-Shape Network for Real-Time Polyp Segmentation in Colonoscopy Images.

Ruiwei Feng,Biwen Lei,Wenzhe Wang,Tingting Chen,Jintai Chen,Danny Z. Chen,Jian Wu

DOI: https://doi.org/10.1109/isbi45749.2020.9098492

2020-01-01

Abstract:Colorectal cancer is one of the most life-threatening malignancies, commonly occurring from intestinal polyps. Currently, clinical colonoscopy exam is an effective way for early detection of polyps and is often conducted in real-time manner. But, colonoscopy analysis is time-consuming and suffers a high miss rate. In this paper, we develop a novel stair-shape network (SSN) for real-time polyp segmentation in colonoscopy images (not merely for simple detection). Our new model is much faster than U-Net, yet yields better performance for polyp segmentation. The model first utilizes four blocks to extract spatial features at the encoder stage. The subsequent skip connection with a Dual Attention Module for each block and a final Multi-scale Fusion Module are used to fully fuse features of different scales. Based on abundant data augmentation and strong supervision of auxiliary losses, our model can learn much more information for polyp segmentation. Our new polyp segmentation method attains high performance on several datasets (CVC-ColonDB, CVC-ClinicDB, and EndoScene), outperforming state-of-the-art methods. Our network can also be applied to other imaging tasks for real-time segmentation and clinical practice.
Deep learning system for true- and pseudo-invasion in colorectal polyps

Joe Yang,Lina Chen,Eric Liu,Boyu Wang,David K. Driman,Qi Zhang,Charles Ling

DOI: https://doi.org/10.1038/s41598-023-50681-5

IF: 4.6

2024-01-04

Scientific Reports

Abstract:Over 15 million colonoscopies were performed yearly in North America, during which biopsies were taken for pathological examination to identify abnormalities. Distinguishing between true- and pseudo-invasion in colon polyps is critical in treatment planning. Surgical resection of the colon is often the treatment option for true invasion, whereas observation is recommended for pseudo-invasion. The task of identifying true- vs pseudo-invasion, however, could be highly challenging. There is no specialized software tool for this task, and no well-annotated dataset is available. In our work, we obtained (only) 150 whole-slide images (WSIs) from the London Health Science Centre. We built three deep neural networks representing different magnifications in WSIs, mimicking the workflow of pathologists. We also built an online tool for pathologists to annotate WSIs to train our deep neural networks. Results showed that our novel system classifies tissue types with 95.3% accuracy and differentiates true- and pseudo-invasions with 83.9% accuracy. The system's efficiency is comparable to an expert pathologist. Our system can also be easily adjusted to serve as a confirmatory or screening tool. Our system (available at http://ai4path.ca) will lead to better, faster patient care and reduced healthcare costs.

multidisciplinary sciences
Robust whole slide image analysis for cervical cancer screening using deep learning

Shenghua Cheng,Sibo Liu,Jingya Yu,Gong Rao,Yuwei Xiao,Wei Han,Wenjie Zhu,Xiaohua Lv,Ning Li,Jing Cai,Zehua Wang,Xi Feng,Fei Yang,Xiebo Geng,Jiabo Ma,Xu Li,Ziquan Wei,Xueying Zhang,Tingwei Quan,Shaoqun Zeng,Li Chen,Junbo Hu,Xiuli Liu

DOI: https://doi.org/10.1038/s41467-021-25296-x

IF: 16.6

2021-09-24

Nature Communications

Abstract:Abstract Computer-assisted diagnosis is key for scaling up cervical cancer screening. However, current recognition algorithms perform poorly on whole slide image (WSI) analysis, fail to generalize for diverse staining and imaging, and show sub-optimal clinical-level verification. Here, we develop a progressive lesion cell recognition method combining low- and high-resolution WSIs to recommend lesion cells and a recurrent neural network-based WSI classification model to evaluate the lesion degree of WSIs. We train and validate our WSI analysis system on 3,545 patient-wise WSIs with 79,911 annotations from multiple hospitals and several imaging instruments. On multi-center independent test sets of 1,170 patient-wise WSIs, we achieve 93.5% Specificity and 95.1% Sensitivity for classifying slides, comparing favourably to the average performance of three independent cytopathologists, and obtain 88.5% true positive rate for highlighting the top 10 lesion cells on 447 positive slides. After deployment, our system recognizes a one giga-pixel WSI in about 1.5 min.

multidisciplinary sciences
Towards a Computed-Aided Diagnosis System in Colonoscopy: Automatic Polyp Segmentation Using Convolution Neural Networks

Patrick Brandao,Odysseas Zisimopoulos,Evangelos Mazomenos,Gastone Ciuti,Jorge Bernal,Marco Visentini-Scarzanella,Arianna Menciassi,Paolo Dario,Anastasios Koulaouzidis,Alberto Arezzo,David J Hawkes,Danail Stoyanov

DOI: https://doi.org/10.48550/arXiv.2101.06040

2021-01-15

Computer Vision and Pattern Recognition

Abstract:Early diagnosis is essential for the successful treatment of bowel cancers including colorectal cancer (CRC) and capsule endoscopic imaging with robotic actuation can be a valuable diagnostic tool when combined with automated image analysis. We present a deep learning rooted detection and segmentation framework for recognizing lesions in colonoscopy and capsule endoscopy images. We restructure established convolution architectures, such as VGG and ResNets, by converting them into fully-connected convolution networks (FCNs), fine-tune them and study their capabilities for polyp segmentation and detection. We additionally use Shape from-Shading (SfS) to recover depth and provide a richer representation of the tissue's structure in colonoscopy images. Depth is incorporated into our network models as an additional input channel to the RGB information and we demonstrate that the resulting network yields improved performance. Our networks are tested on publicly available datasets and the most accurate segmentation model achieved a mean segmentation IU of 47.78% and 56.95% on the ETIS-Larib and CVC-Colon datasets, respectively. For polyp detection, the top performing models we propose surpass the current state of the art with detection recalls superior to 90% for all datasets tested. To our knowledge, we present the first work to use FCNs for polyp segmentation in addition to proposing a novel combination of SfS and RGB that boosts performance
A promising deep learning-assistive algorithm for histopathological screening of colorectal cancer

Cowan Ho,Zitong Zhao,Xiu Fen Chen,Jan Sauer,Sahil Ajit Saraf,Rajasa Jialdasani,Kaveh Taghipour,Aneesh Sathe,Li-Yan Khor,Kiat-Hon Lim,Wei-Qiang Leow

DOI: https://doi.org/10.1038/s41598-022-06264-x

IF: 4.6

2022-02-09

Scientific Reports

Abstract:Abstract Colorectal cancer is one of the most common cancers worldwide, accounting for an annual estimated 1.8 million incident cases. With the increasing number of colonoscopies being performed, colorectal biopsies make up a large proportion of any histopathology laboratory workload. We trained and validated a unique artificial intelligence (AI) deep learning model as an assistive tool to screen for colonic malignancies in colorectal specimens, in order to improve cancer detection and classification; enabling busy pathologists to focus on higher order decision-making tasks. The study cohort consists of Whole Slide Images (WSI) obtained from 294 colorectal specimens. Qritive’s unique composite algorithm comprises both a deep learning model based on a Faster Region Based Convolutional Neural Network (Faster-RCNN) architecture for instance segmentation with a ResNet-101 feature extraction backbone that provides glandular segmentation, and a classical machine learning classifier. The initial training used pathologists’ annotations on a cohort of 66,191 image tiles extracted from 39 WSIs. A subsequent application of a classical machine learning-based slide classifier sorted the WSIs into ‘low risk’ (benign, inflammation) and ‘high risk’ (dysplasia, malignancy) categories. We further trained the composite AI-model’s performance on a larger cohort of 105 resections WSIs and then validated our findings on a cohort of 150 biopsies WSIs against the classifications of two independently blinded pathologists. We evaluated the area under the receiver-operator characteristic curve (AUC) and other performance metrics. The AI model achieved an AUC of 0.917 in the validation cohort, with excellent sensitivity (97.4%) in detection of high risk features of dysplasia and malignancy. We demonstrate an unique composite AI-model incorporating both a glandular segmentation deep learning model and a classical machine learning classifier, with excellent sensitivity in picking up high risk colorectal features. As such, AI plays a role as a potential screening tool in assisting busy pathologists by outlining the dysplastic and malignant glands.

multidisciplinary sciences
A Generalized Deep Learning Framework for Whole-Slide Image Segmentation and Analysis

Mahendra Khened,Avinash Kori,Haran Rajkumar,Balaji Srinivasan,Ganapathy Krishnamurthi

DOI: https://doi.org/10.48550/arXiv.2001.00258

2020-11-18

Abstract:Histopathology tissue analysis is considered the gold standard in cancer diagnosis and prognosis. Given the large size of these images and the increase in the number of potential cancer cases, an automated solution as an aid to histopathologists is highly desirable. In the recent past, deep learning-based techniques have provided state of the art results in a wide variety of image analysis tasks, including analysis of digitized slides. However, the size of images and variability in histopathology tasks makes it a challenge to develop an integrated framework for histopathology image analysis. We propose a deep learning-based framework for histopathology tissue analysis. We demonstrate the generalizability of our framework, including training and inference, on several open-source datasets, which include CAMELYON (breast cancer metastases), DigestPath (colon cancer), and PAIP (liver cancer) datasets. We discuss multiple types of uncertainties pertaining to data and model, namely aleatoric and epistemic, respectively. Simultaneously, we demonstrate our model generalization across different data distribution by evaluating some samples on TCGA data. On CAMELYON16 test data (n=139) for the task of lesion detection, the FROC score achieved was 0.86 and in the CAMELYON17 test-data (n=500) for the task of pN-staging the Cohen's kappa score achieved was 0.9090 (third in the open leaderboard). On DigestPath test data (n=212) for the task of tumor segmentation, a Dice score of 0.782 was achieved (fourth in the challenge). On PAIP test data (n=40) for the task of viable tumor segmentation, a Jaccard Index of 0.75 (third in the challenge) was achieved, and for viable tumor burden, a score of 0.633 was achieved (second in the challenge). Our entire framework and related documentation are freely available at GitHub and PyPi.

Image and Video Processing,Computer Vision and Pattern Recognition,Machine Learning,Tissues and Organs
Fast whole-slide cartography in colon cancer histology using superpixels and CNN classification

Frauke Wilm,Michaela Benz,Volker Bruns,Serop Baghdadlian,Jakob Dexl,David Hartmann,Petr Kuritcyn,Martin Weidenfeller,Thomas Wittenberg,Susanne Merkel,Arndt Hartmann,Markus Eckstein,Carol I. Geppert

DOI: https://doi.org/10.1117/1.JMI.9.2.027501

2022-03-16

Abstract:Automatic outlining of different tissue types in digitized histological specimen provides a basis for follow-up analyses and can potentially guide subsequent medical decisions. The immense size of whole-slide-images (WSI), however, poses a challenge in terms of computation time. In this regard, the analysis of non-overlapping patches outperforms pixelwise segmentation approaches, but still leaves room for optimization. Furthermore, the division into patches, regardless of the biological structures they contain, is a drawback due to the loss of local dependencies. We propose to subdivide the WSI into coherent regions prior to classification by grouping visually similar adjacent pixels into superpixels. Afterwards, only a random subset of patches per superpixel is classified and patch labels are combined into a superpixel label. We propose a metric for identifying superpixels with an uncertain classification and evaluate two medical applications, namely tumor area and invasive margin estimation and tumor composition analysis. The algorithm has been developed on 159 hand-annotated WSIs of colon resections and its performance is compared to an analysis without prior segmentation. The algorithm shows an average speed-up of 41% and an increase in accuracy from 93.8% to 95.7%. By assigning a rejection label to uncertain superpixels, we further increase the accuracy by 0.4%. Whilst tumor area estimation shows high concordance to the annotated area, the analysis of tumor composition highlights limitations of our approach. By combining superpixel segmentation and patch classification, we designed a fast and accurate framework for whole-slide cartography that is AI-model agnostic and provides the basis for various medical endpoints.

Image and Video Processing,Computer Vision and Pattern Recognition
An Efficient Cervical Whole Slide Image Analysis Framework Based on Multi-scale Semantic and Location Deep Features

Ziquan Wei,Shenghua Cheng,Junbo Hu,Li Chen,Shaoqun Zeng,Xiuli Liu

DOI: https://doi.org/10.48550/arXiv.2106.15113

2022-06-03

Abstract:Digital gigapixel whole slide image (WSI) is widely used in clinical diagnosis, and automated WSI analysis is key for computer-aided diagnosis. Currently, analyzing the integrated descriptor of probabilities or feature maps from massive local patches encoded by ResNet classifier is the main manner for WSI-level prediction. Feature representations of the sparse and tiny lesion cells in cervical slides, however, are still challenging, while the unused location representations are available to supply the semantics classification. This study designs a novel and efficient framework with a new module InCNet constructed lightweight model YOLCO (You Only Look Cytology Once). It directly extracts feature inside the single cell (cluster) instead of the traditional way that from image tile with a fixed size. The InCNet (Inline Connection Network) enriches the multi-scale connectivity without efficiency loss. The proposal allows the input size enlarged to megapixel that can stitch the WSI by the average repeats decreased from $10^3\sim10^4$ to $10^1\sim10^2$ for collecting features and predictions at two scales. Based on Transformer for classifying the integrated multi-scale multi-task WSI features, the experimental results appear $0.872$ AUC score better than the best conventional model on our dataset ($n$=2,019) from four scanners. The code is available at <a class="link-external link-https" href="https://github.com/Chrisa142857/You-Only-Look-Cytopathology-Once" rel="external noopener nofollow">this https URL</a> , where the deployment version has the speed $\sim$70 s/WSI.

Computer Vision and Pattern Recognition,Artificial Intelligence
Lesion-Decoupling-Based Segmentation with Large-Scale Colon and Esophageal Datasets for Early Cancer Diagnosis

Qing Lin,Weimin Tan,Shilun Cai,Bo Yan,Jichun Li,Yunshi Zhong

DOI: https://doi.org/10.1109/tnnls.2023.3248804

IF: 14.255

2023-01-01

IEEE Transactions on Neural Networks and Learning Systems

Abstract:Lesions of early cancers often show flat, small, and isochromatic characteristics in medical endoscopy images, which are difficult to be captured. By analyzing the differences between the internal and external features of the lesion area, we propose a lesion-decoupling-based segmentation (LDS) network for assisting early cancer diagnosis. We introduce a plug-and-play module called self-sampling similar feature disentangling module (FDM) to obtain accurate lesion boundaries. Then, we propose a feature separation loss (FSL) function to separate pathological features from normal ones. Moreover, since physicians make diagnoses with multimodal data, we propose a multimodal cooperative segmentation network with two different modal images as input: white-light images (WLIs) and narrowband images (NBIs). Our FDM and FSL show a good performance for both single-modal and multimodal segmentations. Extensive experiments on five backbones prove that our FDM and FSL can be easily applied to different backbones for a significant lesion segmentation accuracy improvement, and the maximum increase of mean Intersection over Union (mIoU) is 4.58. For colonoscopy, we can achieve up to mIoU of 91.49 on our Dataset A and 84.41 on the three public datasets. For esophagoscopy, mIoU of 64.32 is best achieved on the WLI dataset and 66.31 on the NBI dataset.
A deep learning framework for predicting endometrial cancer from cytopathologic images with different staining styles

Ruijie Wang,Qing Li,Guizhi Shi,Qiling Li,Dexing Zhong

DOI: https://doi.org/10.1371/journal.pone.0306549

IF: 3.7

2024-07-31

PLoS ONE

Abstract:Endometrial cancer screening is crucial for clinical treatment. Currently, cytopathologists analyze cytopathology images is considered a popular screening method, but manual diagnosis is time-consuming and laborious. Deep learning can provide objective guidance efficiency. But endometrial cytopathology images often come from different medical centers with different staining styles. It decreases the generalization ability of deep learning models in cytopathology images analysis, leading to poor performance. This study presents a robust automated screening framework for endometrial cancer that can be applied to cytopathology images with different staining styles, and provide an objective diagnostic reference for cytopathologists, thus contributing to clinical treatment. We collected and built the XJTU-EC dataset, the first cytopathology dataset that includes segmentation and classification labels. And we propose an efficient two-stage framework for adapting different staining style images, and screening endometrial cancer at the cellular level. Specifically, in the first stage, a novel CM-UNet is utilized to segment cell clumps, with a channel attention (CA) module and a multi-level semantic supervision (MSS) module. It can ignore staining variance and focus on extracting semantic information for segmentation. In the second stage, we propose a robust and effective classification algorithm based on contrastive learning, ECRNet. By momentum-based updating and adding labeled memory banks, it can reduce most of the false negative results. On the XJTU-EC dataset, CM-UNet achieves an excellent segmentation performance, and ECRNet obtains an accuracy of 98.50%, a precision of 99.32% and a sensitivity of 97.67% on the test set, which outperforms other competitive classical models. Our method robustly predicts endometrial cancer on cytopathologic images with different staining styles, which will further advance research in endometrial cancer screening and provide early diagnosis for patients. The code will be available on GitHub.
Colorectal Cancer Detection Based on Deep Learning

Lin Xu,Blair Walker,Peir-In Liang,Yi Tong,Cheng Xu,Yu Chun Su,Aly Karsan

DOI: https://doi.org/10.4103/jpi.jpi_68_19

2020-01-01

Journal of Pathology Informatics

Abstract:INTRODUCTION: The initial point in the diagnostic workup of solid tumors remains manual, with the assessment of hematoxylin and eosin (H&E)-stained tissue sections by microscopy. This is a labor-intensive step that requires attention to detail. In addition, diagnoses are influenced by an individual pathologist's knowledge and experience and may not always be reproducible between pathologists.METHODS: We introduce a deep learning-based method in colorectal cancer detection and segmentation from digitized H&E-stained histology slides.RESULTS: In this study, we demonstrate that this neural network approach produces median accuracy of 99.9% for normal slides and 94.8% for cancer slides compared to pathologist-based diagnosis on H&E-stained slides digitized from clinical samples.CONCLUSION: Given that our approach has very high accuracy on normal slides, use of neural network algorithms may provide a screening approach to save pathologist time in identifying tumor regions. We suggest that this new method may be a powerful assistant for colorectal cancer diagnostics.
Deep learning and multiscale analysis for epithelial-mesenchyme segmentation and classification in breast cancer histological images

Tangsen Huang,Haibing Yin,Xingru Huang

DOI: https://doi.org/10.1007/s11760-024-03424-6

IF: 1.583

2024-09-15

Signal Image and Video Processing

Abstract:This paper proposes an innovative deep learning-based method called Deep WSI-Stroma for the segmentation and classification of epithelial and mesenchyme regions in whole slide images (WSIs) of breast cancer histopathology. The method adopts an end-to-end convolutional neural network architecture and designs a multi-scale, multi-level network structure that fuses feature maps from different resolutions, enabling effective modeling of both local cellular and global tissue-level features. Attention mechanisms and adversarial training strategies are also incorporated to enhance the model's robustness and generalization ability. Experiments on the TCGA-BRCA dataset demonstrate that Deep WSI-Stroma achieves an average Dice score of 0.873 for the segmentation task, significantly outperforming classical models such as U-Net and FCN. For the classification task, it attains an average F1 score of 0.921 across the three classes, substantially surpassing hand-crafted features with SVM and CNN methods. These superior results validate the excellent performance of the proposed method in handling large-scale, high-resolution WSI data and highlight the immense potential of deep learning techniques. This innovative approach leverages the powerful representation and learning capabilities of deep learning, exhibiting significant advantages in the complex task of histopathological image analysis, and provides important insights and driving forces for related fields.

engineering, electrical & electronic,imaging science & photographic technology

A useful route to (R)- and (S)-tert-leucine.

Deep Learning-Based Semantic Segmentation of Non-Melanocytic Skin Tumors in Whole-Slide Histopathological Images.

Deep learning for multi-class semantic segmentation enables colorectal cancer detection and classification in digital pathology images

An interpretable machine learning system for colorectal cancer diagnosis from pathology slides

ColonNet: A novel polyp segmentation framework based on LK-RFB and GPPD

Multi-task learning for tissue segmentation and tumor detection in colorectal cancer histology slides

Deep Learning Classification of Colorectal Lesions Based on Whole Slide Images

Automated risk classification of colon biopsies based on semantic segmentation of histopathology images

SSN: A Stair-Shape Network for Real-Time Polyp Segmentation in Colonoscopy Images.

Deep learning system for true- and pseudo-invasion in colorectal polyps

Robust whole slide image analysis for cervical cancer screening using deep learning

Towards a Computed-Aided Diagnosis System in Colonoscopy: Automatic Polyp Segmentation Using Convolution Neural Networks

A promising deep learning-assistive algorithm for histopathological screening of colorectal cancer

A Generalized Deep Learning Framework for Whole-Slide Image Segmentation and Analysis

Fast whole-slide cartography in colon cancer histology using superpixels and CNN classification

An Efficient Cervical Whole Slide Image Analysis Framework Based on Multi-scale Semantic and Location Deep Features

Lesion-Decoupling-Based Segmentation with Large-Scale Colon and Esophageal Datasets for Early Cancer Diagnosis

A deep learning framework for predicting endometrial cancer from cytopathologic images with different staining styles

Colorectal Cancer Detection Based on Deep Learning

Deep learning and multiscale analysis for epithelial-mesenchyme segmentation and classification in breast cancer histological images