Abstract:The gold standard for esophageal cancer diagnosis and treatment is the Thinprep Cytologic Test (TCT) of suspected sections. TCT refers to analyze the features of the lesion areas using tissue regions stained with hematoxylin and eosin. However, pathologists are currently subjected to high workloads and limited experiences. Moreover, automatic esophageal cancer detection methods typically screen the smears by focusing on suspicious lesions identified by cytotechnicians, cell misclassification often results in inaccurate and weak robust diagnoses, smear utilization rate is also reduced. Computer-assisted diagnosis also faces challenges such as information loss, non-quantitative analysis, and nonstandard diagnosing processes. To address these issues, this article proposes a deep learning based detection framework called the Esophageal Time Series Thinprep Cytologic Test (ETS-TCT) to provide a quantitative and robust screening of Whole Slide Imaging (WSI) for esophageal cancer. Our system is divided into three modules: Coarse-fine detection model, quantitative analysis model, and Fusion Long Short Term Memory-Support Vector Machine (FLSTM-SVM) model. These modules are organized to map the pathological information from cell-level to smear-level and offer interpretable predictions to pathologists. For each smear, we design the coarse-fine segmentation model for adaptively locating and classifying target cells, give mathematical descriptions for cell Deoxyribonucleic Acid (DNA) values using the quantitative analysis model, establish an early risk screening model for esophageal cancer using the optimized FLSTM-SVM network. To validate the methodology, we use two clinical datasets containing 580 samples, achieving the accuracy, sensitivity, specificity, and area under ROC (AUC) of 92.0%, 93.4%, 94.4%, and 0.913, respectively. In short, the framework provides robust and accurate diagnosis of esophageal cancer WSIs using the time series features. This screening can assist the pathologists in strengthening the diagnosis by robustly presenting the quantitative intermediate results as well as visual interpretations. Moreover, we clearly present and expatiate the concepts of time series features, highlighting the relationship between these features to physiological states of patients. Our results indicate the possibility of using the framework as a second system to the computer-assisted esophageal cancer screening.

Three feature streams based on a convolutional neural network for early esophageal cancer identification

Automatic Classification of Esophageal Lesions in Endoscopic Images Using a Convolutional Neural Network

Automatic classification of esophageal disease in gastroscopic images using an efficient channel attention deep dense convolutional neural network

Esophageal Squamous Cell Carcinoma Recognition Based on Lightweight Residual Networks with an Attention Mechanism

Tu2005 DEVELOPMENT AND VALIDATION OF A DEEP LEARNING ALGORITHM FOR DETECTION AND RECOGNITION OF PRECANCEROUS LESION IN ESOPHAGUS

AI-assisted Identification of Intrapapillary Capillary Loops in Magnification Endoscopy for Diagnosing Early-Stage Esophageal Squamous Cell Carcinoma: a Preliminary Study

Convolutional neural network-based artificial intelligence for the diagnosis of early esophageal cancer based on endoscopic images: A meta-analysis

Ensembled CNN with artificial bee colony optimization method for esophageal cancer stage classification using SVM classifier

A deep learning-based system for identifying differentiation status and delineating the margins of early gastric cancer in magnifying narrow-band imaging endoscopy

Application of endoscopic ultrasonography for detecting esophageal lesions based on convolutional neural network.

Design and implementation of deep learning algorithm for image discrimination of light field confocal endoscopy for esophageal cancer and gastric cancer

Esophageal Cancer Detection Framework Based on Time Series Information from Smear Images

EsccNet: A Hybrid CNN and Transformers Model for the Classification of Whole Slide Images of Esophageal Squamous Cell Carcinoma

Depth Information-Based Automatic Annotation of Early Esophageal Cancers in Gastroscopic Images Using Deep Learning Techniques.

Eso-Net: A Novel 2.5D Segmentation Network with the Multi-Structure Response Filter for the Cancerous Esophagus

Deep learning Instance Segmentation on Esophageal Squamous Cell Carcinoma detection

Detection of Incidental Esophageal Cancers on Chest CT by Deep Learning

RFIA-Net: Rich CNN-transformer Network Based on Asymmetric Fusion Feature Aggregation to Classify Stage I Multimodality Oesophageal Cancer Images

The current state of artificial intelligence in endoscopic diagnosis of early esophageal squamous cell carcinoma

Real-time automated diagnosis of precancerous lesions and early esophageal squamous cell carcinoma using a deep learning model (with videos)

Using a deep learning system in endoscopy for screening of early esophageal squamous cell carcinoma (with video)