Abstract:PURPOSE:To develop and evaluate the colposcopy based deep learning model using all kinds of cervical images for cervical screening, and investigate the synergetic benefits of the colposcopy, the cytology test, and the HPV test for improving cervical screening performance.METHODS:This study consisted of 2160 women who underwent cervical screening, there were 442 cases with the histopathological confirmed high-grade squamous intraepithelial lesion (HSIL) or cancer, and the remained 1718 women were controls. Three kinds of cervical images were acquired from colposcopy including the saline image of cervix after saline irrigation, the acetic acid image of cervix after applying acetic acid solution, and the iodine image of cervix after applying Lugol's iodine solution. Each kind of image was used to build a single-image based deep learning model by the VGG-16 convolutional neural network, respectively. A multiple-images based deep learning model was built using multivariable logistic regression (MLR) by combining the single-image based models. The performance of the visual inspection was also obtained. The results of the cytology test and HPV test were used to build a Cytology-HPV joint diagnostic model by MLR. Finally, a cross-modal integrated model was built using MLR by combining the multiple-images based deep learning model, the cytology test results, and the HPV test results. The performances of models were tested in an independent test set using the area under the receiver operating characteristic curve (AUC).RESULTS:The saline image, acetic acid image, and iodine image based deep learning models had AUC of 0.760, 0.791, and 0.840. The multiple-images based deep learning model achieved an improved AUC of 0.845. The AUC of the visual inspection was 0.751. The Cytology-HPV joint diagnostic model had an AUC of 0.837, which was higher than the cytology test (AUC = 0.749) and the HPV test (AUC = 0.742). The cross-modal integrated model achieved the best performance with AUC of 0.921.CONCLUSIONS:Combining all kinds of cervical images were benefit for improving the performance of the colposcopy based deep learning model, and more accurate cervical screening could be achieved by incorporating the colposcopy based deep learning model, the cytology test results, and the HPV test results.

CTIFI: Clinical-experience-guided three-vision images features integration for diagnosis of cervical lesions

Tensor-Based Subspace Learning for Classification of Focal Liver Lesions in Multi-phase CT Images

Diagnosis of Cervical Precancerous Lesions Based on Multimodal Feature Changes.

M-DFNet

Deep Learning Method for Content-Based Retrieval of Focal Liver Lesions Using Multiphase Contrast-Enhanced Computer Tomography Images

Artificial Classification of Cervical Squamous Lesions in ThinPrep Cytologic Tests Using a Deep Convolutional Neural Network.

Multi-view Learning with Feature Level Fusion for Cervical Dysplasia Diagnosis

Fusing Medical Image Features and Clinical Features with Deep Learning for Computer-Aided Diagnosis

Computer-Aided Cervical Cancer Diagnosis Using Time-Lapsed Colposcopic Images

Deep integrated fusion of local and global features for cervical cell classification

Deep Learning-Based Multimodal Image Analysis for Cervical Cancer Detection.

Cervical Precancerous Lesion Detection Based on Deep Learning of Colposcopy Images.

A Deep Learning Model for Cervical Optical Coherence Tomography Image Classification

Classification and recognition of computed tomography images using image reconstruction and information fusion methods

Deep Learning Based Cervical Screening by the Cross-Modal Integration of Colposcopy, Cytology, and HPV Test.

Double Attention for Pathology Image Diagnosis Network with Visual Interpretability.

AF-SENet: Classification of Cancer in Cervical Tissue Pathological Images Based on Fusing Deep Convolution Features

Computer-aided diagnostic system based on deep learning for classifying colposcopy images

Segmentation of the cervical lesion region in colposcopic images based on deep learning

Feasibility multi-center study of artificial intelligence assistance in cervical fluid-based cytology diagnosis

A two-stream decision fusion network for cervical pap-smear image classification tasks