Abstract:Significance: Oral cancer is a quite common global health issue. Early diagnosis of cancerous and potentially malignant disorders in the oral cavity would significantly increase the survival rate of oral cancer. Previously reported smartphone-based images detection methods for oral cancer mainly focus on demonstrating the effectiveness of their methodology, yet it still lacks systematic study on how to improve the diagnosis accuracy on oral disease using hand-held smartphone photographic images.Aim: We present an effective smartphone-based imaging diagnosis method, powered by a deep learning algorithm, to address the challenges of automatic detection of oral diseases.Approach: We conducted a retrospective study. First, a simple yet effective centered rule image-capturing approach was proposed for collecting oral cavity images. Then, based on this method, a medium-sized oral dataset with five categories of diseases was created, and a resampling method was presented to alleviate the effect of image variability from hand-held smartphone cameras. Finally, a recent deep learning network (HRNet) was introduced to evaluate the performance of our method for oral cancer detection.Results: The performance of the proposed method achieved a sensitivity of 83.0%, specificity of 96.6%, precision of 84.3%, and F1 of 83.6% on 455 test images. The proposed "center positioning" method was about 8% higher than that of a simulated "random positioning" method in terms of F1 score, the resampling method had additional 6% of performance improvement, and the introduced HRNet achieved slightly better performance than VGG16, ResNet50, and DenseNet169, with respect to the metrics of sensitivity, specificity, precision, and F1.Conclusions: Capturing oral images centered on the lesion, resampling the cases in training set, and using the HRNet can effectively improve the performance of deep learning algorithm on oral cancer detection. The smartphone-based imaging with deep learning method has good potential for primary oral cancer diagnosis.

Deep learning and sub-band fluorescence imaging-based method for caries and calculus diagnosis embeddable on different smartphones

Smart-phone Phase Contrast Microscope with a Singlet Lens and Deep Learning

Machine Learning-Based Automatic Identification and Diagnosis of Dental Caries and Calculus Using Hyperspectral Fluorescence Imaging.

A Smartphone-based System for Real-time Early Childhood Caries Diagnosis

Development and Evaluation of Deep Learning for Screening Dental Caries from Oral Photographs

A deep learning model using convolutional neural networks for caries detection and recognition with endoscopes

Caries lesions diagnosis with deep convolutional neural network in intraoral QLF images by handheld device

Object detection for caries or pit and fissure sealing requirement in children's first permanent molars

Artificial intelligence for caries and periapical periodontitis detection.

Artificial intelligence for caries detection: a novel diagnostic tool using deep learning algorithms

Faster-RCNN based intelligent detection and localization of dental caries

Automatic detection of oral cancer in smartphone-based images using deep learning for early diagnosis

Detection of dental caries in oral photographs taken by mobile phones based on the YOLOv3 algorithm

Clinically Applicable System For 3D Teeth Segmentation in Intraoral Scans using Deep Learning

Deep learning for early dental caries detection in bitewing radiographs

A deep learning approach to automatic gingivitis screening based on classification and localization in RGB photos

Multi-Task and Few-Shot Learning-Based Fully Automatic Deep Learning Platform for Mobile Diagnosis of Skin Diseases

Oral screening of dental calculus, gingivitis and dental caries through segmentation on intraoral photographic images using deep learning

Towards Earlier Detection of Oral Diseases On Smartphones Using Oral and Dental RGB Images

CariesNet: a deep learning approach for segmentation of multi-stage caries lesion from oral panoramic X-ray image