Abstract:Background and Objective Tongue diagnosis is one of the characteristics of traditional Chinese medicine (TCM), but traditional tongue diagnosis is affected by many factors, and its differential diagnosis results are not widely recognized. The appearance of tongue diagnosis instruments is the product of the modernization of tongue diagnosis, and it has standard and objective advantages in clinical practice. In this study, based on standard tongue images, a tongue image dataset and detection model were constructed. And based on the deep learning convolutional neural network (CNN) algorithm and visual question answering technology, a human-computer interaction intelligent health detector for tongue image recognition is constructed. Methods In this research, 1420 tongue images were collected. After screening, experts judged them, and annotated the tongue images to form tongue image datasets. Then the artificial intelligence network framework based on deep learning convolutional neural network (CNN), that is, ResNet34, is applied to this dataset to automatically extract image features and realize tongue images classification. Finally, the VGG16 network framework is applied to the dataset to compare the classification model and compare with the classification effect. Results In this paper, relevant datasets were formed by collating the tongue images collected by annotation, which verified that the ResNet34 architecture could better perform the task of tooth mark and tongue feature recognition. Compared with similar learning tasks in existing studies, the accuracy of the teeth-printed tongue recognition model proposed in this study is more than 10% higher, which indicates that the CNN algorithm can distinguish teeth-printed tongue more accurately and effectively. At the same time, using datasets and models combined with visual question and answer technology, an AI health detector for TCM tongue image identification is designed, which can make health assessments and give suggestions to users. Conclusion This study adopts a convolutional neural network model based on deep learning, which can reduce the extraction of tongue features more quickly and conveniently. At the same time, the model architecture has excellent performance and strong generalization ability and is more accurate in judging users' health status.

Artificial intelligence in tongue diagnosis: classification of tongue lesions and normal tongue images using deep convolutional neural network

Artificial Classification of Cervical Squamous Lesions in ThinPrep Cytologic Tests Using a Deep Convolutional Neural Network.

Artificial intelligence in tongue diagnosis: Using deep convolutional neural network for recognizing unhealthy tongue with tooth-mark

Automated Detection of Oral Pre-Cancerous Tongue Lesions Using Deep Learning for Early Diagnosis of Oral Cavity Cancer

A deep learning algorithm for classification of oral lichen planus lesions from photographic images: A retrospective study

Artificial intelligence based diagnosis of sulcus: assesment of videostroboscopy via deep learning

A deep learning approach to detection of oral cancer lesions from intra oral patient images: A preliminary retrospective study

Automated Multi-Class Classification of Skin Lesions Through Deep Convolutional Neural Network with Dermoscopic Images.

Tongue contour extraction from ultrasound images based on deep neural network

Deep-DSP: deep convolutional network with double spatial pyramid for tongue image segmentation

Diagnosis of Oral Squamous Cell Carcinoma Using Deep Neural Networks and Binary Particle Swarm Optimization on Histopathological Images: An AIoMT Approach

Human-computer interaction based health diagnostics using ResNet34 for tongue image classification

Diagnosing oral and maxillofacial diseases using deep learning

Deep Learning-Based Classification of Dermoscopic Images for Skin Lesions

Application of U-Net with Global Convolution Network Module in Computer-Aided Tongue Diagnosis

Vocal cord lesions classification based on deep convolutional neural network and transfer learning

Automated Identification of Human Gastrointestinal Tract Abnormalities Based on Deep Convolutional Neural Network with Endoscopic Images

Periodontal Disease Classification with Color Teeth Images Using Convolutional Neural Networks

Skin Cancer Detection and Classification using GUI and Deep Neural Network

An Intelligent Tongue Diagnosis System via Deep Learning on the Android Platform

Automatic Classification Framework of Tongue Feature Based on Convolutional Neural Networks