Abstract:Background and Objective Tongue diagnosis is one of the characteristics of traditional Chinese medicine (TCM), but traditional tongue diagnosis is affected by many factors, and its differential diagnosis results are not widely recognized. The appearance of tongue diagnosis instruments is the product of the modernization of tongue diagnosis, and it has standard and objective advantages in clinical practice. In this study, based on standard tongue images, a tongue image dataset and detection model were constructed. And based on the deep learning convolutional neural network (CNN) algorithm and visual question answering technology, a human-computer interaction intelligent health detector for tongue image recognition is constructed. Methods In this research, 1420 tongue images were collected. After screening, experts judged them, and annotated the tongue images to form tongue image datasets. Then the artificial intelligence network framework based on deep learning convolutional neural network (CNN), that is, ResNet34, is applied to this dataset to automatically extract image features and realize tongue images classification. Finally, the VGG16 network framework is applied to the dataset to compare the classification model and compare with the classification effect. Results In this paper, relevant datasets were formed by collating the tongue images collected by annotation, which verified that the ResNet34 architecture could better perform the task of tooth mark and tongue feature recognition. Compared with similar learning tasks in existing studies, the accuracy of the teeth-printed tongue recognition model proposed in this study is more than 10% higher, which indicates that the CNN algorithm can distinguish teeth-printed tongue more accurately and effectively. At the same time, using datasets and models combined with visual question and answer technology, an AI health detector for TCM tongue image identification is designed, which can make health assessments and give suggestions to users. Conclusion This study adopts a convolutional neural network model based on deep learning, which can reduce the extraction of tongue features more quickly and conveniently. At the same time, the model architecture has excellent performance and strong generalization ability and is more accurate in judging users' health status.

Probability Neural Network for the Classification of Tongue Diagnosis by Near Infrared Spectroscopy

Study on Near Infrared Spectrum in the Application of the BP Neural Network in the Tongue Diagnosis for Hepatitis Patients

Research on Discrimination of Tongue Diseases with Near Infrared Spectroscopy

Application of Partial Least Squares Near-Infrared Spectral Classification in Diabetic Identification

Possibilities of Visible-Near Infrared Spectroscopy for Rapid Diagnosis of Diseases

Spectrum Identification of Hepatitis Tongue Diagnosis Based on Principal Component Analysis and BP Neural Network

[Noninvasive Prediction of Red Blood Cell Counts by Normalized Reflection Spectroscopy for Tongue Inspection].

Rapid Screening for Coronary Heart Disease by NIR Reflection Spectroscopy

Application of Probabilistic Neural Networks Method to Gastric Endoscope Samples Diagnosis Based on Ftir Spectroscopy

Classification of Hyperspectral Medical Tongue Images for Tongue Diagnosis

Comparison of Random Forest, Support Vector Machine and Back Propagation Neural Network for Electronic Tongue Data Classification: Application to the Recognition of Orange Beverage and Chinese Vinegar

[Rapid Diagnosis of Fatty Liver by Glossoscopy Based on Spectrometry].

[Improving Signal to Noise Ratio of Spectroscopy for Tongue Inspection by Reflectivity Normalization Method].

Tongue Colour Diagnosis System Using Convolutional Neural Network

Tongue Images Classification Based on Constrained High Dispersal Network

Exploring hepatic fibrosis screening via deep learning analysis of tongue images

Human-computer interaction based health diagnostics using ResNet34 for tongue image classification

Application of computer tongue image analysis technology in the diagnosis of NAFLD

Classification of diabetes and measurement of blood glucose concentration noninvasively using near infrared spectroscopy

Automatic classification of tongue texture color and tongue coating color based on BP neural network

A Non-Invasive Interpretable NAFLD Diagnostic Method Combining TCM Tongue Features