Abstract:ETHNOPHARMACOLOGICAL RELEVANCE: Tongue coating has been used as an effective signature of health in traditional Chinese medicine (TCM). The level of greasy coating closely relates to the strength of dampness or pathogenic qi in TCM theory. Previous empirical studies and our systematic review have shown the relation between greasy coating and various diseases, including gastroenteropathy, coronary heart disease, and coronavirus disease 2019 (COVID-19). However, the objective and intelligent greasy coating and related diseases recognition methods are still lacking. The construction of the artificial intelligent tongue recognition models may provide important syndrome diagnosis and efficacy evaluation methods, and contribute to the understanding of ethnopharmacological mechanisms based on TCM theory.AIM OF THE STUDY: The present study aimed to develop an artificial intelligent model for greasy tongue coating recognition and explore its application in COVID-19.MATERIALS AND METHODS: Herein, we developed greasy tongue coating recognition networks (GreasyCoatNet) using convolutional neural network technique and a relatively large (N = 1486) set of tongue images from standard devices. Tests were performed using both cross-validation procedures and a new dataset (N = 50) captured by common cameras. Besides, the accuracy and time efficiency comparisons between the GreasyCoatNet and doctors were also conducted. Finally, the model was transferred to recognize the greasy coating level of COVID-19.RESULTS: The overall accuracy in 3-level greasy coating classification with cross-validation was 88.8% and accuracy on new dataset was 82.0%, indicating that GreasyCoatNet can obtain robust greasy coating estimates from diverse datasets. In addition, we conducted user study to confirm that our GreasyCoatNet outperforms TCM practitioners, yet only consuming roughly 1% of doctors' examination time. Critically, we demonstrated that GreasyCoatNet, along with transfer learning, can construct more proper classifier of COVID-19, compared to directly training classifier on patient versus control datasets. We, therefore, derived a disease-specific deep learning network by finetuning the generic GreasyCoatNet.CONCLUSIONS: Our framework may provide an important research paradigm for differentiating tongue characteristics, diagnosing TCM syndrome, tracking disease progression, and evaluating intervention efficacy, exhibiting its unique potential in clinical applications.

Texture Analysis of Tongue Coating in Traditional Chinese Medicine Based on Transfer Learning and Multi-Model Decision

A Two-Stage Deep Transfer Learning Model and Its Application for Medical Image Processing in Traditional Chinese Medicine

A Tongue Color Classification Method in TCM Based on Transfer Learning

Preliminary Study of Tongue Image Classification Based on Multi-label Learning

Computerized Tongue Coating Nature Diagnosis Using Convolutional Neural Network

Intelligent quality control of traditional chinese medical tongue diagnosis images based on deep learning

Tongue Image Texture Classification Based on Xception.

Research on Data Analysis Network of TCM Tongue Diagnosis Based on Deep Learning Technology

Constructing tongue coating recognition model using deep transfer learning to assist syndrome diagnosis and its potential in noninvasive ethnopharmacological evaluation

Classification of tongue color based on CNN

Tongue Image Texture Classification Based on Image Inpainting and Convolutional Neural Network

TCM Tongue Color Classification Method under Noisy Labeling

Automatic classification of tongue texture color and tongue coating color based on BP neural network

Deep Learning Multi-label Tongue Image Analysis and Its Application in a Population Undergoing Routine Medical Checkup

Tongue Images Classification Based on Constrained High Dispersal Network

Human-computer interaction based health diagnostics using ResNet34 for tongue image classification

TIM‐Net: A Multi‐label Classification Network for TCM Tongue Images Fusing Global‐local Features

Tongue Colour and Coating Prediction in Traditional Chinese Medicine Based on Visible Hyperspectral Imaging

Application of Convolutional Neural Network Algorithm in Diagnosis of Chronic Cough and Tongue in Children with Traditional Chinese Medicine

Tongue Shape Classification Integrating Image Preprocessing and Convolution Neural Network

A Novel Automatic Tongue Coating Extraction Method In Tongue Diagnose Of Traditional Chinese Medicine