Abstract:BackgroundIn China, diabetes is a common, high-incidence chronic disease. Diabetes has become a serious public health problem. However, the current diagnosis and treatment methods are difficult to control the progress of diabetes. Traditional Chinese Medicine (TCM) has become an option for the treatment of diabetes due to its low cost, satisfactory curative effect and good accessibility.Objective: Based on the tongue image data to realize the fine classification of the diabetic population, provide a diagnostic basis for the formulation of individualized treatment plans for diabetes, ensure the accuracy and consistency of the diagnosis of TCM, and promote the objective, standardized and standardized development of TCM diagnosis.Methods: We use the TFDA-1 tongue examination instrument to collect the tongue images of the subjects. Tongue Diagnosis Analysis System (TDAS) is used to extract the color feature, texture feature and tongue coating ratio feature of the tongue image. Auto-Encoder extracts auto-encoding features from tongue images through self-supervised learning extraction. We use K-means to perform fusion calculations on TDAS features and self-encoding features to classify tongue images. TDAS features are used to describe the differences between clusters and the characteristics of clusters. Vision Transformer (ViT) combined with Grad-weighted Class Activation Mapping (Grad-CAM) is used to verify the clustering results and calculate positioning diagnostic information.Results: According to the input tongue image data, K-means divides the diabetic population into 4 clusters with clear boundaries between clusters. Cluster 3 had the highest TB-L and TC-L, and Cluster 2 had the lowest TB-L and TC-L (P <0.001). Cluster 2 and Cluster 4 had the highest TB-a (P <0.01, P <0.001), and Cluster 3 had the lowest TB-a (P <0.001). Cluster 2 had the highest TB-b and TC-b (P <0.01, P <0.001), and Cluster 3 had the lowest TB-b and TC-b (P <0.01, P <0.001). Cluster 2 had the highest TB-ASM, and TB-CON, TB-ENT and TB-MEAN had the lowest (P <0.001). Cluster 3 had the lowest TC-ASM, TC-CON, TC-ENT and TC-MEAN the highest (P <0.01, P <0.001). Cluster 3 had the highest Per-all (P <0.001). Vision Transformer (ViT) verifies the clustering results of K-means, the highest Top-1 Classification Accuracy (CA) is 84.9%, and the average CA is 83.6%.Conclusions: The study organically combined unsupervised learning, self-supervised learning and supervised learning, and designed a complete diabetic tongue image classification method. This method does not rely on human intervention, and makes decisions based entirely on tongue image data and achieves state-of-the-art results. Our research will help TCM deeply participate in the individualized treatment of diabetes, and provide new ideas for promoting the objective, standardization and standardization of TCM diagnosis.Funding: The authors gratefully acknowledge the financial supports by the National Key Research and Development Program of China [grant numbers 2017YFC1703300 and 2017YFC1703301]; National Natural Science Foundation of China [grant numbers 81873235, 81973750, 82004258 and 81904094]; and 1226 Engineering Health Key Project [grant number BWS17J028].Declaration of Interest: We declare no competing interests.Ethical Approval: The study was approved by the IRB of Shuguang Hospital affiliated with Shanghai University of TCM.

Prediction of fasting plasma glucose and glycated haemoglobin using machine learning based on tongue features

Establishment of Noninvasive Diabetes Risk Prediction Model Based on Tongue Features and Machine Learning Techniques.

A tongue features fusion approach to predicting prediabetes and diabetes with machine learning

Application of tongue image characteristics and oral-gut microbiota in predicting pre-diabetes and type 2 diabetes with machine learning

The Study of Key Tongue Features for Prediabetes Risk and Diabetes Risk using Principal Component Analysis and Logistic Regression

The Relationship Between Computerized Face and Tongue Image Segmentation and Metabolic Parameters in Patients with Type 2 Diabetes Based on Machine Learning

Diabetes Tongue Image Classification Using Machine Learning and Deep Learning

Development and economic assessment of machine learning models to predict glycosylated hemoglobin in type 2 diabetes

Predicting three-month fasting blood glucose and glycated hemoglobin changes in patients with type 2 diabetes mellitus based on multiple machine learning algorithms

Early Prediction of Gestational Diabetes Mellitus in the Chinese Population Via Advanced Machine Learning

Predicting the Risk of Incident Type 2 Diabetes Mellitus in Chinese Elderly Using Machine Learning Techniques

Research of the Distribution of Tongue Features of Diabetic Population Based on Unsupervised Learning Technology

Diagnostic Method of Diabetes Based on Support Vector Machine and Tongue Images

Human Tongue Thermography Could Be a Prognostic Tool for Prescreening the Type II Diabetes Mellitus

Machine learning-based prediction of diabetic patients using blood routine data

Predicting the diabetic foot in the population of type 2 diabetes mellitus from tongue images and clinical information using multi-modal deep learning

Application of machine learning methods for the prediction of true fasting status in patients performing blood tests

Using convolutional neural network for diabetes mellitus diagnosis based on tongue images

Machine Learning Based Tongue Image Recognition for Diabetes Diagnosis

A multi-step approach for tongue image classification in patients with diabetes

A Deep Tongue Image Features Analysis Model for Medical Application.