Abstract:<h3 class="u-h4 u-margin-m-top u-margin-xs-bottom">Background</h3><p>Diabetics has become a serious public health burden in China. Multiple complications appear with the progression of diabetics pose a serious threat to the quality of human life and health. We can prevent the progression of prediabetics to diabetics and delay the progression to diabetics by early identification of diabetics and prediabetics and timely intervention, which have positive significance for improving public health.</p><h3 class="u-h4 u-margin-m-top u-margin-xs-bottom">Objective</h3><p>Using machine learning techniques, we establish the noninvasive diabetics risk prediction model based on tongue features fusion and predict the risk of prediabetics and diabetics.</p><h3 class="u-h4 u-margin-m-top u-margin-xs-bottom">Methods</h3><p>Applying the type TFDA-1 Tongue Diagnosis Instrument, we collect tongue images, extract tongue features including color and texture features using TDAS, and extract the advanced tongue features with ResNet-50, achieve the fusion of the two features with GA_XGBT, finally establish the noninvasive diabetics risk prediction model and evaluate the performance of testing effectiveness.</p><h3 class="u-h4 u-margin-m-top u-margin-xs-bottom">Results</h3><p>Cross-validation suggests the best performance of GA_XGBT model with fusion features, whose average CA is 0.821, the average AUROC is 0.924, the average AUPRC is 0.856, the average Precision is 0.834, the average Recall is 0.822, the average F1-score is 0.813. Test set suggests the best testing performance of GA_XGBT model, whose average CA is 0.81, the average AUROC is 0.918, the average AUPRC is 0.839, the average Precision is 0.821, the average Recall is 0.81, the average F1-score is 0.796. When we test prediabetics with GA_XGBT model, we find that the AUROC is 0.914, the Precision is 0.69, the Recall is 0.952, the F1-score is 0.8. When we test diabetics with GA_XGBT model, we find that the AUROC is 0.984, the Precision is 0.929, the Recall is 0.951, the F1-score is 0.94.</p><h3 class="u-h4 u-margin-m-top u-margin-xs-bottom">Conclusions</h3><p>Based on tongue features, the study uses classical machine learning algorithm and deep learning algorithm to maximum the respective advantages. We combine the prior knowledge and potential features together, establish the noninvasive diabetics risk prediction model with features fusion algorithm, and detect prediabetics and diabetics noninvasively. Our study presents a feasible method for establishing the association between diabetics and the tongue image information and prove that tongue image information is a potential marker which facilitates effective early diagnosis of prediabetics and diabetics.</p>

Using convolutional neural network for diabetes mellitus diagnosis based on tongue images

Machine Learning Based Tongue Image Recognition for Diabetes Diagnosis

Swin-ResNet: Research and Implementation of a Tooth-Marked Tongue Classification Method Combining ResNet-50 and Swin Transformer

Human-computer interaction based health diagnostics using ResNet34 for tongue image classification

Diagnostic Method of Diabetes Based on Support Vector Machine and Tongue Images

A multi-step approach for tongue image classification in patients with diabetes

Artificial intelligence in tongue diagnosis: Using deep convolutional neural network for recognizing unhealthy tongue with tooth-mark

Panoramic tongue imaging and deep convolutional machine learning model for diabetes diagnosis in humans

Application of Convolutional Neural Network Algorithm in Diagnosis of Chronic Cough and Tongue in Children with Traditional Chinese Medicine

Intelligent decision support model using tongue image features for healthcare monitoring of diabetes diagnosis and classification

Deep-DSP: deep convolutional network with double spatial pyramid for tongue image segmentation

A tongue features fusion approach to predicting prediabetes and diabetes with machine learning

Multiple color representation and fusion for diabetes mellitus diagnosis based on back tongue images

Intelligent quality control of traditional chinese medical tongue diagnosis images based on deep learning

Automatic Classification Framework of Tongue Feature Based on Convolutional Neural Networks

Multi-modal Fusion for Diabetes Mellitus and Impaired Glucose Regulation Detection

Deep Learning Multi-label Tongue Image Analysis and Its Application in a Population Undergoing Routine Medical Checkup

Predicting the diabetic foot in the population of type 2 diabetes mellitus from tongue images and clinical information using multi-modal deep learning

A survey of artificial intelligence in tongue image for disease diagnosis and syndrome differentiation

A two-stage segmentation of sublingual veins based on compact fully convolutional networks for Traditional Chinese Medicine images

TISNet-Enhanced Fully Convolutional Network with Encoder-Decoder Structure for Tongue Image Segmentation in Traditional Chinese Medicine