Abstract:The recognition of tooth-marked tongues has important value for clinical diagnosis of traditional Chinese medicine. Tooth-marked tongue is often related to spleen deficiency, cold dampness, sputum, effusion, and blood stasis. The clinical manifestations of patients with tooth-marked tongue include loss of appetite, borborygmus, gastric distention, and loose stool. Traditional clinical tooth-marked tongue recognition is conducted subjectively based on the doctor’s visual observation, and its performance is affected by the doctor’s subjectivity, experience, and environmental lighting changes. In addition, the tooth marks typically have various shapes and colors on the tongue, which make it very challenging for doctors to identify tooth marks. The existing methods based on deep learning have made great progress for tooth-marked tongue recognition, but there are still shortcomings such as requiring a large amount of manual labeling of tooth marks, inability to detect and locate the tooth marks, and not conducive to clinical diagnosis and interpretation. In this study, we propose an end-to-end deep neural network for tooth-marked tongue recognition based on weakly supervised learning. Note that the deep neural network only requires image-level annotations of tooth-marked or non-tooth marked tongues. In this method, a deep neural network is trained to classify tooth-marked tongues with the image-level annotations. Then, a weakly supervised tooth-mark detection network (WSTDN) as an architecture variant of the pre-trained deep neural network is proposed for the tooth-marked region detection. Finally, the WSTDN is re-trained and fine-tuned using only the image-level annotations to simultaneously realize the classification of the tooth-marked tongue and the positioning of the tooth-marked region. Experimental results of clinical tongue images demonstrate the superiority of the proposed method compared with previously reported deep learning methods for tooth-marked tongue recognition. The proposed tooth-marked tongue recognition model may provide important syndrome diagnosis and efficacy evaluation methods, and contribute to the understanding of ethnopharmacological mechanisms.

Research on Teeth Marks Recognition in Tongue Image

Towards the objectification of tongue diagnosis: the degree of tooth-marked

Swin-ResNet: Research and Implementation of a Tooth-Marked Tongue Classification Method Combining ResNet-50 and Swin Transformer

An Automatic Recognition of Tooth- Marked Tongue Based on Tongue Region Detection and Tongue Landmark Detection Via Deep Learning.

PRTMTM: A Priori Regularization Method for Tooth-Marked Tongue Classification.

Weakly Supervised Deep Learning for Tooth-Marked Tongue Recognition

Weakly Supervised Object Detection for Automatic Tooth-marked Tongue Recognition

A Novel Automatic Tongue Coating Extraction Method In Tongue Diagnose Of Traditional Chinese Medicine

Computer Identification and Quantification of Fissured Tongue Diagnosis

Artificial intelligence in tongue diagnosis: Using deep convolutional neural network for recognizing unhealthy tongue with tooth-mark

Automatic Tongue Area Extraction in Tongue Images

Intelligent quality control of traditional chinese medical tongue diagnosis images based on deep learning

An image analysis system for tongue diagnosis in traditional chinese medicine

Study on method of automatic diagnosis of tongue feature in traditional Chinese medicine

Tongue Diagnosis and Objective Research

Feature Analysis Method of Tongue Image by Chinese Medical Diagnosis Based on Image Processing

Image segmentation in tongue characterization]

Automatic Extraction of Tongue Coatings from Digital Images:A Traditional Chinese Medicine Diagnostic Tool

Machine Learning Based Tongue Image Recognition for Diabetes Diagnosis

Tongue Area Extraction in Tongue Diagnosis of Traditional Chinese Medicine

Objectification of Tongue Diagnosis in Traditional Medicine, Data Analysis, and Study Application.