Abstract:The recognition of tooth-marked tongues has important value for clinical diagnosis of traditional Chinese medicine. Tooth-marked tongue is often related to spleen deficiency, cold dampness, sputum, effusion, and blood stasis. The clinical manifestations of patients with tooth-marked tongue include loss of appetite, borborygmus, gastric distention, and loose stool. Traditional clinical tooth-marked tongue recognition is conducted subjectively based on the doctor’s visual observation, and its performance is affected by the doctor’s subjectivity, experience, and environmental lighting changes. In addition, the tooth marks typically have various shapes and colors on the tongue, which make it very challenging for doctors to identify tooth marks. The existing methods based on deep learning have made great progress for tooth-marked tongue recognition, but there are still shortcomings such as requiring a large amount of manual labeling of tooth marks, inability to detect and locate the tooth marks, and not conducive to clinical diagnosis and interpretation. In this study, we propose an end-to-end deep neural network for tooth-marked tongue recognition based on weakly supervised learning. Note that the deep neural network only requires image-level annotations of tooth-marked or non-tooth marked tongues. In this method, a deep neural network is trained to classify tooth-marked tongues with the image-level annotations. Then, a weakly supervised tooth-mark detection network (WSTDN) as an architecture variant of the pre-trained deep neural network is proposed for the tooth-marked region detection. Finally, the WSTDN is re-trained and fine-tuned using only the image-level annotations to simultaneously realize the classification of the tooth-marked tongue and the positioning of the tooth-marked region. Experimental results of clinical tongue images demonstrate the superiority of the proposed method compared with previously reported deep learning methods for tooth-marked tongue recognition. The proposed tooth-marked tongue recognition model may provide important syndrome diagnosis and efficacy evaluation methods, and contribute to the understanding of ethnopharmacological mechanisms.

PRTMTM: A Priori Regularization Method for Tooth-Marked Tongue Classification.

Swin-ResNet: Research and Implementation of a Tooth-Marked Tongue Classification Method Combining ResNet-50 and Swin Transformer

The improvement of the tooth-marked recognition method on the tongue images

An Automatic Recognition of Tooth- Marked Tongue Based on Tongue Region Detection and Tongue Landmark Detection Via Deep Learning.

Research on Teeth Marks Recognition in Tongue Image

Weakly Supervised Deep Learning for Tooth-Marked Tongue Recognition

Single Shot Tooth Mark Detector for Tongue Diagnosis in Traditional Chinese Medicine

Weakly Supervised Object Detection for Automatic Tooth-marked Tongue Recognition

A Weakly Supervised Tooth-Mark and Crack Detection Method in Tongue Image.

Towards the objectification of tongue diagnosis: the degree of tooth-marked

Ammonia-Net: A Multi-task Joint Learning Model for Multi-class Segmentation and Classification in Tooth-marked Tongue Diagnosis

TCM Tongue Color Classification Method under Noisy Labeling

Intelligent quality control of traditional chinese medical tongue diagnosis images based on deep learning

An Assessment Method of Tongue Image Quality Based on Random Forest in Traditional Chinese Medicine.

New MLBP-Otsu method and its application in tongue crack image segmentation

Preliminary Study of Tongue Image Classification Based on Multi-label Learning

A Novel Automatic Tongue Coating Extraction Method In Tongue Diagnose Of Traditional Chinese Medicine

What’s wrong with the tongue: color grading quantization based on hyperspectral images

Artificial intelligence in tongue diagnosis: Using deep convolutional neural network for recognizing unhealthy tongue with tooth-mark

Tongue Image Segmentation Via Thresholding and Gray Projection.

Deep Learning Multi-label Tongue Image Analysis and Its Application in a Population Undergoing Routine Medical Checkup