Abstract:Background Tongue diagnosis in traditional Chinese medicine (TCM) provides clinically important, objective evidence from direct observation of specific features that assist with diagnosis. However, the current interpretation of tongue features requires a significant amount of manpower and time. TCM physicians may have different interpretations of features displayed by the same tongue. An automated interpretation system that interprets tongue features would expedite the interpretation process and yield more consistent results. Materials and methods This study applied deep learning visualization to tongue diagnosis. After collecting tongue images and corresponding interpretation reports by TCM physicians in a single teaching hospital, various tongue features such as fissures, tooth marks, and different types of coatings were annotated manually with rectangles. These annotated data and images were used to train a deep learning object detection model. Upon completion of training, the position of each tongue feature was dynamically marked. Results A large high-quality manually annotated tongue feature dataset was constructed and analyzed. A detection model was trained with average precision (AP) 47.67%, 58.94%, 71.25% and 59.78% for fissures, tooth marks, thick and yellow coatings, respectively. At over 40 frames per second on a NVIDIA GeForce GTX 1060, the model was capable of detecting tongue features from any viewpoint in real time. Conclusions/Significance This study constructed a tongue feature dataset and trained a deep learning object detection model to locate tongue features in real time. The model provided interpretability and intuitiveness that are often lacking in general neural network models and implies good feasibility for clinical application.

Tracking Of Dynamic Tongue In Traditional Chinese Medicine

Contour Tracking Method of Dynamic Tongue Using Optical Flow-Snakes Model

The segmentation of the body of tongue based on the improved snake algorithm in Traditional Chinese Medicine

3D dynamic tongue visualization based on DirectX

An image analysis system for tongue diagnosis in traditional chinese medicine

Color Active Contour Models Based Tongue Segmentation in Traditional Chinese Medicine

A Novel Automatic Tongue Coating Extraction Method In Tongue Diagnose Of Traditional Chinese Medicine

Contour-based 3d tongue motion visualization using ultrasound image sequences

A Novel Tongue Segmentation Approach Utilizing Double Geodesic Flow

Automatic Extraction of Tongue Coatings from Digital Images:A Traditional Chinese Medicine Diagnostic Tool

A New Computerized Tongue Diagnosis Method with Optimized Outline Extraction Algorithm Using HSV Color Model

C 2 G 2 FSnake: Automatic Tongue Image Segmentation Utilizing Prior Knowledge

A Snake-Based Approach to Automated Segmentation of Tongue Image Using Polar Edge Detector

Tongue Area Extraction in Tongue Diagnosis of Traditional Chinese Medicine

[Methodological Study on Digitalization of Tongue Image in Traditional Chinese Medical Diagnosis].

Computerized Tongue Image Segmentation Via the Double Geo-Vector Flow

Level Set Method Based Tongue Segmentation in Traditional Chinese Medicine

Objectification of Tongue Diagnosis in Traditional Medicine, Data Analysis, and Study Application.

Tongue feature dataset construction and real-time detection

Tongue Shape Detection Based On B-Spline

Combination of Polar Edge Detection and Active Contour Model for Automated Tongue Segmentation