Abstract:Background and Objective Tongue diagnosis is one of the characteristics of traditional Chinese medicine (TCM), but traditional tongue diagnosis is affected by many factors, and its differential diagnosis results are not widely recognized. The appearance of tongue diagnosis instruments is the product of the modernization of tongue diagnosis, and it has standard and objective advantages in clinical practice. In this study, based on standard tongue images, a tongue image dataset and detection model were constructed. And based on the deep learning convolutional neural network (CNN) algorithm and visual question answering technology, a human-computer interaction intelligent health detector for tongue image recognition is constructed. Methods In this research, 1420 tongue images were collected. After screening, experts judged them, and annotated the tongue images to form tongue image datasets. Then the artificial intelligence network framework based on deep learning convolutional neural network (CNN), that is, ResNet34, is applied to this dataset to automatically extract image features and realize tongue images classification. Finally, the VGG16 network framework is applied to the dataset to compare the classification model and compare with the classification effect. Results In this paper, relevant datasets were formed by collating the tongue images collected by annotation, which verified that the ResNet34 architecture could better perform the task of tooth mark and tongue feature recognition. Compared with similar learning tasks in existing studies, the accuracy of the teeth-printed tongue recognition model proposed in this study is more than 10% higher, which indicates that the CNN algorithm can distinguish teeth-printed tongue more accurately and effectively. At the same time, using datasets and models combined with visual question and answer technology, an AI health detector for TCM tongue image identification is designed, which can make health assessments and give suggestions to users. Conclusion This study adopts a convolutional neural network model based on deep learning, which can reduce the extraction of tongue features more quickly and conveniently. At the same time, the model architecture has excellent performance and strong generalization ability and is more accurate in judging users' health status.

Image Recognition of Chinese Herbal Medicine Using Adaptive Gamma Correction Based on Convolutional Neural Network

Image recognition of traditional Chinese medicine based on deep learning

Combined Channel Attention and Spatial Attention Module Network for Chinese Herbal Slices Automated Recognition

An Optimized Deep Convolutional Neural Network for Dendrobium Classification Based on Electronic Nose

An Optimized Multi-Classifiers Ensemble Learning for Identification of Ginsengs Based on Electronic Nose

An Easy Method for Identifying 315 Categories of Commonly-Used Chinese Herbal Medicines Based on Automated Image Recognition Using AutoML Platforms

Multiple attentional pyramid networks for Chinese herbal recognition

Image Recognition of Chinese herbal pieces Based on Multi-task Learning Model

A novel Chinese herbal medicine classification approach based on EfficientNet

Chinese Herbal Recognition based on Competitive Attentional Fusion of Multi-hierarchies Pyramid Features

Research on Image Classification of Chinese Medicinal Materials Powder Based on Texture Extraction and Improved Lightweight Network

Enhanced Knowledge Distillation for Advanced Recognition of Chinese Herbal Medicine

CCNNet: a novel lightweight convolutional neural network and its application in traditional Chinese medicine recognition

Tu1075 DEEP CONVOLUTIONAL NEURAL NETWORKS FOR RECOGNITION OF ATROPHIC GASTRITIS AND INTESTINAL METAPLASIA BASED ON ENDOSCOPY IMAGES

Semantic-Aware Graph Convolutional Networks for Clinical Auxiliary Diagnosis and Treatment of Traditional Chinese Medicine

A transfer learning-based multimodal neural network combining metadata and multiple medical images for glaucoma type diagnosis

Human-computer interaction based health diagnostics using ResNet34 for tongue image classification

Deep Learning Combined with Hyperspectral Imaging Technology for Variety Discrimination of Fritillaria thunbergii

Traditional Chinese Medicine Recognition Based on Target Detection

Chronic Cervicitis and Cervical Cancer Detection Based on Deep Learning of Colposcopy Images Toward Translational Pharmacology

A multimodal deep architecture for traditional Chinese medicine diagnosis