Abstract:Objective: We endeavor to develop a novel deep learning architecture tailored specifically for the analysis and classification of tongue features, including color, shape, and coating. Unlike conventional methods based on architectures like VGG or ResNet, our proposed method aims to address the challenges arising from their extensive size, thereby mitigating the overfitting problem. Through this research, we aim to contribute to the advancement of techniques in tongue feature recognition, ultimately leading to more precise diagnoses and better patient rehabilitation in Traditional Chinese Medicine (TCM). Methods: In this study, we introduce TGANet (Tongue Feature Attention Network) to enhance model performance. TGANet utilizes the initial five convolutional blocks of pre-trained VGG16 as the backbone and integrates an attention mechanism into this backbone. The integration of the attention mechanism aims to mimic human cognitive attention, emphasizing model weights on pivotal regions of the image. During the learning process, the allocation of attention weights facilitates the interpretation of causal relationships in the model's decision-making. Results: Experimental results demonstrate that TGANet outperforms baseline models, including VGG16, ResNet18, and TSC-WNet, in terms of accuracy, precision, F1 score, and AUC metrics. Additionally, TGANet provides a more intuitive and meaningful understanding of tongue feature classification models through the visualization of attention weights. Conclusion: In conclusion, TGANet presents an effective approach to tongue feature classification, addressing challenges associated with model size and overfitting. By leveraging the attention mechanism and pre-trained VGG16 backbone, TGANet achieves superior performance metrics and enhances the interpretability of the model's decision-making process. The visualization of attention weights contributes to a more intuitive understanding of the classification process, making TGANet a promising tool in tongue diagnosis and rehabilitation.

TCCGAN: A Stacked Generative Adversarial Network for Clinical Tongue Images Color Correction.

Synthesizing Contrast-enhanced Computed Tomography Images with an Improved Conditional Generative Adversarial Network

Tongue Segmentation and Color Classification Using Deep Convolutional Neural Networks

Data Augmentation Using Image-to-image Translation for Tongue Coating Thickness Classification with Imbalanced Data

Tongue feature recognition to monitor rehabilitation: deep neural network with visual attention mechanism

TISNet-Enhanced Fully Convolutional Network with Encoder-Decoder Structure for Tongue Image Segmentation in Traditional Chinese Medicine

Automatic Tongue Crack Extraction For Real-Time Diagnosis

Contrastive Learning Based Stain Normalization Across Multiple Tumor in Histopathology

StackGAN: Text to Photo-realistic Image Synthesis with Stacked Generative Adversarial Networks

What’s wrong with the tongue: color grading quantization based on hyperspectral images

Automatic Classification Framework of Tongue Feature Based on Convolutional Neural Networks

CaGAN: A Cycle-Consistent Generative Adversarial Network with Attention for Low-Dose CT Imaging

Intelligent quality control of traditional chinese medical tongue diagnosis images based on deep learning

Tongue Colour Diagnosis System Using Convolutional Neural Network

Quantified Vector Oriented Tongue Color Classification

Color Active Contour Models Based Tongue Segmentation in Traditional Chinese Medicine

A Tongue Color Classification Method in TCM Based on Transfer Learning

TCGAN: Three-Channel Generate Adversarial Network

Cascaded CNN for Real-time Tongue Segmentation Based on Key Points Localization