Abstract:Background and objectiveAccurate segmentation of tongue image is a prerequisite to intelligent tongue diagnosis. Current tongue segmentation algorithms have good performances in tongue image segmentation in a standard environment. However, tongue segmentation is still challenging to be used in an open environment due to factors such as the complex external open environment and relatively simple equipment. This study aims to construct a novel deep neural network tongue segmentation system suitable for mobile devices, which performs tongue segmentation rapidly in an open environment.MethodsFirstly, a new OET-NET is constructed based on U-Net combined with a residual soft connection module and salient image fusion module to train the tongue image from a different device. Secondly, a new loss function is established based on the Focal loss. Finally, the number of network parameters, the inferred time are treated as indicators to evaluate the model. At the same time, MIoU, precision, recall, F1-Score and FLOPs are used to compare with different tongue segmentation frameworks.ResultsAccording to the training results, the proposed OET-NET’s parameter number is 7.75 MB, the required time of tongue segmentation is about 59 ms/piece, the MIoU is 96.98% and the FLOPs is 15.50 MFLOPs. Compared with U-Net, OET-NET increased the total number of parameters by 0.39 MB and the inference time by 1 ms/piece, but achieved the best segmentation effect compared with the reference models.ConclusionsAccording to less time consumption and less space, the precision of segmentation results is higher than that of other segmentation models. OET-NET can quickly and accurately extract tongue bodies from the open environment, and its relatively smaller number of model parameters made it suitable for mobile devices. It is potential for OET-NET to be applied to tongue image segmentation on mobile terminals.

A Robust Multi-Environment Tongue Image Segmentation Method for Computer-Aided Tongue Diagnosis

Automatic Tongue Image Segmentation for Real-Time Remote Diagnosis

S5Utis: Structured State-Space Sequence SegNeXt UNet-like Tongue Image Segmentation in Traditional Chinese Medicine

Automatic Tongue Image Matting for Remote Medical Diagnosis.

A Method for Tongue Detection Based on Image Segmentation

A novel tongue segmentation method based on improved U-Net

TISNet-Enhanced Fully Convolutional Network with Encoder-Decoder Structure for Tongue Image Segmentation in Traditional Chinese Medicine

Objectification of Tongue Diagnosis in Traditional Medicine, Data Analysis, and Study Application.

Tongue Image Segmentation Via Thresholding and Gray Projection.

An Intelligent Tongue Diagnosis System via Deep Learning on the Android Platform

Automatic Segmentation of Color Tongue Image Using Deep Asymmetric Convolution Skip Net.

Automatic Tongue Image Segmentation Based on Thresholding and an Improved Level Set Model

An Automatic Tongue Detection and Segmentation Framework for Computer-Aided Tongue Image Analysis

Color Active Contour Models Based Tongue Segmentation in Traditional Chinese Medicine

HPA-UNet: A Hybrid Post-Processing Attention U-Net for Tongue Segmentation

Image segmentation in tongue characterization]

A novel tongue feature extraction method on mobile devices

Lw-TISNet: Light-Weight Convolutional Neural Network Incorporating Attention Mechanism and Multiple Supervision Strategy for Tongue Image Segmentation

Automatic tongue location and segmentation

An Efficient Tongue Segmentation Model Based on U-Net Framework.

TongueSAM: An Universal Tongue Segmentation Model Based on SAM with Zero-Shot