Abstract:Instance segmentation of faces and mouth-opening degrees is an important technology for meal-assisting robotics in food delivery safety. However, due to the diversity in in shape, color, and posture of faces and the mouth with small area contour, easy to deform, and occluded, it is challenging to real-time and accurate instance segmentation. In this paper, we proposed a novel method for instance segmentation of faces and mouth-opening degrees. Specifically, in backbone network, deformable convolution was introduced to enhance the ability to capture finer-grained spatial information and the CloFormer module was introduced to improve the ability to capture high-frequency local and low-frequency global information. In neck network, classical convolution and C2f modules are replaced by GSConv and VoV-GSCSP aggregation modules, respectively, to reduce the complexity and floating-point operations of models. Finally, in localization loss, CIOU loss was replaced by WIOU loss to reduce the competitiveness of high-quality anchor frames and mask the influence of low-quality samples, which in turn improves localization accuracy and generalization ability. It is abbreviated as the DCGW-YOLOv8n-seg model. The DCGW-YOLOv8n-seg model was compared with the baseline YOLOv8n-seg model and several state-of-the-art instance segmentation models on datasets, respectively. The results show that the DCGW-YOLOv8n-seg model is characterized by high accuracy, speed, robustness, and generalization ability. The effectiveness of each improvement in improving the model performance was verified by ablation experiments. Finally, the DCGW-YOLOv8n-seg model was applied to the instance segmentation experiment of meal-assisting robotics. The results show that the DCGW-YOLOv8n-seg model can better realize the instance segmentation effect of faces and mouth-opening degrees. The novel method proposed can provide a guiding theoretical basis for meal-assisting robotics in food delivery safety and can provide a reference value for computer vision and image instance segmentation.

NDAM-YOLOseg: a real-time instance segmentation model based on multi-head attention mechanism

GHA-Inst: a real-time instance segmentation model utilizing YOLO detection framework

YOLOMask, an Instance Segmentation Algorithm Based on Complementary Fusion Network

Instance Segmentation of Faces and Mouth-Opening Degrees Based on Improved YOLOv8 Method

Research on an underwater image segmentation algorithm based on YOLOv8

INSTA-YOLO: Real-Time Instance Segmentation

Real-Time Instance Segmentation Method Based on Location Attention

AM YOLO: adaptive multi-scale YOLO for ship instance segmentation

YOLO Based Deep Learning Model for Segmenting the Color Images

DAMO-YOLO : A Report on Real-Time Object Detection Design

Real-time and accurate model of instance segmentation of foods

You Only Look at Once for Real-time and Generic Multi-Task

ASF-YOLO: A Novel YOLO Model with Attentional Scale Sequence Fusion for Cell Instance Segmentation

YOLOv10: Real-Time End-to-End Object Detection

YOLACT: Real-Time Instance Segmentation

A YOLO-NL object detector for real-time detection

A Two-Pipeline Instance Segmentation Network via Boundary Enhancement for Scene Understanding

Open-YOLO 3D: Towards Fast and Accurate Open-Vocabulary 3D Instance Segmentation