Abstract:Instance segmentation of faces and mouth-opening degrees is an important technology for meal-assisting robotics in food delivery safety. However, due to the diversity in in shape, color, and posture of faces and the mouth with small area contour, easy to deform, and occluded, it is challenging to real-time and accurate instance segmentation. In this paper, we proposed a novel method for instance segmentation of faces and mouth-opening degrees. Specifically, in backbone network, deformable convolution was introduced to enhance the ability to capture finer-grained spatial information and the CloFormer module was introduced to improve the ability to capture high-frequency local and low-frequency global information. In neck network, classical convolution and C2f modules are replaced by GSConv and VoV-GSCSP aggregation modules, respectively, to reduce the complexity and floating-point operations of models. Finally, in localization loss, CIOU loss was replaced by WIOU loss to reduce the competitiveness of high-quality anchor frames and mask the influence of low-quality samples, which in turn improves localization accuracy and generalization ability. It is abbreviated as the DCGW-YOLOv8n-seg model. The DCGW-YOLOv8n-seg model was compared with the baseline YOLOv8n-seg model and several state-of-the-art instance segmentation models on datasets, respectively. The results show that the DCGW-YOLOv8n-seg model is characterized by high accuracy, speed, robustness, and generalization ability. The effectiveness of each improvement in improving the model performance was verified by ablation experiments. Finally, the DCGW-YOLOv8n-seg model was applied to the instance segmentation experiment of meal-assisting robotics. The results show that the DCGW-YOLOv8n-seg model can better realize the instance segmentation effect of faces and mouth-opening degrees. The novel method proposed can provide a guiding theoretical basis for meal-assisting robotics in food delivery safety and can provide a reference value for computer vision and image instance segmentation.

GHA-Inst: a real-time instance segmentation model utilizing YOLO detection framework

NDAM-YOLOseg: a real-time instance segmentation model based on multi-head attention mechanism

INSTA-YOLO: Real-Time Instance Segmentation

YOLACT: Real-Time Instance Segmentation

YOLOMask, an Instance Segmentation Algorithm Based on Complementary Fusion Network

A Depth Information Aided Real-Time Instance Segmentation Method for Space Task Scenarios under CPU Platform

Real-Time Instance Segmentation Method Based on Location Attention

Instance Segmentation of Faces and Mouth-Opening Degrees Based on Improved YOLOv8 Method

A Two-Pipeline Instance Segmentation Network via Boundary Enhancement for Scene Understanding

Sparse Instance Activation for Real-Time Instance Segmentation

QueryInst: Parallelly Supervised Mask Query for Instance Segmentation

Real-time Instance Segmentation with Assembly Parallel Task

CompleteInst: An Efficient Instance Segmentation Network for Missed Detection Scene of Autonomous Driving

High-Resolution Remote Sensing Image Segmentation With Global-Guided Normalization and Local Affinity Distillation

Combining Soft and Hard Attentions for High-Quality Single-Stage Instance Segmentation

Research on an underwater image segmentation algorithm based on YOLOv8

You Only Look at Once for Real-time and Generic Multi-Task

Efficient Automatic Driving Instance Segmentation Method Based on Detection

OccludedInst: an Efficient Instance Segmentation Network for Automatic Driving Occlusion Scenes