Abstract:In the field of computer-aided medical diagnosis, it is crucial to adapt medical image segmentation to limited computing resources. There is tremendous value in developing accurate, real-time vision processing models that require minimal computational resources. When building lightweight models, there is always a trade-off between computational cost and segmentation performance. Performance often suffers when applying models to meet resource-constrained scenarios characterized by computation, memory, or storage constraints. This remains an ongoing challenge. This paper proposes a lightweight network for medical image segmentation. It introduces a lightweight transformer, proposes a simplified core feature extraction network to capture more semantic information, and builds a multi-scale feature interaction guidance framework. The fusion module embedded in this framework is designed to address spatial and channel complexities. Through the multi-scale feature interaction guidance framework and fusion module, the proposed network achieves robust semantic information extraction from low-resolution feature maps and rich spatial information retrieval from high-resolution feature maps while ensuring segmentation performance. This significantly reduces the parameter requirements for maintaining deep features within the network, resulting in faster inference and reduced floating-point operations (FLOPs) and parameter counts. Experimental results on ISIC2017 and ISIC2018 datasets confirm the effectiveness of the proposed network in medical image segmentation tasks. For instance, on the ISIC2017 dataset, the proposed network achieved a segmentation accuracy of 82.33 % mIoU, and a speed of 71.26 FPS on 256 × 256 images using a GeForce GTX 3090 GPU. Furthermore, the proposed network is tremendously lightweight, containing only 0.524M parameters. The corresponding source codes are available at https://github.com/CurbUni/LMIS-lightweight-network .

Lightweight Portrait Segmentation Via Edge-Optimized Attention

Edge Segmentation: Empowering Mobile Telemedicine with Compressed Cellular Neural Networks

AyE-Edge: Automated Deployment Space Search Empowering Accuracy Yet Efficient Real-Time Object Detection on the Edge

Real-time Semantic Segmentation with Weighted Factorized-Depthwise Convolution

Edge-AI-Driven Framework with Efficient Mobile Network Design for Facial Expression Recognition

A Depth Information Aided Real-Time Instance Segmentation Method for Space Task Scenarios under CPU Platform

LightEyes: A Lightweight Fundus Segmentation Network for Mobile Edge Computing

When Humans Meet Machines: Towards Efficient Segmentation Networks.

MOS: A Low Latency and Lightweight Framework for Face Detection, Landmark Localization, and Head Pose Estimation

Towards Real-Time Segmentation on the Edge

Ultra Real-Time Portrait Matting Via Parallel Semantic Guidance

An Optimized Face Recognition for Edge Computing

Boundary-Aware Network for Fast and High-Accuracy Portrait Segmentation

Edge Assisted Real-time Instance Segmentation on Mobile Devices

Lightweight medical image segmentation network with multi-scale feature-guided fusion

Real-time Foreground Object Segmentation Networks Using Long and Short Skip Connections

You Only Segment Once: Towards Real-Time Panoptic Segmentation.

MBSeg: Real-Time Contour-Based Method Instance Segmentation for Egocentric Vision

Fast Portrait Segmentation with Highly Light-weight Network

Efficient Lightweight Attention Network for Face Recognition

EFRNet: A Lightweight Network with Efficient Feature Fusion and Refinement for Real-Time Semantic Segmentation