Abstract:Accidents related to the administration of intravenous (IV) medication, such as drug overdose/underdose, drug/patient mis-identification, and delayed bag exchange, occur consistently in clinical fields. Several previous studies have suggested various contact-sensing and image-processing methodologies; however, most of them can increase the workload of nursing staffs during the long-term, continuous monitoring. In this study, we proposed a smart IV pole that can monitor the infusion status of up to four IV medications (patient/drug identification, and liquid residue) with various sizes and hanging positions to reduce IV-related accidents and improve patient safety with the least additional workload; the system consists of 12 cameras, one code scanner, and four controllers. Two types of deep learning models for automated camera selection (CNN-1) and liquid residue monitoring (CNN-2), and three drug residue estimation equations were implemented. The experimental results demonstrated that the accuracy of identification code-checking (60 tests) was 100%. The classification accuracy and the mean inference time of CNN-1 (1200 tests) were 100% and 140 ms. The mean average precision and the mean inference time of CNN-2 (300 tests) were 0.94 and 144 ms. The average error rates between the alarm setting (20, 30, and 40 mL) and the actual drug residue when the alarm first generated were 4.00%, 7.33%, and 4.50% for a 1,000 mL bag; 6.00%, 4.67%, and 2.50% for a 500 mL bag; and 3.00%, 6.00%, and 3.50% for a 100 mL bag, respectively. Our results suggest that the implemented AI-based prototype IV pole is a potential tool for reducing IV-related accidents and improving in-hospital patient safety. Supplementary information: The online version contains supplementary material available at 10.1007/s13534-023-00292-w.

Research on Key Technologies of Robot for Visual Detection of Foreign Matter in Liquid Medicine Based on Machine Learning Algorithm

Visual inspection intelligent robot technology for large infusion industry

The visible foreign matter visual detecting algorithm research in oral liquid

Medicine bottle recognition based on machine vision and deep learning in intravenous medicine dispensing robot*

A Novel Vision-Based Approach for Detection of Foreign Substances

On-line detection of foreign substances in glass bottles filled with transfusion solution through computer vision

An Infusion Liquid Level Detection Method Based on Improved ROI Segmentation and Horizontal Lines Modification

A Novel Approach for Foreign Substances Detection in Injection Using Clustering and Frame Difference

Automated Machine Vision System for Liquid Particle Inspection of Pharmaceutical Injection

Research on Position Tracking Algorithm with Vision Sensor for the Auto Liquid Filling Machine

Machine vision model for detection of foreign substances at the bottom of empty large volume parenteral

Intelligent Detection of Liquid-Solid Interface Quality of Ultra-Clean Pumps for Semiconductor Manufacturing

High-Precision Medicine Bottles Vision Online Inspection System and Classification Based on Multifeatures and Ensemble Learning via Independence Test

Deep learning-based monitoring technique for real-time intravenous medication bag status

An Adaptive Parameter Optimization Deep Learning Model for Energetic Liquid Vision Recognition Based on Feedback Mechanism

Design and Operation of a Deep-Learning-based Fresh Tea-Leaf Sorting Robot

Needle Detection and Localisation for Robot‐assisted Subretinal Injection Using Deep Learning

Detection of Glass Chips in Liquid Injection Based on Computer Vision

Machine Vision for Detecting Defects in Liquid Bottles: An Industrial Application for Food and Packaging Sector

Study Of Automatic Inspection Of Impurities In Bottled Medical Solution Based On Machine Vision

Pharmaceutical Foreign Particle Detection: An Efficient Method Based on Adaptive Convolution and Multiscale Attention