Abstract:The detection of pharmaceutical product quality is indispensable and crucial in drug manufacture. In particular, the detection of liquid pharmaceutical products is generally performed manually and offline. However, this type of method is inefficient and possesses low precision due to limited personal sensing and eyesight capabilities. Since recent advanced computational intelligence (CI) algorithms have achieved great successes in computer vision, CI (e.g., deep neural networks (DNNs)) is expected to provide efficient and powerful tools that will substantially improve the decision-making of autonomous systems. Moreover, with the current automatic detection methods, it is still a challenge to detect tiny particles efficiently in liquid products. This article proposes an end-to-end deep learning (DL) method with adaptive convolution and multiscale attention to locate and classify foreign particles. First, we present a pixel-adaptive feature extraction (PAFE) method for extracting fine-grained features and reducing the intraclass disparities between particles. Following that, a multiscale attention-based feature fusion (MAFF) method, which effectively fuses the pixel-level and semantic-level information of particles, is proposed. Finally, we use a feature-selective anchor-free detection (FSAD) method to quickly detect foreign particles in liquid pharmaceuticals. To confirm the above initiatives, we validate the proposed method on a liquid pharmaceutical dataset, achieving a missed detection rate of 3.6 percent. The speed of our method is an order of magnitude faster than that of other methods, possibly reaching 15 frames per second (FPS). In addition, we test the models transferability on a wine dataset.

On-line detection of foreign substances in glass bottles filled with transfusion solution through computer vision

Detection of Glass Chips in Liquid Injection Based on Computer Vision

A Novel Vision-Based Approach for Detection of Foreign Substances

Design and emulation of image detection system for empty bottles

Glass Detection and Recognition Based on the Fusion of Ultrasonic Sensor and RGB-D Sensor for the Visually Impaired

Study Of Automatic Inspection Of Impurities In Bottled Medical Solution Based On Machine Vision

A Novel Approach for Foreign Substances Detection in Injection Using Clustering and Frame Difference

The Design of Steroscopic Vision System for Detection of Impurities

High-Precision Medicine Bottles Vision Online Inspection System and Classification Based on Multifeatures and Ensemble Learning via Independence Test

Machine vision model for detection of foreign substances at the bottom of empty large volume parenteral

Kurtosis-based connected components method for detecting small and transparent foreign objects in semiopaque bottles

Research on Key Technologies of Robot for Visual Detection of Foreign Matter in Liquid Medicine Based on Machine Learning Algorithm

Machine Vision-based Integrated Inspection System for Beverage Bottles with Multiple Defects

The visible foreign matter visual detecting algorithm research in oral liquid

Automated Visual Inspection of Glass Bottle Bottom With Saliency Detection and Template Matching

Medicine bottle recognition based on machine vision and deep learning in intravenous medicine dispensing robot*

Automated Machine Vision System for Liquid Particle Inspection of Pharmaceutical Injection

High Precision Medicine Bottles Vision Online Inspection System and Classification Based on Multi-Features and Ensemble Learning via Independence Test

Machine Vision for Detecting Defects in Liquid Bottles: An Industrial Application for Food and Packaging Sector

Study and Application of Automatic Count System Based on Computer Vision Detect Technology

Pharmaceutical Foreign Particle Detection: An Efficient Method Based on Adaptive Convolution and Multiscale Attention