Abstract:We propose a novel framework that combines state-of-the-art deep learning approaches with pre- and post-processing algorithms for particle detection in complex/heterogeneous backgrounds common in the manufacturing domain. Traditional methods, like size analyzers and those based on dilution, image processing, or deep learning, typically excel with homogeneous backgrounds. Yet, they often fall short in accurately detecting particles against the intricate and varied backgrounds characteristic of heterogeneous particle–substrate (HPS) interfaces in manufacturing. To address this, we've developed a flexible framework designed to detect particles in diverse environments and input types. Our modular framework hinges on model selection and AI-guided particle detection as its core, with preprocessing and postprocessing as integral components, creating a four-step process. This system is versatile, allowing for various preprocessing, AI model selections, and post-processing strategies. We demonstrate this with an entrainment-based particle delivery method, transferring various particles onto substrates that mimic the HPS interface. By altering particle and substrate properties (e.g., material type, size, roughness, shape) and process parameters (e.g., capillary number) during particle entrainment, we capture images under different ambient lighting conditions, introducing a range of HPS background complexities. In the preprocessing phase, we apply image enhancement and sharpening techniques to improve detection accuracy. Specifically, image enhancement adjusts the dynamic range and histogram, while sharpening increases contrast by combining the high pass filter output with the base image. We introduce an image classifier model (based on the type of heterogeneity), employing Transfer Learning with MobileNet as a Model Selector, to identify the most appropriate AI model (i.e., YOLO model) for analyzing each specific image, thereby enhancing detection accuracy across particle–substrate variations. Following image classification based on heterogeneity, the relevant YOLO model is employed for particle identification, with a distinct YOLO model generated for each heterogeneity type, improving overall classification performance. In the post-processing phase, domain knowledge is used to minimize false positives. Our analysis indicates that the AI-guided framework maintains consistent precision and recall across various HPS conditions, with the harmonic mean of these metrics comparable to those of individual AI model outcomes. This tool shows potential for advancing in-situ process monitoring across multiple manufacturing operations, including high-density powder-based 3D printing, powder metallurgy, extreme environment coatings, particle categorization, and semiconductor manufacturing.

Pharmaceutical Foreign Particle Detection: An Efficient Method Based on Adaptive Convolution and Multiscale Attention

Deep Multimodel Cascade Method Based on CNN and Random Forest for Pharmaceutical Particle Detection

Joint Deep Learning and Clustering Algorithm for Liquid Particle Detection of Pharmaceutical Injection

A Novel Vision-Based Approach for Detection of Foreign Substances

Automated Machine Vision System for Liquid Particle Inspection of Pharmaceutical Injection

A Novel Approach for Foreign Substances Detection in Injection Using Clustering and Frame Difference

Automated particle inspection of continuously freeze-dried products using computer vision

A System for Automated Detection of Ampoule Injection Impurities

DeepScreen: An Accurate, Rapid, and Anti-Interference Screening Approach for Nanoformulated Medication by Deep Learning

High-Precision Medicine Bottles Vision Online Inspection System and Classification Based on Multifeatures and Ensemble Learning via Independence Test

Intelligent Foreign Particle Inspection Machine for Injection Liquid Examination Based on Modified Pulse-Coupled Neural Networks

Multi-scale surface defect detection method for bottled products based on variable receptive fields and Gather–Distribute feature fusion mechanism

An Online, Non-Destructive Method for Simultaneously Detecting Chemical, Biological, and Physical Properties of Herbal Injections Using Hyperspectral Imaging with Artificial Intelligence

In-situ particle analysis with heterogeneous background: a machine learning approach

Multi-scale Deep Adversarial Network for Particle Detection in Liquid Crystal Module

Implementation of near-infrared spectroscopy and convolutional neural networks for predicting particle size distribution in fluidized bed granulation

On-line detection of foreign substances in glass bottles filled with transfusion solution through computer vision

Research on Key Technologies of Robot for Visual Detection of Foreign Matter in Liquid Medicine Based on Machine Learning Algorithm

The Automated Inspection of Opaque Liquid Vaccines

Cascaded foreign object detection in manufacturing processes using convolutional neural networks and synthetic data generation methodology

Enhanced Nanoparticle Recognition via Deep Learning-Accelerated Plasmonic Sensing