Abstract:We propose a novel framework that combines state-of-the-art deep learning approaches with pre- and post-processing algorithms for particle detection in complex/heterogeneous backgrounds common in the manufacturing domain. Traditional methods, like size analyzers and those based on dilution, image processing, or deep learning, typically excel with homogeneous backgrounds. Yet, they often fall short in accurately detecting particles against the intricate and varied backgrounds characteristic of heterogeneous particle–substrate (HPS) interfaces in manufacturing. To address this, we've developed a flexible framework designed to detect particles in diverse environments and input types. Our modular framework hinges on model selection and AI-guided particle detection as its core, with preprocessing and postprocessing as integral components, creating a four-step process. This system is versatile, allowing for various preprocessing, AI model selections, and post-processing strategies. We demonstrate this with an entrainment-based particle delivery method, transferring various particles onto substrates that mimic the HPS interface. By altering particle and substrate properties (e.g., material type, size, roughness, shape) and process parameters (e.g., capillary number) during particle entrainment, we capture images under different ambient lighting conditions, introducing a range of HPS background complexities. In the preprocessing phase, we apply image enhancement and sharpening techniques to improve detection accuracy. Specifically, image enhancement adjusts the dynamic range and histogram, while sharpening increases contrast by combining the high pass filter output with the base image. We introduce an image classifier model (based on the type of heterogeneity), employing Transfer Learning with MobileNet as a Model Selector, to identify the most appropriate AI model (i.e., YOLO model) for analyzing each specific image, thereby enhancing detection accuracy across particle–substrate variations. Following image classification based on heterogeneity, the relevant YOLO model is employed for particle identification, with a distinct YOLO model generated for each heterogeneity type, improving overall classification performance. In the post-processing phase, domain knowledge is used to minimize false positives. Our analysis indicates that the AI-guided framework maintains consistent precision and recall across various HPS conditions, with the harmonic mean of these metrics comparable to those of individual AI model outcomes. This tool shows potential for advancing in-situ process monitoring across multiple manufacturing operations, including high-density powder-based 3D printing, powder metallurgy, extreme environment coatings, particle categorization, and semiconductor manufacturing.

Sensitivity and Uncertainty Analysis of Micro-Flow Imaging for Sub-Visible Particle Measurements Using Artificial Neural Network

Testing Precision Limits of Neural Network-Based Quality Control Metrics in High-Throughput Digital Microscopy

Particle Formation in Response to Different Protein Formulations and Containers: Insights from Machine Learning Analysis of Particle Images

Quantitative Analysis of Moisture Content and Particle Size in a Fluidized Bed Granulation Process Using Near Infrared Spectroscopy and Acoustic Emission Combined with Data Fusion Strategies.

Using Deep Convolutional Neural Networks to Circumvent Morphological Feature Specification when Classifying Subvisible Protein Aggregates from Micro-Flow Images

Features in Backgrounds of Microscopy Images Introduce Biases in Machine Learning Analyses

Artificial intelligence-based droplet size prediction for microfluidic system

Artificial neural network modelling hydrodenticity for optimal design by microfluidics of polymer nanoparticles to apply in magnetic resonance imaging

A deep learning solution for particle size analysis in low resolution inline microscopy images based on generative adversarial network

Transfer Learning Analysis for Subvisible Particle Flow Imaging of Pharmaceutical Formulations

In-situ particle analysis with heterogeneous background: a machine learning approach

Mie Sensing with Neural Networks: Recognition of Nano-Object Parameters, the Invisibility Point, and Restricted Models

Droplet based microfluidics integrated with machine learning

Assessment of subvisible particles in biopharmaceuticals with image feature extraction and machine learning

Precise and Fast Microdroplet Size Distribution Measurement Using Deep Learning

Detection and Metrology of Micro-Nano Particles through the Integration of Image and Laser Modes

Application of advanced machine learning algorithms for anomaly detection and quantitative prediction in protein A chromatography

On the additive artificial intelligence-based discovery of nanoparticle neurodegenerative disease drug delivery systems

Hyperspectral Enhanced Imaging Analysis of Nanoparticles Using Machine Learning Methods

Closed, one-stop intelligent and accurate particle characterization based on micro-Raman spectroscopy and digital microfluidics

PREPRINT Machine Learning for the Sensitivity Analysis of a Model of the Cellular Uptake of Nanoparticles for the Treatment of Cancer