Abstract:We propose a novel framework that combines state-of-the-art deep learning approaches with pre- and post-processing algorithms for particle detection in complex/heterogeneous backgrounds common in the manufacturing domain. Traditional methods, like size analyzers and those based on dilution, image processing, or deep learning, typically excel with homogeneous backgrounds. Yet, they often fall short in accurately detecting particles against the intricate and varied backgrounds characteristic of heterogeneous particle–substrate (HPS) interfaces in manufacturing. To address this, we've developed a flexible framework designed to detect particles in diverse environments and input types. Our modular framework hinges on model selection and AI-guided particle detection as its core, with preprocessing and postprocessing as integral components, creating a four-step process. This system is versatile, allowing for various preprocessing, AI model selections, and post-processing strategies. We demonstrate this with an entrainment-based particle delivery method, transferring various particles onto substrates that mimic the HPS interface. By altering particle and substrate properties (e.g., material type, size, roughness, shape) and process parameters (e.g., capillary number) during particle entrainment, we capture images under different ambient lighting conditions, introducing a range of HPS background complexities. In the preprocessing phase, we apply image enhancement and sharpening techniques to improve detection accuracy. Specifically, image enhancement adjusts the dynamic range and histogram, while sharpening increases contrast by combining the high pass filter output with the base image. We introduce an image classifier model (based on the type of heterogeneity), employing Transfer Learning with MobileNet as a Model Selector, to identify the most appropriate AI model (i.e., YOLO model) for analyzing each specific image, thereby enhancing detection accuracy across particle–substrate variations. Following image classification based on heterogeneity, the relevant YOLO model is employed for particle identification, with a distinct YOLO model generated for each heterogeneity type, improving overall classification performance. In the post-processing phase, domain knowledge is used to minimize false positives. Our analysis indicates that the AI-guided framework maintains consistent precision and recall across various HPS conditions, with the harmonic mean of these metrics comparable to those of individual AI model outcomes. This tool shows potential for advancing in-situ process monitoring across multiple manufacturing operations, including high-density powder-based 3D printing, powder metallurgy, extreme environment coatings, particle categorization, and semiconductor manufacturing.

In-line image analysis of particulate processes with deep learning: Optimizing training data generation via copy-paste augmentation

A deep learning solution for particle size analysis in low resolution inline microscopy images based on generative adversarial network

ParticleSeg3D: A Scalable Out-of-the-Box Deep Learning Segmentation Solution for Individual Particle Characterization from Micro CT Images in Mineral Processing and Recycling

Synthetic Image Rendering Solves Annotation Problem in Deep Learning Nanoparticle Segmentation

A Novel Method for Particle Instance Segmentation and Size Measurement

In-situ particle analysis with heterogeneous background: a machine learning approach

Workflow towards automated segmentation of agglomerated, non-spherical particles from electron microscopy images using artificial neural networks

Image-Based Size Analysis of Agglomerated and Partially Sintered Particles via Convolutional Neural Networks

Attenuation-adjusted deep learning of pore defects in 2D radiographs of additive manufacturing powders

Uncertainty-aware particle segmentation for electron microscopy at varied length scales

A deep learned nanowire segmentation model using synthetic data augmentation

Understanding important features of deep learning models for segmentation of high-resolution transmission electron microscopy images

Automated Segmentation and Analysis of Microscopy Images of Laser Powder Bed Fusion Melt Tracks

A verified open-access AI-based chemical microparticle image database for in-situ particle visualization and quantification in multi-phase flow

Data augmentation in microscopic images for material data mining

Spreading anomaly semantic segmentation and 3D reconstruction of binder jet additive manufacturing powder bed images

Deep learning for automated size and shape analysis of nanoparticles in scanning electron microscopy

Deep-learning based in-situ micrograph analysis of high-density crystallization slurry using image and data enhancement strategy

Nanoparticle Recognition on Scanning Probe Microscopy Images Using Computer Vision and Deep Learning

Optical Inline Analysis and Monitoring of Particle Size and Shape Distributions for Multiple Applications: Scientific and Industrial Relevance

DaedalusData: Exploration, Knowledge Externalization and Labeling of Particles in Medical Manufacturing -- A Design Study