Abstract:This paper focuses on improving the performance of scientific instrumentation that uses glass spray chambers for sample introduction, such as spectrometers, which are widely used in analytical chemistry, by detecting incidents using deep convolutional models. The performance of these instruments can be affected by the quality of the introduction of the sample into the spray chamber. Among the indicators of poor quality sample introduction are two primary incidents: The formation of liquid beads on the surface of the spray chamber, and flooding at the bottom of the spray chamber. Detecting such events autonomously as they occur can assist with improving the overall operational accuracy and efficacy of the chemical analysis, and avoid severe incidents such as malfunction and instrument damage. In contrast to objects commonly seen in the real world, beading and flooding detection are more challenging since they are of significantly small size and transparent. Furthermore, the non-rigid property increases the difficulty of the detection of these incidents, as such that existing deep-learning-based object detection frameworks are prone to fail for this task. There is no former work that uses computer vision to detect these incidents in the chemistry industry. In this work, we propose two frameworks for the detection task of these two incidents, which not only leverage the modern deep learning architectures but also integrate with expert knowledge of the problems. Specifically, the proposed networks first localize the regions of interest where the incidents are most likely generated and then refine these incident outputs. The use of data augmentation and synthesis, and choice of negative sampling in training, allows for a large increase in accuracy while remaining a real-time system for inference. In the data collected from our laboratory, our method surpasses widely used object detection baselines and can correctly detect 95% of the beads and 98% of the flooding. At the same time, out method can process four frames per second and is able to be implemented in real time.

The Automatic Liquid Particles Detection for Injection

Joint Deep Learning and Clustering Algorithm for Liquid Particle Detection of Pharmaceutical Injection

An Intelligent Foreign Substance Inspection Method for Injection Based on Machine Vision

A Novel Approach for Foreign Substances Detection in Injection Using Clustering and Frame Difference

Needle Detection and Localisation for Robot‐assisted Subretinal Injection Using Deep Learning

Automated Machine Vision System for Liquid Particle Inspection of Pharmaceutical Injection

Pharmaceutical Foreign Particle Detection: An Efficient Method Based on Adaptive Convolution and Multiscale Attention

Application of Mobile Injection Molding Pump Defect Detection System Based on Deep Learning

Object detection and tracking for a vision guided automated suspended cell injection process

N-fold Bernoulli Probability Based Adaptive Fast-Tracking Algorithm and Its Application to Autonomous Aerial Refuelling

Intelligent Foreign Particle Inspection Machine for Injection Liquid Examination Based on Modified Pulse-Coupled Neural Networks

Approaches for Accuracy Improvement of the X-ray Image Defect Detection of Automobile Casting Aluminum Parts Based on Deep Learning

A Novel Vision-Based Approach for Detection of Foreign Substances

Deep Multimodel Cascade Method Based on CNN and Random Forest for Pharmaceutical Particle Detection

Automatic Detection of Injection and Press Mold Parts on 2D Drawing Using Deep Neural Network

Real-time Detection of Aerial Refueling Drogue Based on Convolutional Neural Network

Convolutional neural networks automate detection for tracking of submicron scale particles in 2D and 3D

Deep Joint Denoising and Detection for Enhanced Intracellular Particle Analysis

Autonomous Incident Detection on Spectrometers Using Deep Convolutional Models

Detection of a casting defect tracked by deep convolution neural network

Automatic and accurate needle detection in 2D ultrasound during robot-assisted needle insertion process