Abstract:Since preparative chromatography is a sustainability challenge due to large amounts of consumables used in downstream processing of biomolecules, protein crystallization offers a promising alternative as a purification method. While the limited crystallizability of proteins often restricts a broad application of crystallization as a purification method, advances in molecular biology, as well as computational methods are pushing the applicability towards integration in biotechnological downstream processes. However, in industrial and academic settings, monitoring protein crystallization processes non-invasively by microscopic photography and automated image evaluation remains a challenging problem. Recently, the identification of single crystal objects using deep learning has been the subject of increased attention for various model systems. However, the advancement of crystal detection using deep learning for biotechnological applications is limited: robust models obtained through supervised machine learning tasks require large-scale and high-quality data sets usually obtained in large projects through extensive manual labeling, an approach that is highly error-prone for dense systems of transparent crystals. For the first time, recent trends involving the use of synthetic data sets for supervised learning are transferred, thus generating photorealistic images of virtual protein crystals in suspension (PCS) through the use of ray tracing algorithms, accompanied by specialized data augmentations modelling experimental noise. Further, it is demonstrated that state-of-the-art models trained with the large-scale synthetic PCS data set outperform similar fine-tuned models based on the average precision metric on a validation data set, followed by experimental validation using high-resolution photomicrographs from stirred tank protein crystallization processes.

Deep-learning based in-situ micrograph analysis of high-density crystallization slurry using image and data enhancement strategy

Deep Learning-Based In Situ Micrograph Synthesis and Augmentation for Crystallization Process Image Analysis

Deep‐learning Based in Situ Image Monitoring Crystal Polymorph and Size Distribution: Modeling and Validation

Deep learning-based on-line image analysis for continuous industrial crystallization processes

Image Analysis For In-Line Measurement Of Multidimensional Size, Shape, And Polymorphic Transformation Of L-Glutamic Acid Using Deep Learning-Based Image Segmentation And Classification

Image Analysis of Crystal Size Distribution and Agglomeration for Β Form L-Glutamic Acid Crystallization Based on YOLOv4 Deep Learning

Deep Learning-Based Image Analysis with RTFormer Network for Measuring 2D Crystal Size Distribution During Cooling Crystallization of Β Form L-glutamic Acid

Potential of Deep Learning Methods for Deep Level Particle Characterization in Crystallization

Investigation of AI Algorithms for Photometric Online Analysis in a Draft Tube Baffle Crystallizer

Revealing the Effects of Microwell Sizes on the Crystal Growth Kinetics of Active Pharmaceutical Ingredients by Deep Learning

Machine learning-based protein crystal detection for monitoring of crystallization processes enabled with large-scale synthetic data sets of photorealistic images

A verified open-access AI-based chemical microparticle image database for in-situ particle visualization and quantification in multi-phase flow

Digital Design of Cooling Crystallization Processes Using a Machine Learning-Based Strategy

Deep Learning-Aided High-Throughput Screening of Time-Resolved Protein Crystallization on Programmable Microliter-Droplet Systems

Predictive Control of Particlesize Distribution of Crystallization Process Using Deep Learning Based Image Analysis

Crystal Image Segmentation Based on Gray Distribution Steepest Descent Method

Highly Efficient Crystallization Studies through Machine Learning and Automation

Spatiotemporal Evolution of Grain Microstructure: A CNN Perspective

Monitoring Sugar Crystallization with Deep Neural Networks

Recent Advances in the Application of Machine Learning to Crystal Behavior and Crystallization Process Control

Automatic Detection of Grains in Partially Recrystallized Microstructures Using Deep Learning