Abstract:Chemometric modeling for spectral data is considered a key technology in biopharmaceutical processing to realize real-time process control and release testing. Machine learning (ML) models have been shown to increase the accuracy of various spectral regression and classification tasks, remove challenging preprocessing steps for spectral data, and promise to improve the transferability of models when compared to commonly applied, linear methods. The training and optimization of ML models require large data sets which are not available in the context of biopharmaceutical processing. Generative methods to extend data sets with realistic in silico samples, so-called data augmentation, may provide the means to alleviate this challenge. In this study, we develop and implement a novel data augmentation method for generating in silico spectral data based on local estimation of pure component profiles for training convolutional neural network (CNN) models using four data sets. We simultaneously tune hyperparameters associated with data augmentation and the neural network architecture using Bayesian optimization. Finally, we compare the optimized CNN models with partial least-squares regression models (PLS) in terms of accuracy, robustness, and interpretability. The proposed data augmentation method is shown to produce highly realistic spectral data by adapting the estimates of the pure component profiles to the sampled concentration regimes. Augmenting CNNs with the in silico spectral data is shown to improve the prediction accuracy for the quantification of monoclonal antibody (mAb) size variants by up to 50% in comparison to single-response PLS models. Bayesian structure optimization suggests that multiple convolutional blocks are beneficial for model accuracy and enable transfer across different data sets. Model-agnostic feature importance methods and synthetic noise perturbation are used to directly compare the optimized CNNs with PLS models. This enables the identification of wavelength regions critical for model performance and suggests increased robustness against Gaussian white noise and wavelength shifts of the CNNs compared to the PLS models.

Augmentation Is What You Need!

Boosting Unsupervised Contrastive Learning Using Diffusion-Based Data Augmentation from Scratch

Levenshtein Augmentation Improves Performance of SMILES Based Deep-Learning Synthesis Prediction

Synergy Effect between Convolutional Neural Networks and the Multiplicity of SMILES for Improvement of Molecular Prediction

SMILES Enumeration as Data Augmentation for Neural Network Modeling of Molecules

Augmentation Inside the Network

Data-Efficient Augmentation for Training Neural Networks

Generative data augmentation and automated optimization of convolutional neural networks for process monitoring

Data Augmentation Can Improve Robustness

Smart(Sampling)Augment: Optimal and Efficient Data Augmentation for Semantic Segmentation

Soft Augmentation for Image Classification

RandMSAugment: A Mixed-Sample Augmentation for Limited-Data Scenarios

On the Generalization Effects of Linear Transformations in Data Augmentation

Enhancing Performance of Deep Learning Models with a Novel Data Augmentation Approach

Evaluating the Impact of Data Augmentation on Predictive Model Performance

Transformer-CNN: Fast and Reliable tool for QSAR

Exploring Data Augmentation Methods on Social Media Corpora

Enhancing Protein Predictive Models via Proteins Data Augmentation: A Benchmark and New Directions

A Novel Molecular Representation Learning for Molecular Property Prediction with a Multiple SMILES-Based Augmentation

HybridAugment++: Unified Frequency Spectra Perturbations for Model Robustness

Style Augmentation: Data Augmentation via Style Randomization