Abstract:Introduction: Hybrid modeling combining First-Principles with machine learning is becoming a pivotal methodology for Biopharma 4.0 enactment. Chinese Hamster Ovary (CHO) cells, being the workhorse for industrial glycoproteins production, have been the object of several hybrid modeling studies. Most previous studies pursued a shallow hybrid modeling approach based on three-layered Feedforward Neural Networks (FFNNs) combined with macroscopic material balance equations. Only recently, the hybrid modeling field is incorporating deep learning into its framework with significant gains in descriptive and predictive power. Methods: This study compares, for the first time, deep and shallow hybrid modeling in a CHO process development context. Data of 24 fed-batch cultivations of a CHO-K1 cell line expressing a target glycoprotein, comprising 30 measured state variables over time, were used to compare both methodologies. Hybrid models with varying FFNN depths (3-5 layers) were systematically compared using two training methodologies. The classical training is based on the Levenberg-Marquardt algorithm, indirect sensitivity equations and cross-validation. The deep learning is based on the Adaptive Moment Estimation Method (ADAM), stochastic regularization and semidirect sensitivity equations. Results and conclusion: The results point to a systematic generalization improvement of deep hybrid models over shallow hybrid models. Overall, the training and testing errors decreased by 14.0% and 23.6% respectively when applying the deep methodology. The Central Processing Unit (CPU) time for training the deep hybrid model increased by 31.6% mainly due to the higher FFNN complexity. The final deep hybrid model is shown to predict the dynamics of the 30 state variables within the error bounds in every test experiment. Notably, the deep hybrid model could predict the metabolic shifts in key metabolites (e.g., lactate, ammonium, glutamine and glutamate) in the test experiments. We expect deep hybrid modeling to accelerate the deployment of high-fidelity digital twins in the biopharma sector in the near future.

Data-driven and physics informed modelling of Chinese Hamster Ovary cell bioreactors

Data-driven and Physics Informed Modelling of Chinese Hamster Ovary Cell Bioreactors

A novel approach for perfusion process design based on a "Grey-Box" kinetic model

Hybrid modeling for in silico optimization of a dynamic perfusion cell culture process

A neural ordinary differential equation model for predicting the growth of Chinese Hamster Ovary cell in a bioreactor system

Hybrid deep modeling of a CHO-K1 fed-batch process: combining first-principles with deep neural networks

Multi-Scale Kinetics Modeling for Cell Culture Process with Metabolic State Transition

CHO cell productivity improvement by genome-scale modeling and pathway analysis: Application to feed supplements

A genome-scale dynamic constraint-based modelling (gDCBM) framework predicts growth dynamics, medium composition and intracellular flux distributions in CHO clonal variations

Data-driven parameterization and development of mechanistic cell cultivation models in monoclonal antibody production processes: Shifts in cell metabolic behavior

Investigating ‘greyness’ of Hybrid Model for Bioprocess Predictive Modelling

Modeling of cell cultivation for monoclonal antibody production processes considering lactate metabolic shifts

Process model comparison and transferability across bioreactor scales and modes of operation for a mammalian cell bioprocess

Model-based Analysis and Optimization of Bioreactor for Hematopoietic Stem Cell Cultivation

An innovative hybrid modeling approach for simultaneous prediction of cell culture process dynamics and product quality

Towards advanced bioprocess optimization: A multiscale modelling approach

A multiscale hybrid modelling methodology for cell cultures enabled by enzyme-constrained dynamic metabolic flux analysis under uncertainty

A Single Dynamic Metabolic Model Can Describe mAb Producing CHO Cell Batch and Fed-Batch Cultures on Different Culture Media

Optimization and Scale-Up of Fermentation Processes Driven by Models

Cell-culture process optimization via model-based predictions of metabolism and protein glycosylation

Kinetic Modeling of Mammalian Cell Culture Bioprocessing: The Quest to Advance Biomanufacturing