Optimization-Based Multi-Source Transfer Learning for Modeling of Nonlinear Processes

Ming Xiao,Keerthana Vellayappan,Pravin P S,Krishna Gudena,Zhe Wu
DOI: https://doi.org/10.1016/j.ces.2024.120117
IF: 4.7
2024-04-20
Chemical Engineering Science
Abstract:This work develops an optimization-based multi-source transfer learning scheme for modeling of nonlinear chemical processes. Specifically, a transfer learning neural network model for a target process with limited data is developed using the pre-trained model obtained with multiple source processes. Since the performance of transfer learning models depends on the quality of the pre-trained models, we propose a novel Bayesian optimization problem to optimize the selection of multi-source data for the pre-trained models by first deriving a generalization error bound for multi-source domain adaptation using Y -discrepancy distance. Subsequently, the optimization problem is formulated using the theoretical error bound to select the optimal set of multiple sources, which can provide a good initial guess of the weight parameters for transfer learning model. Finally, a simulation study of a chemical reactor process in Aspen Plus Dynamics is conducted to illustrate the effectiveness of the optimization-based multi-source transfer learning scheme.
engineering, chemical
What problem does this paper attempt to address?