Bayesian Based Reaction Optimization for Complex Continuous Gas-Liquid-solid Reactions

Runzhe Liang,Xiaonan Duan,Jisong Zhang,Zhihong Yuan

DOI: https://doi.org/10.1039/d1re00397f

IF: 5.2002

2021-01-01

Reaction Chemistry & Engineering

Abstract:In recent years, self-optimization strategies have been gradually utilized for the determination of optimal reaction conditions owing to their high convenience and independence from researchers' experience.

What problem does this paper attempt to address?

Kinetic Parameter Estimation of the Polyethylene Process by Bayesian Optimization

Shuyuan Fan,Xinpeng Zhang,Xiaodong Hong,Zuwei Liao,Yuming Chen,Congjing Ren,Yao Yang,Jingdai Wang,Yongrong Yang

DOI: https://doi.org/10.1021/acs.iecr.3c04665

2024-01-01

Industrial & Engineering Chemistry Research

Abstract:The design and optimization of polymerization processes rely on accurate kinetic parameters of polymerization reactions since they have a significant impact on polymer properties. We develop a kinetic parameter estimation methodology for non-steady-state olefin polymerization processes. A dynamic model for olefin polymerization reaction kinetics based on the method of moments and instantaneous distribution method is established, which considers reaction temperature fluctuations and concentration variation during polymerization. Bayesian optimization (BO) algorithm is applied in the parameter estimation framework, where the kinetic model is treated as a black box function. The effectiveness of the method developed in this article was demonstrated through three cases, and the parameter estimation strategies used in other literature studies were compared. Additionally, we conduct a comparison of the fitting and extrapolation results obtained from diverse algorithms. Notably, BO emerges as a favorable alternative to deterministic algorithms, as it circumvents the challenges inherent in utilizing gradient-based optimization methods for complex polymerization dynamics models and is more suitable for scenarios with fast prediction in high-throughput experiments. Furthermore, using a dynamic kinetic model is crucial for kinetic parameter estimation in non-steady-state olefin polymerization, as it can reflect the dynamic changes with reaction temperature and concentrations.
Efficient Hybrid Strategy for Simultaneous Design of Refinery Hydrogen Networks and Pressure Swing Adsorption Unit

Lingjun Huang,Xiaodong Hong,Zuwei Liao,Yao Yang,Jingdai Wang,Yongrong Yang

DOI: https://doi.org/10.1016/j.jclepro.2024.142858

IF: 11.1

2024-01-01

Journal of Cleaner Production

Abstract:Refineries face increasing hydrogen demand due to the consumption of heavy and sour crude oil. This study presents a novel hybrid method to optimize hydrogen network configurations with a rigorous pressure swing adsorption (PSA) process model. This method utilizes Bayesian optimization to address the upper-level unknown constraints black-box optimization problem while employing deterministic algorithms to manage the lower-level nonlinear programming problem. Furthermore, infeasible regions are transformed into feasible ones by introducing a dummy stream, and the costs incurred during the transformation process are accurately calculated. The proposed method is validated using two literature cases. In Case 1, Bayesian optimization outperformed the Kriging model, resulting in a 7.84% reduction in total annual cost (TAC). In Case 2, a comparison of four search strategies revealed the developed two-phase strategy as the most effective one. This method offers a powerful and practical tool for optimizing real-world hydrogen networks with PSA processes.
Bayesian reaction optimization as a tool for chemical synthesis

Benjamin J. Shields,Jason Stevens,Jun Li,Marvin Parasram,Farhan Damani,Jesus I. Martinez Alvarado,Jacob M. Janey,Ryan P. Adams,Abigail G. Doyle

DOI: https://doi.org/10.1038/s41586-021-03213-y

IF: 64.8

2021-02-03

Nature

Abstract:Reaction optimization is fundamental to synthetic chemistry, from optimizing the yield of industrial processes to selecting conditions for the preparation of medicinal candidates<a href="/articles/s41586-021-03213-y#ref-CR1">1</a>. Likewise, parameter optimization is omnipresent in artificial intelligence, from tuning virtual personal assistants to training social media and product recommendation systems<a href="/articles/s41586-021-03213-y#ref-CR2">2</a>. Owing to the high cost associated with carrying out experiments, scientists in both areas set numerous (hyper)parameter values by evaluating only a small subset of the possible configurations. Bayesian optimization, an iterative response surface-based global optimization algorithm, has demonstrated exceptional performance in the tuning of machine learning models<a href="/articles/s41586-021-03213-y#ref-CR3">3</a>. Bayesian optimization has also been recently applied in chemistry<a href="#ref-CR4">4</a>,<a href="#ref-CR5">5</a>,<a href="#ref-CR6">6</a>,<a href="#ref-CR7">7</a>,<a href="#ref-CR8">8</a>,<a href="/articles/s41586-021-03213-y#ref-CR9">9</a>; however, its application and assessment for reaction optimization in synthetic chemistry has not been investigated. Here we report the development of a framework for Bayesian reaction optimization and an open-source software tool that allows chemists to easily integrate state-of-the-art optimization algorithms into their everyday laboratory practices. We collect a large benchmark dataset for a palladium-catalysed direct arylation reaction, perform a systematic study of Bayesian optimization compared to human decision-making in reaction optimization, and apply Bayesian optimization to two real-world optimization efforts (Mitsunobu and deoxyfluorination reactions). Benchmarking is accomplished via an online game that links the decisions made by expert chemists and engineers to real experiments run in the laboratory. Our findings demonstrate that Bayesian optimization outperforms human decisionmaking in both average optimization efficiency (number of experiments) and consistency (variance of outcome against initially available data). Overall, our studies suggest that adopting Bayesian optimization methods into everyday laboratory practices could facilitate more efficient synthesis of functional chemicals by enabling better-informed, data-driven decisions about which experiments to run.

multidisciplinary sciences
An Efficient Latent Variable Optimization Approach with Stochastic Constraints for Complex Industrial Process

Zhengshun Fei,Kangling Liu,Bin Hu,Jun Liang

DOI: https://doi.org/10.1016/j.cjche.2015.05.009

2015-01-01

Abstract:For complex chemical processes, process optimization is usually performed on causal models from first principle models. When the mechanism models cannot be obtained easily, restricted model built by process data is used for dynamic process optimization. A new strategy is proposed for complex process optimization, in which latent variables are used as decision variables and statistics is used to describe constraints. As the constraint condition will be more complex by projecting the original variable to latent space, Hotelling T2 statistics is introduced for constraint formulation in latent space. In this way, the constraint is simplified when the optimization is solved in low-dimensional space of latent variable. The validity of the methodology is illustrated in pH-level optimal control process and practical polypropylene grade transition process.
A Novel Fast Dynamic Optimization Approach for Complex Multivariable Chemical Process Systems

Ping Liu,Guodong Li,Xinggao Liu,Zeyin Zhang

DOI: https://doi.org/10.1002/cjce.22633

2016-01-01

Abstract:A novel fast dynamic optimization approach is proposed for complex multivariable chemical process systems, where the control variables are parameterized with different non-uniform time grids and are treated as optimal decision variables to obtain the optimal switching structures for tackling the shortcoming caused by the conventional uniform parameterization method. Meanwhile, an adaptive fast calculation approach is proposed to calculate the differential equations so as to decrease the optimization time. The gradient formulae of decision variables are therefore further derived so that the conventional gradient-based optimization algorithm can be utilized easily. Two well-known complex multivariable systems in engineering are tested as illustrations and are compared with other literature reports in detail, where the uniform discretization control vector parameterization (ud-CVP) method is also developed as the comparative base. Numerical results show that the proposed method can achieve better optimization results with fewer parameters and lower computation costs.
Combining Bayesian optimization and automation to simultaneously optimize reaction conditions and routes

Oliver Schilter,Daniel Pacheco Gutierrez,Linnea M. Folkmann,Alessandro Castrogiovanni,Alberto García-Durán,Federico Zipoli,Loïc M. Roch,Teodoro Laino

DOI: https://doi.org/10.1039/d3sc05607d

IF: 8.4

2024-05-01

Chemical Science

Abstract:Reaching optimal reaction conditions is crucial to achieve high yields, minimal by-products, and environmentally sustainable chemical reactions. With the recent rise of artificial intelligence, there has been a shift from traditional Edisonian trial-and-error optimization to data-driven and automated approaches, which offer significant advantages. Here, we showcase the capabilities of an integrated platform; we conducted simultaneous optimizations of four different terminal alkynes and two reaction routes using an automation platform combined with a Bayesian optimization platform. Remarkably, we achieved a conversion rate of over 80% for all four substrates in 23 experiments, covering ca. 0.2% of the combinatorial space. Further analysis allowed us to identify the influence of different reaction parameters on the reaction outcomes, demonstrating the potential for expedited reaction condition optimization and the prospect of more efficient chemical processes in the future.

chemistry, multidisciplinary
A physically encoded Bayesian assistant for the optimization of multicomponent reactions

DOI: https://doi.org/10.1038/s41557-024-01547-4

IF: 24.274

2024-06-13

Nature Chemistry

Abstract:The optimization of chemical reactions can be laborious, particularly in the case of complex, multicomponent catalytic cycles. Now, it is shown that Bayesian optimization methods, underpinned by explainable computational physical models, can guide chemists to discover efficient organic molecular metallophotocatalyst formulations, avoiding the use of precious metals such as iridium.

chemistry, multidisciplinary
Race to the bottom: Bayesian optimisation for chemical problems

Alex Ganose,Aron Walsh,Yifan Wu

DOI: https://doi.org/10.26434/chemrxiv-2023-l8sms

2023-12-06

Abstract:What is the minimum number of experiments, or calculations, required to find an optimal solution? Relevant chemical problems range from identifying a compound with target functionality within a given phase space to controlling materials synthesis and device fabrication conditions. A common feature in this application domain is that both the dimensionality of the problems and the cost of evaluations are high. The selection of an appropriate optimisation technique is key, with standard choices including iterative (e.g. steepest descent) and heuristic (e.g. simulated annealing) approaches, which are complemented by a new generation of statistical machine learning methods. Here we pay attention to progress in Bayesian optimisation. We highlight recent success cases and discuss the challenges of using machine learning with automated research workflows that produce small and noisy data sets. Finally, we outline opportunities for developments in hybrid algorithms for robust and efficient searches.

Chemistry
Bayesian optimization for chemical products and functional materials

Ke Wang,Alexander W Dowling

DOI: https://doi.org/10.1016/j.coche.2021.100728

IF: 6.117

2022-06-01

Current Opinion in Chemical Engineering

Abstract:The design of chemical-based products and functional materials is vital to modern technologies, yet remains expensive and slow. Artificial intelligence and machine learning offer new approaches to leverage data to overcome these challenges. This review focuses on recent applications of Bayesian optimization (BO) to chemical products and materials including molecular design, drug discovery, molecular modeling, electrolyte design, and additive manufacturing. Numerous examples show how BO often requires an order of magnitude fewer experiments than Edisonian search. The essential equations for BO are introduced in a self-contained primer specifically written for chemical engineers and others new to the area. Finally, the review discusses four current research directions for BO and their relevance to product and materials design.

engineering, chemical,biotechnology & applied microbiology
Practical Path-based Bayesian Optimization

Jose Pablo Folch,James Odgers,Shiqiang Zhang,Robert M Lee,Behrang Shafei,David Walz,Calvin Tsay,Mark van der Wilk,Ruth Misener

2023-12-01

Abstract:There has been a surge in interest in data-driven experimental design with applications to chemical engineering and drug manufacturing. Bayesian optimization (BO) has proven to be adaptable to such cases, since we can model the reactions of interest as expensive black-box functions. Sometimes, the cost of this black-box functions can be separated into two parts: (a) the cost of the experiment itself, and (b) the cost of changing the input parameters. In this short paper, we extend the SnAKe algorithm to deal with both types of costs simultaneously. We further propose extensions to the case of a maximum allowable input change, as well as to the multi-objective setting.

Machine Learning,Optimization and Control,Methodology
Dynamic Optimization of Multivariable Endothermic Reaction in Cascade CSTR

Yang Chen,Zhijiang Shao,Jixin Qian,Kexin Wang,Zhiliang Zhan,Zuhua Xu

DOI: https://doi.org/10.1109/wcica.2010.5553780

2010-01-01

Abstract:The dynamic optimization problem of a multivariable endothermic reaction in cascade continuous stirred tank reactors is solved with simultaneous method in this paper. Radau collocation is applied in discretization because of its stiff decay and high precision. A two-layer optimization is presented to get a fast convergence rate when dealing with the nonlinear case. In the industry process, the load variation may be very large and may cause output variable's big overshoot. In order to reduce the overshoot, a segmentation load variation method is introduced. The good results of this nonlinear ordinary differential equations system show the validity of these methods.
CAPBO: A Cost‐aware Parallelized Bayesian Optimization Method for Chemical Reaction Optimization

Runzhe Liang,Haoyang Hu,Yueheng Han,Bingzhen Chen,Zhihong Yuan

DOI: https://doi.org/10.1002/aic.18316

IF: 4.167

2024-01-01

AIChE Journal

Abstract:Bayesian optimization employs probabilistic surrogate models to effectively address expensive and time-consuming closed-loop chemical experimental design. However, traditional Bayesian optimization focuses on reducing the number of iterations and follows an inherently sequential process (with one new data point sampled in each iteration), which is an inefficient means of exploiting and characterizing reactions using parallel microreactors. In this article, we present an approach that overcomes this issue by considering two essential factors: experimental cost sensitivity and parallelization. We propose a novel cost-aware parallelized Bayesian optimization method (CAPBO) in which the goal is changed from reducing the number of iterations to reducing the experimental cost, with quantitative experimental speed-up achieved through parallelization. The combination of these two items greatly fits the need of reaction optimization, leading to better optimization effects. Benchmarking and case studies demonstrate that the proposed method significantly outperforms traditional Bayesian optimization and considerably improves the optimization efficiency while maintaining the simplicity of the framework.
An Integrated Method of Bayesian Optimization and D-Optimal Design for Chemical Experiment Optimization

Xinye Huang,Shuyuan Zhang,Haoran Li,Tong Qiu

DOI: https://doi.org/10.3390/pr11010087

IF: 3.5

2022-01-01

Processes

Abstract:The smart chemical laboratory has recently emerged as a promising trend for future chemical research, where experiment optimization is of vital importance. The traditional Bayesian optimization (BO) algorithm focuses on exploring the dependent variable space while overlooking the independent variable space. Consequently, the BO algorithm suffers from becoming stuck at local optima, which severely deteriorates the optimization performance, especially with bad-quality initial points. Herein, we propose a novel stochastic framework of Bayesian optimization with D-optimal design (BODO) by integrating BO with D-optimal design. BODO can balance the exploitation in the dependent variable space and the exploration in the independent variable space. We highlight the excellent performance of BODO even with poor initial points on the benchmark alpine2 function. Meanwhile, BODO demonstrates a better average objective function value than BO on the benchmark Summit SnAr chemical process, showing its advantage in chemical experiment optimization and potential application in future chemical experiments.
Optimization of heterogeneous continuous flow hydrogenation using FTIR inline analysis: a comparative study of multi-objective Bayesian optimization and kinetic modeling

An Su,Kejie Chai,Weida Xia,Runqiu Shen,Guihua Luo,Yingying Cheng,Weike Su

DOI: https://doi.org/10.26434/chemrxiv-2024-m0kf5

2024-03-12

Abstract:The heterogeneous continuous flow hydrogenation is pivotal in chemical research and production, yet its reaction optimization has historically been intricate and labor-intensive. This study introduces a heterogeneous continuous flow hydrogenation system specifically designed for the preparation of 2-amino-3-methylbenzoic acid (AMA), employing FTIR inline analysis coupled with an artificial neural network model for monitoring. We explored two distinct reaction optimization strategies: multi-objective Bayesian optimization (MOBO) and intrinsic kinetic modeling, executed in parallel to optimize the reaction conditions. Remarkably, the MOBO approach achieved an optimal AMA yield of 99% and a productivity of 0.64 g/hour within a limited number of iterations. Conversely, despite requiring extensive experimental data collection and equation fitting, the intrinsic kinetic modeling approach yielded a similar optimal AMA yield but a higher productivity of 1.13 g/hour, attributed to increased catalyst usage. Our findings indicate that while MOBO offers a more efficient route with fewer required experiments, kinetic modeling provides deeper insights into the reaction optimization landscape but is limited by its assumptions.

Chemistry
Process Quality Control Through Bayesian Optimization with Adaptive Local Convergence

Jiawei Tang,Xiaowen Lin,Fei Zhao,Xi Chen

DOI: https://doi.org/10.1016/j.ces.2024.120039

IF: 4.7

2024-01-01

Chemical Engineering Science

Abstract:How to take as few experiments as possible to achieve the desired quality target is a challenging and essential topic of process quality control, especially for complex and expensive manufacturing processes with high-dimensional quality outputs. This paper proposes a Bayesian optimization (BO)-based strategy utilizing quality information with adaptive local convergence. First, a series of pretreatment setting rules of the Gaussian process model is proposed to reduce the uncertainty of BO. Then, the quality target is adopted into the Gaussian process model, and the acquisition function is improved. Finally, to balance global exploration and local exploitation and reduce the experimental cost, an adaptive criterion is designed to switch global BO search to local search. The operating conditions can be efficiently updated until the quality target is reached. Two applications with high-dimensional quality outputs are presented to demonstrate the effectiveness of the proposed method.
Exploring Optimal Reaction Conditions Guided by Graph Neural Networks and Bayesian Optimization

Youngchun Kwon,Dongseon Lee,Jin Woo Kim,Youn-Suk Choi,Sun Kim

DOI: https://doi.org/10.1021/acsomega.2c05165

IF: 4.1

2022-12-20

ACS Omega

Abstract:ACS Omega . 2022 Dec 2;7(49):44939-44950. doi: 10.1021/acsomega.2c05165. eCollection 2022 Dec 13. NO

chemistry, multidisciplinary
Cost-Informed Bayesian Reaction Optimization

Alexandre Schoepfer,Jan Weinreich,Ruben Laplaza,Jerome Waser,Clemence Corminboeuf

DOI: https://doi.org/10.26434/chemrxiv-2024-44ft2

2024-04-22

Abstract:Bayesian optimization (BO) is an increasingly popular method for optimization and development of chemical reactions. Although effective in guiding experimental design, BO does not account for experimentation costs: testing readily available reagents under different conditions might be more cost and time-effective than synthesizing or buying additional ones. To address this issue, we present cost-informed BO (CIBO), an approach tailored for the rational planning of chemical experimentation that prioritizes the most cost-effective experiments. Reagents are used only when their anticipated improvement in reaction performance sufficiently outweighs their costs. Our algorithm tracks the available reagents, including recently acquired ones, and dynamically updates their cost during the optimization. Using literature data of Pd-catalyzed reactions, we show that CIBO reduces the cost of reaction optimization by up to 90% compared to standard BO. Our approach is compatible with any type of cost, e.g., the cost of buying equipment or compounds, waiting time, and environmental or security concerns. We believe CIBO supersedes BO in chemistry and envision applications in both traditional and self-driving laboratories for experiment planning.

Chemistry
Modeling and optimization for the continuous catalytic reforming process based on the hybrid surrogate optimization model

Xiang C. Ma,Chang He,Qing L. Chen,Bing J. Zhang

DOI: https://doi.org/10.1016/j.compchemeng.2024.108841

IF: 4.13

2024-08-26

Computers & Chemical Engineering

Abstract:To address the modeling and optimization challenges of the complex reaction system in the continuous catalytic reforming process, a new integrated simulation and optimization framework is presented. First, a detailed mechanism model is established based on a reaction network involving 32 components and 50 reactions, coupled with mass transfer, heat transfer, pressure drop, and catalyst deactivation equations. Then, to solve the differential-algebraic equations in the mechanism model, a multi-objective hybrid optimization method with the adaptive infill strategy is introduced. GAMS and MATLAB are integrated to perform a joint iterative solution. Finally, two cases are conducted with the proposed algorithm. Results show that the mechanism model calculation deviations are below 4 % of reactor temperature, pressure, and composition distribution, and the Pareto front of various production plans is obtained. The accurate simulation and rapid trade-off optimization among the key goals can be achieved to provide scientific decision support for enterprise production.

engineering, chemical,computer science, interdisciplinary applications
Robust Gaussian Process Regression method for efficient reaction pathway optimization: application to surface processes

Wei Fang,Yu-Cheng Zhu,Yi-Han Cheng,Yi-Ping Hao,Jeremy O. Richardson

2023-04-28

Abstract:Simulation of surface processes is a key part of computational chemistry that offers atomic-scale insights into mechanisms of heterogeneous catalysis, diffusion dynamics, as well as quantum tunneling phenomena. The most common theoretical approaches involve optimization of reaction pathways, including semiclassical tunneling pathways (called instantons). However, the computational effort can be demanding, especially for instanton optimizations with ab initio electronic structure. Recently, machine learning has been applied to accelerate reaction-pathway optimization, showing great potential for a wide range of applications. However, previous methods suffer from practical issues such as unfavorable scaling with respect to the size of the descriptor, and were mostly designed for reactions in the gas phase. We propose an improved framework based on Gaussian process regression for general transformed coordinates, which can alleviate the size problem. The descriptor combines internal and Cartesian coordinates, which improves the performance for modeling surface processes. We demonstrate with eleven instanton optimizations in three example systems that the new approach makes ab initio instanton optimization significantly cheaper, such that it becomes not much more expensive than a classical transition-state theory calculation.

Chemical Physics
A Brief Introduction to Chemical Reaction Optimization

Connor J Taylor,Alexander Pomberger,Kobi C Felton,Rachel Grainger,Magda Barecka,Thomas W Chamberlain,Richard A Bourne,Christopher N Johnson,Alexei A Lapkin

DOI: https://doi.org/10.1021/acs.chemrev.2c00798

2023-03-22

Abstract:From the start of a synthetic chemist's training, experiments are conducted based on recipes from textbooks and manuscripts that achieve clean reaction outcomes, allowing the scientist to develop practical skills and some chemical intuition. This procedure is often kept long into a researcher's career, as new recipes are developed based on similar reaction protocols, and intuition-guided deviations are conducted through learning from failed experiments. However, when attempting to understand chemical systems of interest, it has been shown that model-based, algorithm-based, and miniaturized high-throughput techniques outperform human chemical intuition and achieve reaction optimization in a much more time- and material-efficient manner; this is covered in detail in this paper. As many synthetic chemists are not exposed to these techniques in undergraduate teaching, this leads to a disproportionate number of scientists that wish to optimize their reactions but are unable to use these methodologies or are simply unaware of their existence. This review highlights the basics, and the cutting-edge, of modern chemical reaction optimization as well as its relation to process scale-up and can thereby serve as a reference for inspired scientists for each of these techniques, detailing several of their respective applications.

Bayesian Based Reaction Optimization for Complex Continuous Gas-Liquid-solid Reactions

Kinetic Parameter Estimation of the Polyethylene Process by Bayesian Optimization

Efficient Hybrid Strategy for Simultaneous Design of Refinery Hydrogen Networks and Pressure Swing Adsorption Unit

Bayesian reaction optimization as a tool for chemical synthesis

An Efficient Latent Variable Optimization Approach with Stochastic Constraints for Complex Industrial Process

A Novel Fast Dynamic Optimization Approach for Complex Multivariable Chemical Process Systems

Combining Bayesian optimization and automation to simultaneously optimize reaction conditions and routes

A physically encoded Bayesian assistant for the optimization of multicomponent reactions

Race to the bottom: Bayesian optimisation for chemical problems

Bayesian optimization for chemical products and functional materials

Practical Path-based Bayesian Optimization

Dynamic Optimization of Multivariable Endothermic Reaction in Cascade CSTR

CAPBO: A Cost‐aware Parallelized Bayesian Optimization Method for Chemical Reaction Optimization

An Integrated Method of Bayesian Optimization and D-Optimal Design for Chemical Experiment Optimization

Optimization of heterogeneous continuous flow hydrogenation using FTIR inline analysis: a comparative study of multi-objective Bayesian optimization and kinetic modeling

Process Quality Control Through Bayesian Optimization with Adaptive Local Convergence

Exploring Optimal Reaction Conditions Guided by Graph Neural Networks and Bayesian Optimization

Cost-Informed Bayesian Reaction Optimization

Modeling and optimization for the continuous catalytic reforming process based on the hybrid surrogate optimization model

Robust Gaussian Process Regression method for efficient reaction pathway optimization: application to surface processes

A Brief Introduction to Chemical Reaction Optimization