Abstract:ReaxFF is a computationally efficient force field to simulate complex reactive dynamics in extended molecular models with diverse chemistries, if reliable force-field parameters are available for the chemistry of interest. If not, they must be calibrated by minimizing the error ReaxFF makes on a relevant training set. Because this optimization is far from trivial, many methods, in particular genetic algorithms (GAs), have been developed to search for the global optimum in parameter space. Recently, two alternative parameter calibration techniques were proposed, i.e.\ Monte-Carlo Force Field optimizer (MCFF) and Covariance Matrix Adaptation Evolutionary Strategy (CMA-ES), which have the potential to find good parameters at a relatively low computational cost. In this work, these two methods are tested, as implemented in ADF2018, using three ReaxFF training sets, which have previously been used to benchmark GAs. Even though MCFF and CMA-ES should not be considered as exhaustive global optimizers, they can find parameters that are comparable in quality to those obtained with GAs. We observe that CMA-ES leads to slightly better results and is less sensitive to the initial guess of the parameters. Concrete recipes are provided for obtaining similar results with new training sets.Besides optimization recipes, a successful ReaxFF parameterization requires the design of a good training set. At every trial set of parameters, ReaxFF is used to optimize molecular geometries in the training set. When the optimization of some geometries fails easily, it becomes increasingly difficult to find the optimal parameters. We have addressed this issue by fixing several bugs in the ReaxFF forces and by improving the robustness of the geometry optimization. These improvements cannot eliminate all geometry convergence issues and we recommend to avoid very flexible geometries in the training set.Both MCFF and CMA-ES are still liable to converge to sub- or near-optimal parameters, which we detected by repeating the calibration with different random seeds. The existence of distinct near-optimal parameter vectors is a general pattern throughout our study and provides opportunities to improve the training set or to detect overfitting artifacts.

Tuning Reinforcement Learning Parameters for Cluster Selection to Enhance Evolutionary Algorithms

Optimization of molecular clusters configurations using a Genetic Algorithm

Multi-objective molecular generation via clustered Pareto-based reinforcement learning

ReaxFF Parameter Optimization with Monte-Carlo and Evolutionary Algorithms: Guidelines and Insights

An Adaptive Genetic Algorithm for determining optimal structures for atomic clusters

Automatic tuning of hyper-parameters of reinforcement learning algorithms using Bayesian optimization with behavioral cloning

Exploring Nanocluster Potential Energy Surfaces via Deep Reinforcement Learning: Strategies for Global Minimum Search

Online Deterministic Annealing for Classification and Clustering

A Multi-Objective Evolutionary Algorithm With Hierarchical Clustering-Based Selection

Diversity-Aware Reinforcement Learning for de novo Drug Design

Evolutionary Diversity Optimization with Clustering-based Selection for Reinforcement Learning

Deep Reinforcement Learning for Dynamic Algorithm Selection: A Proof-of-Principle Study on Differential Evolution

AdaptiveMDL-GenClust: A Robust Clustering Framework Integrating Normalized Mutual Information and Evolutionary Algorithms

Robustness of "cut and splice" genetic algorithms in the structural optimization of atomic clusters

CASTELO: Clustered Atom Subtypes aidEd Lead Optimization -- a combined machine learning and molecular modeling method

On the Effectiveness of Simple Success-Based Parameter Selection Mechanisms for Two Classical Discrete Black-Box Optimization Benchmark Problems

Systematic Comparison of Monte Carlo Annealing and Covariance Matrix Adaptation for the Optimization of ReaxFF Parameters

Augmented Hill-Climb increases reinforcement learning efficiency for language-based de novo molecule generation

Cluster learning-assisted directed evolution

Evaluation of Reinforcement Learning in Transformer-based Molecular Design

Cluster-MLP: An Active Learning Genetic Algorithm Framework for Accelerated Discovery of Global Minimum Configurations of Pure and Alloyed Nanoclusters