Abstract:The ability to find optimal molecular structures with desired properties is a popular challenge, with applications in areas such as drug discovery. Genetic algorithms are a common approach to global minima molecular searches due to their ability to search large regions of the energy landscape and decrease computational time via parallelization. In order to decrease the amount of unstable intermediate structures being produced and increase the overall efficiency of an evolutionary algorithm, clustering was introduced in multiple instances. However, there is little literature detailing the effects of differentiating the selection frequencies between clusters. In order to find a balance between exploration and exploitation in our genetic algorithm, we propose a system of clustering the starting population and choosing clusters for an evolutionary algorithm run via a dynamic probability that is dependent on the fitness of molecules generated by each cluster. We define four parameters, MFavOvrAll-A, MFavClus-B, NoNewFavClus-C, and Select-D, that correspond to a reward for producing the best structure overall, a reward for producing the best structure in its own cluster, a penalty for not producing the best structure, and a penalty based on the selection ratio of the cluster, respectively. A reward increases the probability of a cluster's future selection, while a penalty decreases it. In order to optimize these four parameters, we used a Gaussian distribution to approximate the evolutionary algorithm performance of each cluster and performed a grid search for different parameter combinations. Results show parameter MFavOvrAll-A (rewarding clusters for producing the best structure overall) and parameter Select-D (appearance penalty) have a significantly larger effect than parameters MFavClus-B and NoNewFavClus-C. In order to produce the most successful models, a balance between MFavOvrAll-A and Select-D must be made that reflects the exploitation vs exploration trade-off often seen in reinforcement learning algorithms. Results show that our reinforcement-learning-based method for selecting clusters outperforms an unclustered evolutionary algorithm for quinoline-like structure searches.

Effective linkage learning using low-order statistics and clustering

Learning Cluster Causal Diagrams: an Information-Theoretic Approach

Supervised Hierarchical Clustering with Exponential Linkage

Learning to Link

A Many-Objective Evolutionary Algorithm With Two Interacting Processes: Cascade Clustering and Reference Point Incremental Learning

A Complete Linkage Algorithm for Clustering Dynamic Datasets

Model Linkage Selection for Cooperative Learning

Cooperative coevolutionary differential evolution with linkage measurement minimization for large-scale optimization problems in noisy environments

A clustering and dimensionality reduction based evolutionary algorithm for large-scale multi-objective problems

A Multi-disciplinary Ensemble Algorithm for Clustering Heterogeneous Datasets

Efficient heuristics for learning scalable Bayesian network classifier from labeled and unlabeled data

Ensemble Clustering Based on Meta-Learning and Hyperparameter Optimization

Niching an Archive-based Gaussian Estimation of Distribution Algorithm via Adaptive Clustering

Linkage in Genetic Algorithms

Iterated Local Search with Linkage Learning

Bivariate Estimation-of-Distribution Algorithms Can Find an Exponential Number of Optima

A Framework for Multi-Model EDAs with Model Recombination

Genie: A new, fast, and outlier-resistant hierarchical clustering algorithm

Modularity based linkage model for neuroevolution

Tuning Reinforcement Learning Parameters for Cluster Selection to Enhance Evolutionary Algorithms

Effective Structure Learning For Estimation Of Distribution Algorithms Via L1-Regularized Bayesian Networks Regular Paper