The tree reconstruction game: phylogenetic reconstruction using reinforcement learning
Dana Azouri,Oz Granit,Michael Alburquerque,Yishay Mansour,Tal Pupko,Itay Mayrose
DOI: https://doi.org/10.1093/molbev/msae105
IF: 10.7
2024-06-05
Molecular Biology and Evolution
Abstract:The computational search for the maximum-likelihood phylogenetic tree is an NP-hard problem. As such, current tree-search algorithms might result in a tree that is the local optima, not the global one. Here we introduce a paradigm shift for predicting the maximum-likelihood tree, by approximating long-term gains of likelihood rather than maximizing likelihood gain at each step of the search. Our proposed approach harnesses the power of reinforcement learning to learn an optimal search strategy, aiming at the global optimum of the search space. We show that when analyzing empirical data containing dozens of sequences, the log-likelihood improvement from the starting tree obtained by the reinforcement learning–based agent was 0.969 or higher compared to that achieved by current state-of-the-art techniques. Notably, this performance is attained without the need to perform costly likelihood optimizations apart from the training process, thus potentially allowing for an exponential increase in runtime. We exemplify this for datasets containing 15 sequences of length 18,000 base-pairs, and demonstrate that the reinforcement learning-based method is roughly three times faster than the state-of-the-art software. This study illustrates the potential of reinforcement learning in addressing the challenges of phylogenetic tree reconstruction.
genetics & heredity,biochemistry & molecular biology,evolutionary biology