Abstract:Gene-flow processes such as hybridization and introgression play important roles in shaping diversity across the tree of life. Recent studies extending birth-death models have made it possible to investigate patterns of reticulation in a macroevolutionary context. These models allow for different macroevolutionary patterns of gene flow events that can either add, maintain, or remove lineages—with the gene flow itself possibly being dependent on the relatedness between species—thus creating complex diversification scenarios. Further, many reticulate phylogenetic inference methods assume specific reticulation structures or phylogenies belonging to certain network classes. However, the distributions of phylogenetic networks under reticulate birth-death processes are poorly characterized, and it is unknown whether they violate common methodological assumptions. We use simulation techniques to explore phylogenetic network space under a birth-death-hybridization process where the hybridization rate can have a linear dependence on genetic distance. Specifically, we measured the number of lineages through time and role of hybridization in diversification along with the proportion of phylogenetic networks that belong to commonly used network classes (e.g., tree-child, tree-based, or level-1 networks). We find that the growth of phylogenetic networks and class membership are largely affected by assumptions about macroevolutionary patterns of gene flow. In accordance with previous studies, a lower proportion of networks belonged to these classes based on type and density of reticulate events. However, under a birth-death-hybridization process, these factors form an antagonistic relationship; the type of reticulation events that cause high membership proportions also lead to the highest reticulation density, consequently lowering the overall proportion of phylogenies in some classes. Further, we observed that genetic distance–dependent gene flow and incomplete sampling increase the proportion of class membership, primarily due to having fewer reticulate events. Our results can inform studies if their biological expectations of gene flow are associated with evolutionary histories that satisfy the assumptions of current methodology and aid in finding phylogenetic classes that are relevant for methods development.

Anomalous networks under the multispecies coalescent: theory and prevalence

In the Light of Deep Coalescence: Revisiting Trees Within Networks

Identifiability of Level-1 Species Networks from Gene Tree Quartets

Probabilities of unranked and ranked anomaly zones under birth-death models

Ultrafast learning of 4-node hybridization cycles in phylogenetic networks using algebraic invariants

Anomaly zones for uniformly sampled gene trees under the gene duplication and loss model

Phylogenetic Networks: A Tool to Display Character Conflict and Demographic History

Defining Loci in Restriction-Based Reduced Representation Genomic Data from Nonmodel Species: Sources of Bias and Diagnostics for Optimal Clustering

Phylogenetic Networks Do not Need to Be Complex: Using Fewer Reticulations to Represent Conflicting Clusters

TINNiK: inference of the tree of blobs of a species network under the coalescent model

TINNiK: Inference of the Tree of Blobs of a Species Network Under the Coalescent

Anomaly, reciprocity, and community detection in networks

Identifiability of the unrooted species tree topology under the coalescent model with time-reversible substitution processes, site-specific rate variation, and invariable sites

Identifiability of speciation times under the multispecies coalescent

Statistical Inference of Allopolyploid Species Networks in the Presence of Incomplete Lineage Sorting

Exploring the distribution of phylogenetic networks generated under a birth-death-hybridization process

The Multilocus Multispecies Coalescent: A Flexible New Model of Gene Family Evolution

A branching process with coalescence to model random phylogenetic networks

Inference of Phylogenetic Networks from Sequence Data using Composite Likelihood

Coalescence 2.0: a multiple branching of recent theoretical developments and their applications