A consistency lemma in statistical phylogenetics

Mike Steel

DOI: https://doi.org/10.48550/arXiv.1501.06623

2015-01-26

Populations and Evolution

Abstract:This short note provides a simple formal proof of a folklore result in statistical phylogenetics concerning the convergence of bootstrap support for a tree and its edges.

What problem does this paper attempt to address?

Consistency of Bayesian inference of resolved phylogenetic trees

Mike Steel

DOI: https://doi.org/10.48550/arXiv.1001.2864

2013-07-11

Abstract:Bayesian inference is now a leading technique for reconstructing phylogenetic trees from aligned sequence data. In this short note, we formally show that the maximum posterior tree topology provides a statistically consistent estimate of a fully-resolved evolutionary tree under a wide variety of conditions. This includes the inference of gene trees from aligned sequence data across the entire parameter range of branch lengths, and under general conditions on priors in models where the usual `identifiability' conditions hold. We extend this to the inference of species trees from sequence data, where the gene trees constitute `nuisance parameters', as in the program *BEAST. This note also addresses earlier concerns raised in the literature questioning the extent to which statistical consistency for Bayesian methods might hold in general.

Populations and Evolution,Quantitative Methods
Impossibility results on stability of phylogenetic consensus methods

Emanuele Delucchi,Linard Hoessly,Giovanni Paolini

DOI: https://doi.org/10.1093/sysbio/syz071

2023-11-13

Abstract:We answer two questions raised by Bryant, Francis and Steel in their work on consensus methods in phylogenetics. Consensus methods apply to every practical instance where it is desired to aggregate a set of given phylogenetic trees (say, gene evolution trees) into a resulting, "consensus" tree (say, a species tree). Various stability criteria have been explored in this context, seeking to model desirable consistency properties of consensus methods as the experimental data are updated (e.g., more taxa, or more trees, are mapped). However, such stability conditions can be incompatible with some basic regularity properties that are widely accepted to be essential in any meaningful consensus method. Here, we prove that such an incompatibility does arise in the case of extension stability on binary trees and in the case of associative stability. Our methods combine general theoretical considerations with the use of computer programs tailored to the given stability requirements.

Populations and Evolution
A survey of the monotonicity and non-contradiction of consensus methods and supertree methods

Mareike Fischer,Michael Hendriksen

2024-10-12

Abstract:In a recent study, Bryant, Francis and Steel investigated the concept of \enquote{future-proofing} consensus methods in phylogenetics. That is, they investigated if such methods can be robust against the introduction of additional data like added trees or new species. In the present manuscript, we analyze consensus methods under a different aspect of introducing new data, namely concerning the discovery of new clades. In evolutionary biology, often formerly unresolved clades get resolved by refined reconstruction methods or new genetic data analyses. In our manuscript we investigate which properties of consensus methods can guarantee that such new insights do not disagree with previously found consensus trees, but merely refine them, a property termed \emph{monotonicity}. Along the lines of analyzing monotonicity, we also study two {established} supertree methods, namely Matrix Representation with Parsimony (MRP) and Matrix Representation with Compatibility (MRC), which have also been suggested as consensus methods in the literature. While we (just like Bryant, Francis and Steel in their recent study) unfortunately have to conclude some negative answers concerning general consensus methods, we also state some relevant and positive results concerning the majority rule ($\mathtt{MR}$) and strict consensus methods, which are amongst the most frequently used consensus methods. Moreover, we show that there exist infinitely many consensus methods which are monotonic and have some other desirable properties. \textbf{Keywords:} consensus tree, phylogenetics, majority rule, tree refinement, matrix representation with parsimony \textbf{MSC:} C92B05, 05C05

Populations and Evolution,Combinatorics
Evolutionary Trees and the Ising Model on the Bethe Lattice: a Proof of Steel's Conjecture

Constantinos Daskalakis,Elchanan Mossel,Sebastien Roch

DOI: https://doi.org/10.48550/arXiv.math/0509575

2009-07-28

Abstract:A major task of evolutionary biology is the reconstruction of phylogenetic trees from molecular data. The evolutionary model is given by a Markov chain on a tree. Given samples from the leaves of the Markov chain, the goal is to reconstruct the leaf-labelled tree. It is well known that in order to reconstruct a tree on $n$ leaves, sample sequences of length $\Omega(\log n)$ are needed. It was conjectured by M. Steel that for the CFN/Ising evolutionary model, if the mutation probability on all edges of the tree is less than $p^{\ast} = (\sqrt{2}-1)/2^{3/2}$, then the tree can be recovered from sequences of length $O(\log n)$. The value $p^{\ast}$ is given by the transition point for the extremality of the free Gibbs measure for the Ising model on the binary tree. Steel's conjecture was proven by the second author in the special case where the tree is "balanced." The second author also proved that if all edges have mutation probability larger than $p^{\ast}$ then the length needed is $n^{\Omega(1)}$. Here we show that Steel's conjecture holds true for general trees by giving a reconstruction algorithm that recovers the tree from $O(\log n)$-length sequences when the mutation probabilities are discretized and less than $p^\ast$. Our proof and results demonstrate that extremality of the free Gibbs measure on the infinite binary tree, which has been studied before in probability, statistical physics and computer science, determines how distinguishable are Gibbs measures on finite binary trees.

Probability,Computational Engineering, Finance, and Science,Data Structures and Algorithms,Classical Analysis and ODEs,Combinatorics,Statistics Theory,Populations and Evolution
Combinatorics of least squares trees

Radu Mihaescu,Lior Pachter

DOI: https://doi.org/10.1073/pnas.0802089105

2008-02-18

Abstract:A recurring theme in the least squares approach to phylogenetics has been the discovery of elegant combinatorial formulas for the least squares estimates of edge lengths. These formulas have proved useful for the development of efficient algorithms, and have also been important for understanding connections among popular phylogeny algorithms. For example, the selection criterion of the neighbor-joining algorithm is now understood in terms of the combinatorial formulas of Pauplin for estimating tree length. We highlight a phylogenetically desirable property that weighted least squares methods should satisfy, and provide a complete characterization of methods that satisfy the property. The necessary and sufficient condition is a multiplicative four point condition that the the variance matrix needs to satisfy. The proof is based on the observation that the Lagrange multipliers in the proof of the Gauss--Markov theorem are tree-additive. Our results generalize and complete previous work on ordinary least squares, balanced minimum evolution and the taxon weighted variance model. They also provide a time optimal algorithm for computation.

Combinatorics,Statistics Theory
Shrinkage Effect in Ancestral Maximum Likelihood

Elchanan Mossel,Sebastien Roch,Mike Steel

DOI: https://doi.org/10.48550/arXiv.0802.0914

2008-02-07

Abstract:Ancestral maximum likelihood (AML) is a method that simultaneously reconstructs a phylogenetic tree and ancestral sequences from extant data (sequences at the leaves). The tree and ancestral sequences maximize the probability of observing the given data under a Markov model of sequence evolution, in which branch lengths are also optimized but constrained to take the same value on any edge across all sequence sites. AML differs from the more usual form of maximum likelihood (ML) in phylogenetics because ML averages over all possible ancestral sequences. ML has long been known to be statistically consistent -- that is, it converges on the correct tree with probability approaching 1 as the sequence length grows. However, the statistical consistency of AML has not been formally determined, despite informal remarks in a literature that dates back 20 years. In this short note we prove a general result that implies that AML is statistically inconsistent. In particular we show that AML can `shrink' short edges in a tree, resulting in a tree that has no internal resolution as the sequence length grows. Our results apply to any number of taxa.

Populations and Evolution,Computational Engineering, Finance, and Science,Probability,Statistics Theory
The meaning and measure of concordance factors in phylogenomics

Robert Lanfear,Matthew W Hahn

DOI: https://doi.org/10.1093/molbev/msae214

IF: 10.7

2024-10-18

Molecular Biology and Evolution

Abstract:As phylogenomic datasets have grown in size, researchers have developed new ways to measure biological variation and to assess statistical support for specific branches. Larger datasets have more sites and loci, and therefore less sampling variance. While we can more accurately measure the mean signal in these datasets, lower sampling variance is often reflected in uniformly high measures of branch support—such as the bootstrap and posterior probability—limiting their utility. Larger datasets have also revealed substantial biological variation in the topologies found across individual loci, such that the single species tree inferred by most phylogenetic methods represents a limited summary of the data for many purposes. In contrast to measures of statistical support, the degree of underlying topological variation among loci should be approximately constant regardless of the size of the dataset. "Concordance factors" and similar statistics have therefore become increasingly important tools in phylogenetics. In this review, we explain why concordance factors should be thought of as descriptors of topological variation rather than as measures of statistical support, and argue that they provide important information about the predictive power of the species tree not contained in measures of support. We review a growing suite of statistics for measuring concordance, compare them in a common framework that reveals their interrelationships, and demonstrate how to calculate them using an example from birds. We also discuss how measures of topological variation might change in the future as we move beyond estimating a single "tree of life" towards estimating the myriad evolutionary histories underlying genomic variation.

genetics & heredity,biochemistry & molecular biology,evolutionary biology
`Lassoing' a phylogenetic tree I: Basic properties, shellings, and covers

A.W.M. Dress,K.T. Huber,M. Steel

DOI: https://doi.org/10.48550/arXiv.1102.0309

2011-07-15

Abstract:A classical result, fundamental to evolutionary biology, states that an edge-weighted tree $T$ with leaf set $X$, positive edge weights, and no vertices of degree 2 can be uniquely reconstructed from the set of leaf-to-leaf distances between any two elements of $X$. In biology, $X$ corresponds to a set of taxa (e.g. extant species), the tree $T$ describes their phylogenetic relationships, the edges correspond to earlier species evolving for a time until splitting in two or more species by some speciation/bifurcation event, and their length corresponds to the genetic change accumulating over that time in such a species. In this paper, we investigate which subsets of $\binom{X}{2}$ suffice to determine (`lasso') a tree from the leaf-to-leaf distances induced by that tree. The question is particularly topical since reliable estimates of genetic distance - even (if not in particular) by modern mass-sequencing methods - are, in general, available only for certain combinations of taxa.

Populations and Evolution,Computational Engineering, Finance, and Science,Data Structures and Algorithms
Consistency of the Maximum Likelihood Estimator of Evolutionary Tree

Arindam RoyChoudhury

DOI: https://doi.org/10.48550/arXiv.1405.0760

2014-05-05

Populations and Evolution

Abstract:Maximum likelihood estimation (MLE) methods are widely used for evolutionary tree. As evolutionary tree is not a smooth parameter, the consistency of its MLE has been a topic of debate. It has been noted without proof that the classical proof of consistency by Wald holds for the MLE of evolutionary tree. Other proofs of consistency under various models were also proposed. Here we will discuss some shortcomings in some of these proofs and comment on the applicability of Wald's proof.
Impossibility of phylogeny reconstruction from $k$-mer counts

Wai-Tong Louis Fan,Brandon Legried,Sebastien Roch

DOI: https://doi.org/10.48550/arXiv.2010.14460

2022-03-02

Abstract:We consider phylogeny estimation under a two-state model of sequence evolution by site substitution on a tree. In the asymptotic regime where the sequence lengths tend to infinity, we show that for any fixed $k$ no statistically consistent phylogeny estimation is possible from $k$-mer counts over the full leaf sequences alone. Formally, we establish that the joint distribution of $k$-mer counts over the entire leaf sequences on two distinct trees have total variation distance bounded away from $1$ as the sequence length tends to infinity. Our impossibility result implies that statistical consistency requires more sophisticated use of $k$-mer count information, such as block techniques developed in previous theoretical work.

Probability,Computational Engineering, Finance, and Science,Statistics Theory,Populations and Evolution
Statistics for Phylogenetic Trees in the Presence of Stickiness

Lars Lammers,Tom M. W. Nye,Stephan F. Huckemann

2024-07-04

Abstract:Samples of phylogenetic trees arise in a variety of evolutionary and biomedical applications, and the Fréchet mean in Billera-Holmes-Vogtmann tree space is a summary tree shown to have advantages over other mean or consensus trees. However, use of the Fréchet mean raises computational and statistical issues which we explore in this paper. The Fréchet sample mean is known often to contain fewer internal edges than the trees in the sample, and in this circumstance calculating the mean by iterative schemes can be problematic due to slow convergence. We present new methods for identifying edges which must lie in the Fréchet sample mean and apply these to a data set of gene trees relating organisms from the apicomplexa which cause a variety of parasitic infections. When a sample of trees contains a significant level of heterogeneity in the branching patterns, or topologies, displayed by the trees then the Fréchet mean is often a star tree, lacking any internal edges. Not only in this situation, the population Fréchet mean is affected by a non-Euclidean phenomenon called stickness which impacts upon asymptotics, and we examine two data sets for which the mean tree is a star tree. The first consists of trees representing the physical shape of artery structures in a sample of medical images of human brains in which the branching patterns are very diverse. The second consists of gene trees from a population of baboons in which there is evidence of substantial hybridization. We develop hypothesis tests which work in the presence of stickiness. The first is a test for the presence of a given edge in the Fréchet population mean; the second is a two-sample test for differences in two distributions which share the same sticky population mean.

Populations and Evolution,Statistics Theory
Continuum tree asymptotics of discrete fragmentations and applications to phylogenetic models

Bénédicte Haas,Grégory Miermont,Jim Pitman,Matthias Winkel

DOI: https://doi.org/10.1214/07-AOP377

2008-09-25

Abstract:Given any regularly varying dislocation measure, we identify a natural self-similar fragmentation tree as scaling limit of discrete fragmentation trees with unit edge lengths. As an application, we obtain continuum random tree limits of Aldous's beta-splitting models and Ford's alpha models for phylogenetic trees. This confirms in a strong way that the whole trees grow at the same speed as the mean height of a randomly chosen leaf.

Probability
The Bayesian Phylogenetic Bootstrap, Application to Short Trees and Branches

Frederic Lemoine,Olivier Gascuel

DOI: https://doi.org/10.1101/2024.06.22.600199

2024-09-19

Abstract:Felsenstein's bootstrap is the most commonly used method to measure branch support in phylogenetics. Current sequencing technologies can result in massive sampling of taxa (e.g. SARS-CoV-2). In this case, the sequences are very similar, the trees are short, and the branches correspond to a small number of mutations (possibly 0). Nevertheless, these trees contain a strong signal, with unresolved parts but a low rate of false branches. With such data, Felsenstein's bootstrap is not satisfactory. Due to the frequentist nature of bootstrap sampling, the expected support of a branch corresponding to a single mutation is ~63%, even though it is highly likely to be correct. Here we propose a Bayesian version of the phylogenetic bootstrap in which sites are assigned uninformative prior probabilities. The branch support can then be interpreted as a posterior probability. We do not view the alignment as a small subsample of a large sample of sites, but rather as containing all available information (e.g., as with complete viral genomes, which are becoming routine). We give formulas for expected supports under the assumption of perfect phylogeny, in both the frequentist and Bayesian frameworks, where a branch corresponding to a single mutation now has an expected support of ~90%. Simulations show that these theoretical results are robust to realistic data. Analyses on low-homoplasy viral and non-viral datasets show that Bayesian bootstrap support is easier to interpret, with high supports for branches very likely to be correct. As homoplasy increases, the two supports become closer and strongly correlated.

Evolutionary Biology
Phylogenetic Flexibility via Hall-Type Inequalities and Submodularity

Katharina T Huber,Vincent Moulton,Mike Steel

DOI: https://doi.org/10.1007/s11538-018-0419-1

Abstract:Given a collection [Formula: see text] of subsets of a finite set X, we say that [Formula: see text] is phylogenetically flexible if, for any collection R of rooted phylogenetic trees whose leaf sets comprise the collection [Formula: see text], R is compatible (i.e. there is a rooted phylogenetic X-tree that displays each tree in R). We show that [Formula: see text] is phylogenetically flexible if and only if it satisfies a Hall-type inequality condition of being 'slim'. Using submodularity arguments, we show that there is a polynomial-time algorithm for determining whether or not [Formula: see text] is slim. This 'slim' condition reduces to a simpler inequality in the case where all of the sets in [Formula: see text] have size 3, a property we call 'thin'. Thin sets were recently shown to be equivalent to the existence of an (unrooted) tree for which the median function provides an injective mapping to its vertex set; we show here that the unrooted tree in this representation can always be chosen to be a caterpillar tree. We also characterise when a collection [Formula: see text] of subsets of size 2 is thin (in terms of the flexibility of total orders rather than phylogenies) and show that this holds if and only if an associated bipartite graph is a forest. The significance of our results for phylogenetics is in providing precise and efficiently verifiable conditions under which supertree methods that require consistent inputs of trees can be applied to any input trees on given subsets of species.
Inconsistency of parsimony under the multispecies coalescent

Daniel Rickert,Wai-Tong Louis Fan,Matthew Hahn

2024-07-05

Abstract:While it is known that parsimony can be statistically inconsistent under certain models of evolution due to high levels of homoplasy, the consistency of parsimony under the multispecies coalescent (MSC) is less well studied. Previous studies have shown the consistency of concatenated parsimony (parsimony applied to concatenated alignments) under the MSC for the rooted 4-taxa case under an infinite-sites model of mutation; on the other hand, other work has also established the inconsistency of concatenated parsimony for the unrooted 6-taxa case. These seemingly contradictory results suggest that concatenated parsimony may fail to be consistent for trees with more than 5 taxa, for all unrooted trees, or for some combination of the two. Here, we present a technique for computing the expected internal branch lengths of gene trees under the MSC. This technique allows us to determine the regions of the parameter space of the species tree under which concatenated parsimony fails for different numbers of taxa, for rooted or unrooted trees. We use our new approach to demonstrate that there are always regions of statistical inconsistency for concatenated parsimony for the 5- and 6-taxa cases, regardless of rooting. Our results therefore suggest that parsimony is not generally dependable under the MSC.

Populations and Evolution
The standard lateral gene transfer model is statistically consistent for pectinate four-taxon trees

Andreas Sand,Andreas Sand,Mike Steel

DOI: https://doi.org/10.1016/j.jtbi.2013.07.002

IF: 2.405

2013-10-01

Journal of Theoretical Biology

Abstract:Evolutionary events such as incomplete lineage sorting and lateral gene transfers constitute major problems for inferring species trees from gene trees, as they can sometimes lead to gene trees which conflict with the underlying species tree. One particularly simple and efficient way to infer species trees from gene trees under such conditions is to combine three-taxon analyses for several genes using a majority vote approach. For incomplete lineage sorting this method is known to be statistically consistent; however, for lateral gene transfers it was recently shown that a zone of inconsistency exists for a specific four-taxon tree topology, and it was posed as an open question whether inconsistencies could exist for other four-taxon tree topologies? In this letter we analyze all remaining four-taxon topologies and show that no other inconsistencies exist.

biology,mathematical & computational biology
Isomorphism and Symmetries in Random Phylogenetic Trees

Miklos Bona,Philippe Flajolet

DOI: https://doi.org/10.48550/arXiv.0901.0696

2009-01-07

Abstract:The probability that two randomly selected phylogenetic trees of the same size are isomorphic is found to be asymptotic to a decreasing exponential modulated by a polynomial factor. The number of symmetrical nodes in a random phylogenetic tree of large size obeys a limiting Gaussian distribution, in the sense of both central and local limits. The probability that two random phylogenetic trees have the same number of symmetries asymptotically obeys an inverse square-root law. Precise estimates for these problems are obtained by methods of analytic combinatorics, involving bivariate generating functions, singularity analysis, and quasi-powers approximations.

Probability,Combinatorics
Point estimates in phylogenetic reconstructions

Philipp Benner,Miroslav Bacak,Pierre-Yves Bourguignon

DOI: https://doi.org/10.1093/bioinformatics/btu461

2014-10-10

Abstract:Motivation: The construction of statistics for summarizing posterior samples returned by a Bayesian phylogenetic study has so far been hindered by the poor geometric insights available into the space of phylogenetic trees, and ad hoc methods such as the derivation of a consensus tree makeup for the ill-definition of the usual concepts of posterior mean, while bootstrap methods mitigate the absence of a sound concept of variance. Yielding satisfactory results with sufficiently concentrated posterior distributions, such methods fall short of providing a faithful summary of posterior distributions if the data do not offer compelling evidence for a single topology. Results: Building upon previous work of Billera et al., summary statistics such as sample mean, median and variance are defined as the geometric median, Fréchet mean and variance, respectively. Their computation is enabled by recently published works, and embeds an algorithm for computing shortest paths in the space of trees. Studying the phylogeny of a set of plants, where several tree topologies occur in the posterior sample, the posterior mean balances correctly the contributions from the different topologies, where a consensus tree would be biased. Comparisons of the posterior mean, median and consensus trees with the ground truth using simulated data also reveals the benefits of a sound averaging method when reconstructing phylogenetic trees.

Applications,Populations and Evolution
Statistical Phylogenetic Tree Analysis Using Differences of Means

Elissaveta Arnaoudova,David Haws,Peter Huggins,Jerzy W. Jaromczyk,Neil Moore,Chris Schardl,Ruriko Yoshida

DOI: https://doi.org/10.48550/arXiv.1004.2101

2010-04-13

Abstract:We propose a statistical method to test whether two phylogenetic trees with given alignments are significantly incongruent. Our method compares the two distributions of phylogenetic trees given by the input alignments, instead of comparing point estimations of trees. This statistical approach can be applied to gene tree analysis for example, detecting unusual events in genome evolution such as horizontal gene transfer and reshuffling. Our method uses difference of means to compare two distributions of trees, after embedding trees in a vector space. Bootstrapping alignment columns can then be applied to obtain p-values. To compute distances between means, we employ a "kernel trick" which speeds up distance calculations when trees are embedded in a high-dimensional feature space, e.g. splits or quartets feature space. In this pilot study, first we test our statistical method's ability to distinguish between sets of gene trees generated under coalescence models with species trees of varying dissimilarity. We follow our simulation results with applications to various data sets of gophers and lice, grasses and their endophytes, and different fungal genes from the same genome. A companion toolkit, {\tt Phylotree}, is provided to facilitate computational experiments.

Populations and Evolution,Genomics
Regenerative tree growth: structural results and convergence

Jim Pitman,Douglas Rizzolo,Matthias Winkel

DOI: https://doi.org/10.48550/arXiv.1207.3551

2013-09-27

Abstract:We introduce regenerative tree growth processes as consistent families of random trees with n labelled leaves, n>=1, with a regenerative property at branch points. This framework includes growth processes for exchangeably labelled Markov branching trees, as well as non-exchangeable models such as the alpha-theta model, the alpha-gamma model and all restricted exchangeable models previously studied. Our main structural result is a representation of the growth rule by a sigma-finite dislocation measure kappa on the set of partitions of the natural numbers extending Bertoin's notion of exchangeable dislocation measures from the setting of homogeneous fragmentations. We use this representation to establish necessary and sufficient conditions on the growth rule under which we can apply results by Haas and Miermont for unlabelled and not necessarily consistent trees to establish self-similar random trees and residual mass processes as scaling limits. While previous studies exploited some form of exchangeability, our scaling limit results here only require a regularity condition on the convergence of asymptotic frequencies under kappa, in addition to a regular variation condition.

Probability

A consistency lemma in statistical phylogenetics

Consistency of Bayesian inference of resolved phylogenetic trees

Impossibility results on stability of phylogenetic consensus methods

A survey of the monotonicity and non-contradiction of consensus methods and supertree methods

Evolutionary Trees and the Ising Model on the Bethe Lattice: a Proof of Steel's Conjecture

Combinatorics of least squares trees

Shrinkage Effect in Ancestral Maximum Likelihood

The meaning and measure of concordance factors in phylogenomics

`Lassoing' a phylogenetic tree I: Basic properties, shellings, and covers

Consistency of the Maximum Likelihood Estimator of Evolutionary Tree

Impossibility of phylogeny reconstruction from $k$-mer counts

Statistics for Phylogenetic Trees in the Presence of Stickiness

Continuum tree asymptotics of discrete fragmentations and applications to phylogenetic models

The Bayesian Phylogenetic Bootstrap, Application to Short Trees and Branches

Phylogenetic Flexibility via Hall-Type Inequalities and Submodularity

Inconsistency of parsimony under the multispecies coalescent

The standard lateral gene transfer model is statistically consistent for pectinate four-taxon trees

Isomorphism and Symmetries in Random Phylogenetic Trees

Point estimates in phylogenetic reconstructions

Statistical Phylogenetic Tree Analysis Using Differences of Means

Regenerative tree growth: structural results and convergence