- We are sorry, but NCBI web applications do not support your browser and may not function properly. More information

# Efficient error correction algorithms for gene tree reconciliation based on duplication, duplication and loss, and deep coalescence

^{1}Department of Computer Science, Iowa State University, Ames, IA 50011, USA

^{2}Department of Biology, University of Florida, Gainesville, FL 32611, USA

^{}Corresponding author.

#### Supplement

#### Conference

## Abstract

### Background

Gene tree - species tree reconciliation problems infer the patterns and processes of gene evolution within a species tree. Gene tree parsimony approaches seek the evolutionary scenario that implies the fewest gene duplications, duplications and losses, or deep coalescence (incomplete lineage sorting) events needed to reconcile a gene tree and a species tree. While a gene tree parsimony approach can be informative about genome evolution and phylogenetics, error in gene trees can profoundly bias the results.

### Results

We introduce efficient algorithms that rapidly search local Subtree Prune and Regraft (SPR) or Tree Bisection and Reconnection (TBR) neighborhoods of a given gene tree to identify a topology that implies the fewest duplications, duplication and losses, or deep coalescence events. These algorithms improve on the current solutions by a factor of *n *for searching SPR neighborhoods and *n*^{2 }for searching TBR neighborhoods, where *n *is the number of taxa in the given gene tree. They provide a fast error correction protocol for ameliorating the effects of gene tree error by allowing small rearrangements in the topology to improve the reconciliation cost. We also demonstrate a simple protocol to use the gene rearrangement algorithm to improve gene tree parsimony phylogenetic analyses.

### Conclusions

The new gene tree rearrangement algorithms provide a fast method to address gene tree error. They do not make assumptions about the underlying processes of genome evolution, and they are amenable to analyses of large-scale genomic data sets. These algorithms are also easily incorporated into gene tree parsimony phylogenetic analyses, potentially producing more credible estimates of reconciliation cost.

## Introduction

The availability of large-scale genomic data from a wide variety of taxa has revealed much incongruence between gene trees and the phylogeny of the species in which the genes evolve. This incongruence may be caused by evolutionary processes such as gene duplication and loss, deep coalescence, or lateral gene transfer. The variation in gene tree topologies can be used to infer the processes of genome evolution. Gene tree - species tree (GT-ST) reconciliation methods seek to map the history of gene trees into the context of species evolution and thus potentially link processes of gene evolution to phenotypic changes and diversification. Yet these methods can be confounded by error in the gene trees, which also may cause incongruence between the gene and species topologies. We introduce efficient algorithms to correct gene tree topologies based on the gene duplication, duplication and loss, or deep coalescence cost models. The algorithms work by identifying the small rearrangements in the gene trees that reduce the reconciliation cost. They are extremely fast and thus amenable to analyses of enormous genomic data sets.

Perhaps the most commonly used and computationally feasible approach to GT-ST reconciliation is gene tree parsimony, which seeks to infer the fewest evolutionary events (e.g., duplication, loss, coalescence, or lateral gene transfer) needed to reconcile a gene tree and species tree topology [1]. This approach also can be extended to infer species phylogenies, finding the species tree that implies the fewest evolutionary events implied by the gene trees (e.g., [2-4]). However, the gene trees often are estimated using heuristic methods from short sequence alignments, and consequently, there is often much error in the estimated gene tree topologies. Error in the gene trees creates more GT-ST incongruence and can radically affect GT-ST reconciliation analyses, implying far more duplications, duplications and losses, or deep coalescence events than actually exist. For example, Rasmussen and Kellis [5] estimated that error in gene tree reconstruction can lead to 2-3 fold overestimates of gene duplications and losses. Gene tree error also can erroneously imply large numbers of duplications near the root of the species tree [6,7], and it can mislead gene tree parsimony phylogenetic analyses (e.g., [8-10]).

Several approaches have been proposed to address gene tree error in GT-ST reconciliation. First, questionable nodes in a gene tree or nodes with low support may be collapsed prior to gene tree reconciliation, and the resulting non-binary gene trees may be reconciled with species trees [11-13]. Similarly, GT-ST reconciliations can use a distribution of gene tree topologies, such as bootstrap gene trees, rather than a single gene tree estimate [6,14,15]. Both of these approaches may help account for stochastic error and uncertainty in gene tree topologies, but they do not explicitly confront gene tree error. Methods also exist to simultaneously infer the gene tree topology and the gene tree reconciliation with a known species tree [5,16]. While these sophisticated statistical approaches appear very promising, they are computationally intensive, and it is unclear if they will be tractable for large-scale analyses. Another, perhaps a more computationally feasible, approach is to allow a limited number of local rearrangements in the gene tree topology if they reduced the reconciliation cost [17,18].

Previously [17,18] described a method to allow NNI-branch swaps on selected branches of a gene tree to reduce the reconciliation cost. Following [17,18], we address gene tree error in the reconciliation process by assuming that the correct gene tree can be found in a particular neighborhood of the given gene tree. We describe this approach for the gene duplication, duplication and loss, and deep coalescence models, which identify the fewest respective events implied from a given gene tree and given species tree. This neighborhood consists of all trees that are within one edit operation of the gene tree. While [17,18] use Nearest Neighbor Interchange (NNI) edit operations to define the neighborhood, we use the standard tree edit operations SPR [19,20] and TBR [19], which significantly extend upon the search space of the NNI neighborhood. The SPR and TBR local search problems find a tree in the SPR and TBR neighborhood of a given gene tree, respectively, that has the smallest reconciliation cost when reconciled with a given species tree. Using the algorithm from Zhang [21] the best known (naïve) runtimes are *O*(*n*^{3}) for the SPR local search problem and *O*(*n*^{4}) for the TBR local search problem, where *n *is the number of taxa in the given gene tree. These runtimes typically are prohibitively long for the computation of larger GT-ST reconciliations. We improve on these solutions by a factor of *n *for the SPR local search problem and a factor of *n*^{2 }for the TBR local search problem. This makes the local search under the TBR edit operation as efficient as under the SPR edit operation, and it provides a high-speed gene tree error-correction protocol that is computationally feasible for large-scale genomic data sets.

We also evaluated the performance of our algorithms using the implementation of SPR based local search algorithms. Note, that the SPR neighborhood is properly contained in the TBR neighborhood for any given tree. Thus the performance of the SPR based program provides a conservative estimate of the performance of the TBR based program. We test our programs on a collection of 106 yeast gene trees, some of which contain hundreds of leaves, and we demonstrate how it can be easily incorporated into large-scale gene tree parsimony phylogenetic analyses.

## Basic notation and preliminaries

Throughout this paper, the term tree refers to a rooted full binary (phylogenetic) tree.

Let *T *be a tree. The leaf set of *T *is denoted by *Le*(*T*). The set of all vertices of *T *is denoted by *V*(*T*) and the set of all edges by *E*(*T*). The *root *of *T *is denoted by *Ro*(*T*). The set of internal vertices of *T *is *I*(*T*):= *V*(*T*)\*Le*(*T*).

Given a vertex *v * *V*(*T*), we denote the *parent *of *v *by *Pa _{T}*(

*v*). Let

*u*:=

*Pa*(

_{T}*v*). The edge that connects

*v*with

*u*is written as (

*u, v*). The first element in the pair is always the parent of the second element. The set of all children of

*v*is denoted by

*Ch*(

_{T}*v*) and the children are called

*siblings*. For

*w*

*Ch*(

_{T}*v*), the sibling of

*w*is denoted by

*Sb*(

_{T}*w*).

We define ≤* _{T }*to be the

*partial order*on

*V*(

*T*) where

*x*≤

*if*

_{T }y*y*is a vertex on the path between

*Ro*(

*T*) to

*x*, and write

*x*<

*if*

_{T }y*x*≤

*and*

_{T }y*x*≠

*y*. The

*least common ancestor*of a non-empty subset

*L*

*V*(

*T*), denoted as

*LCA*(

_{T}*L*), is the unique smallest upper bound of

*L*under ≤

*. Given*

_{T}*x, y*

*V*(

*T*),

*d*(

_{T}*x, y*) denotes the number of edges on the unique path between

*x*and

*y*in

*T*.

Given *U * *V*(*T*), we denote by *T*(*U*) the unique rooted subtree of *T *that spans *U *with the minimum number of vertices. Furthermore, the *restriction *of *T *to *U*, denoted by *T*_{|U}, is the rooted tree that is obtained from *T*(*U*) by suppressing all non-root vertices of degree two. The *subtree *of *T *rooted at *u * *V*(*T*), denoted by *T _{u}*, is defined to be

*T*

_{|U}, for

*U*:= {

*v*

*Le*(

*T*):

*v*≤

*}. Two trees*

_{T }u*T*

_{1 }and

*T*

_{2 }are called

*isomorphic*if there exists a bijection between the vertex sets of

*T*

_{1 }and

*T*

_{2 }which maps a vertex

*u*

_{1 }of

*T*

_{1 }to vertex

*u*

_{2 }of

*T*

_{2 }if the subtree rooted at

*u*

_{1 }in

*T*

_{1 }has the same leaf set as the subtree rooted at

*u*

_{2 }in

*T*

_{2}. If an isomorphism exists between

*T*

_{1 }and

*T*

_{2}, we write

*T*

_{1 }

*T*

_{2}.

Given function *f *: *A *→ *B*, we denote by *f*(*A*') where *A*' *A *a set of images of each element in *A*' under *f*.

### The reconciliation cost models

A *species tree *is a tree that depicts the branching pattern representing the divergence of a set of species, whereas a *gene tree *is a tree that depicts the evolutionary history among the sequences encoding one gene (or gene family) for a given set of species. We assume that each leaf of the gene tree is labeled with the species from which that gene was sampled. Let *G *be a gene tree and *S *a species tree. In order to compare *G *with *S*, we require a mapping from each gene *g * *V*(*G*) to the most recent species in *S *that could have contained *g*.

**Definition 1 (Mapping**). *The *leaf-mapping * _{G,S }*:

*Le*(

*G*) →

*Le*(

*S*)

*is a surjection that maps each leaf g*

*Le*(

*G*)

*to that unique leaf s*

*Le*(

*S*)

*which has the same label as g. The extension*

*:*

_{G,S }*V*(

*G*) →

*V*(

*S*)

*is the mapping defined by*(

_{G,S}*g*):=

*LCA*(

*(*

_{G,S}*Le*(

*G*))).

_{g}*For convenience, we write*(

*g*)

*instead of*

*(*

_{G,S}*g*)

*when G and S are clear from the context*.

**Definition 2 (Comparability**). *Given trees G and S, we say that G is *comparable *to S if a leaf-mapping _{G,S}(g) is well defined*.

Throughout this paper we use the following terminology: *G *is a gene tree that is comparable to the species tree *S *through a leaf-mapping * _{G,S}*, and

*n*is the number of taxa present in both input trees.

Now we define different reconciliation costs from *G *to *S *for a given mapping * _{G,S }*that extends

*. The reconciliation cost are based on the models of gene duplication [22,23], duplication-loss [21], and deep coalescence [21].*

_{G,S}**Definition 3 (Duplication cost**).

• *The *duplication cost *from g * *V*(*G*) *to S*, ${\mathcal{C}}_{D}\left(G,S,g\right):=\left\{\begin{array}{c}1,\phantom{\rule{0.3em}{0ex}}\phantom{\rule{0.3em}{0ex}}\phantom{\rule{0.3em}{0ex}}\phantom{\rule{0.3em}{0ex}}\phantom{\rule{0.3em}{0ex}}if\mathcal{M}\left(g\right)\in \mathcal{M}\left(Ch\left(g\right)\right);\\ 0,\phantom{\rule{0.3em}{0ex}}\phantom{\rule{0.3em}{0ex}}\phantom{\rule{0.3em}{0ex}}\phantom{\rule{0.3em}{0ex}}otherwise.\\ \end{array}\right)$

• *The *duplication cost *from G to S*, ${\mathcal{C}}_{D}\left(G\mathsf{\text{,}}\phantom{\rule{0.3em}{0ex}}S\right):={\sum}_{g\in I\left(G\right)}{\mathcal{C}}_{D}\left(G,S,g\right)$.

**Definition 4 (Duplication-loss cost**).

• *The *loss cost *from g * *V*(*G*) *to S*,

• The duplication-loss cost *from G to S, *${\mathcal{C}}_{DL}\left(G,\mathsf{\text{}}S\right):={\sum}_{{{}_{g}}_{\in I\left(G\right)}}\left({\mathcal{C}}_{D}\left(G,S,g\right)\mathsf{\text{}}+{\mathcal{C}}_{L}\left(G,S,g\right)\right)$.

**Definition 5 (Deep coalescence cost**).

• *The *number of lineages from *g * *V*(*G*) *to h * *Ch*(*g*) *in S*,

• *The *deep coalescence cost *from G to S*, ${\mathcal{C}}_{DC}\left(G,S\right):={\sum}_{{{}_{g}}_{\in I\left(G\right)}}{\mathcal{C}}_{DC}\left(G,S,g\right)-\left|E\left(S\right)\right|$.

### The error-correction problems

Here we give definitions for tree rearrangement operations TBR [19] and SPR [19,20], and then formulate the Error-Correction problems that were motivated in the introduction.

**Definition 6 **(Tree Bisection and Reconnection (TBR)). *Let T be a tree. For this definition, we regard the *planted tree *Pl*(*T*) *as the tree obtained from adding the *root edge{*r, Ro*(*T*)} *to E*(*T*), *where r * *V*(*T*).

Let *e *:= (*u, v*) *E*(*T*), *and X and Y be the connected components that are obtained by removing edge e from T such that v * *X *and *u * *Y. We define TBR _{T }*(

*v, x, y*)

*for x X and y*

*Y to be the tree that is obtained from Pl*(

*T*)

*by first deleting edge e, and then adjoining a new edge f between X and Y as follows*:

1. *If x *≠ *Ro*(*X*) *then suppress Ro*(*X*) *and create a new root by subdividing edge *(*Pa*(*x*), *x*).

2. *Subdivide edges *(*Pa*(*y*), *y*) *by introducing a new vertex y'*.

3. *Re-connect components X and Y by adding edge f *= (*y', Ro*(*x*).

4. *Suppress the vertex u, and rename vertex y' as u*.

5. *Contract the root edge*.

*We say that, the tree TBR _{T }(v, x, y) is obtained from T by a *tree bisection and reconnection (TBR)

*operation that bisects the tree T into the components X and Y , and reconnects them above the nodes x and y. (See*Figure Figure1.)1

*.) We define the following neighborhoods for the TBR operation*:

1. *TBR _{G}*(

*v, x*)

*:=*

*(*

_{yY }TBR_{G}*v, x, y*)

2. *TBR _{G}*(

*v*)

*:=*

*(*

_{xX }TBR_{G}*v, x*)

3. *TBR _{G }:= *

_{(u, v)E(G) }

*TBR*(

_{G}*v*)

**Definition 7 **(Subtree Prune and Regrafting (SPR)). *The SPR operation is defined as a special case of the TBR operation. Let e *:= (*u, v*) *E*(*T*), *and X and Y be the connected components that are obtained by removing edge e from T such that v * *X *and *u * *Y. We define SPR _{T }*(

*v, y*)

*for y*

*Y to be TBR*(

_{T }*v, v, y*).

*We say that the tree SPR*(

_{T }*v, y*)

*is obtained from T by performing subtree prune and regraft (SPR) operation that prunes subtree T*Figure 2(a).)

_{v }and regrafts it above y. (See**The NNI adjacency graph**. (a) The tree $\overline{G}$ is obtained from

*G*by pruning and regrafting subtree

*G*to the root of

_{v }*G*. The vertex

*x*

*V*(

*G*) is suppressed, and the new vertex above root in $\overline{G}$ is named

*x*. (b) Two NNI operations NNI

_{G'}**...**

*We define the following *neighborhoods *for the SPR operation*:

*1. SPR _{G}*(

*v*)

*:=*

*(*

_{yY }SPR_{G}*v, y*)

*2. SPR _{G }:= *

_{(u, v)E(G) }

*SPR*(

_{G}*v*)

We now state the SPR based error-correction problems for duplication (D), duplication-loss (DL), and deep coalescence (DC). Let Γ {D, DL, DC}.

### Problem 1 (SPR based error-correction for Γ (SEC-Γ))

*Instance*: *A gene tree G and a species tree S*.

*Find: A gene tree G** *SPR _{G }such that *${\mathcal{C}}_{\Gamma}\left({G}^{*},S\right)=\underset{{G}^{\prime}\in SP{R}_{G}}{\text{min}}{\mathcal{C}}_{\Gamma}\left({G}^{\prime},S\right)$.

The TBR based error-correction for Γ (TEC-Γ) problems are defined analogously to the SPR based error-correction for Γ (SEC-Γ) problems.

### Solving the SEC-Γ problems

In this section we study the SPR based error-correction problems, for duplication (D), duplication-loss (DL), and deep coalescence (DC), in more detail. Our efficient solution for these problems are based on solving restricted versions of these problems efficiently. For each Γ {*D, DL, DC*} we first define a restricted version of the SEC-Γ problem, which we call the restricted SPR based error-correction for the Γ (R-SEC-Γ) problem.

### Problem 2 (Restricted SPR based error-correction for (R-SEC-Γ))

*Instance: A gene tree G, a species tree S, and v * *V*(*G*).

*Find: A gene tree G** *SPR _{G}*(

*v*)

*such that*${\mathcal{C}}_{\Gamma}\left({G}^{*},S\right)=\underset{{G}^{\prime}\in SP{R}_{G}\left(v\right)}{\text{min}}{\mathcal{C}}_{\Gamma}\left({G}^{\prime},S\right)$.

**Observation 1**. Let Γ {*D, DL, DC*}. *Given a gene tree G and a species tree S*, the *SEC-*Γ *problem can be solved as follows: (i) solve the R-SEC-*Γ *problem for every v * *V*(*G*) *where v *≠ *Ro*(*G*), *(ii) under all solutions found return a minimum scoring gene tree G**.

Naïvely, the R-SEC-Γ problem can be solved in Θ(*n*^{2}) time by computing the cost ${\mathcal{C}}_{\Gamma}\left({\mathsf{\text{G}}}^{\prime},\mathsf{\text{S}}\right)$ for each *G*' *SPR _{G}*(

*v*). The cost for a given gene and species tree can be computed in Θ(

*n*) time [21]. We introduce a novel algorithm for the R-SEC-Γ problem that improves by a factor of

*n*on the naïve solution. This speedup is achieved by semi-ordering the trees in

*SPR*(

_{G}*v*), for each

*v*

*V*(

*G*), such that the score-difference of any two consecutive trees in this order can be computed in constant time.

### Ordering the trees in SPR_{G}(*v*)

_{G}

Consider a graph on trees in *SPR _{G}*(

*v*), in which every two adjacent trees are one NNI [19] operation apart. We show that such a graph is a rooted full binary tree, after providing necessary definitions.

**Definition 8 **(Nearest Neighbor Interchange (NNI)). *We define the NNI operation as a special case of the SPR operation. Let e * *E*(*T*) *where e *:= (*u, v*), *and X and Y be the connected components that are obtained by removing edge e from T such that v * *X and u * *Y. We define NNI _{T }*(

*v*)

*to be SPR*(

_{T }*v, y*)

*for y:= Pa*(

*u*),

*and say that NNI*(

_{T }*v*)

*is obtained from T by performing nearest neighbor interchange (NNI) operation that prunes subtree T*Figure 2(b).)

_{v }and regrafts it above the parent of v's parent. (See**Definition 9 **(NNI distance). *Let the *NNI-distance, *denoted as d _{NNI}*(

*T*

_{1, }

*T*

_{2}),

*between two trees T*

_{1 }

*and T*

_{2 }

*over n taxa be the minimum number of NNI operations required to transform T*

_{1 }

*into T*

_{2}.

**Definition 10 **(NNI-adjacency graph). *The *NNI-adjacency graph, *denoted as *$\mathcal{X}=\left(V,E\right)$, *is the graph where V = SPR _{G}*(

*v*)

*and*{

*T*

_{1, }

*T*

_{2}}

*E if d*(

_{NNI}*T*

_{1, }

*T*

_{2}) = 1.

**Lemma 1**. $\mathcal{X}$*is a tree*.

*Proof*. We prove it by showing that there exists a unique path between every two vertices in $\mathcal{X}$. Let *G', G*'' *V*($\mathcal{X}$), thus *G', G*'' SPR* _{G}*(

*v*). Let

*G*':= SPR

*(*

_{G}*v, x*

_{1}) and

*G*'':= SPR

*(*

_{G}*v, x*

_{2}). We use induction on

*d*(

_{G}*x*

_{1},

*x*

_{2}). Let

*d*(

_{G}*x*

_{1},

*x*

_{2}) = 1 and assume without loss of generality that

*x*

_{2 }=

*Pa*(

_{G}*x*

_{1}). Thus,

*G*'' = NNI

*(*

_{G'' }*Sb*(

*x*

_{1})). So the hypothesis holds for

*d*(

_{G}*x*

_{1},

*x*

_{2}) = 1. Assume now that the hypothesis is true for

*d*(

_{G}*x*

_{1},

*x*

_{2}) ≤

*k*and suppose

*d*(

_{G}*x*

_{1},

*x*

_{2}) =

*k*+ 1. Since

*G*is a tree, there must be a unique path between

*x*

_{1 }and

*x*

_{2}; let

*y*be a vertex on this path. Let

*d*(

_{G}*y, x*

_{1}) = 1, and

*G*:= SPR

^{n }*(*

_{G}*v, y*). If

*y*=

*Pa*(

_{G}*x*

_{1}), then

*G*= NNI

^{n }*(*

_{G'}*v*); otherwise

*G*= NNI

^{n }*(*

_{G'}*Sb*(

*y*)). Since

*d*(

_{G}*y, x*

_{2}) =

*k*, thus (by induction hypothesis) the hypothesis is valid for

*d*(

_{G}*x*

_{1},

*x*

_{2}) =

*k*+ 1. □

**Theorem 1**. $\mathcal{X}$*is a rooted full binary tree*.

*Proof*. In view of Lemma 1, it suffices to show that except a unique vertex of degree 2 all other vertices in $\mathcal{X}$ are of degree 1 or 3. Let *G*' *V*($\mathcal{X}$), thus *G*' = SPR* _{G}*(

*v, y*) for some

*y*

*V*(

*G*). There are three cases:

**Case 1: ***y ***is a root**. Let *y*_{1 } *Ch _{G}*(

*y*). Let

*G*

^{1 }:= SPR

*(*

_{G}*v, y*

_{1}), thus ${G}^{\prime}=\mathsf{\text{NN}}{\mathsf{\text{I}}}_{{\mathsf{\text{G}}}^{\mathsf{\text{1}}}}\left(v\right)$). Hence {

*G*

^{1},

*G*'}

*E*($\mathcal{X}$). Since |

*Ch*(

_{G}*y*)| = 2,

*G*' must be a degree 2 vertex in $\mathcal{X}$.

**Case 2: **y **is a leaf**. Let *y*_{1 }= *Pa _{G}*(

*y*). Let

*G*

^{1 }:= SPR

*(*

_{G}*v, y*

_{1}), thus

*G*

^{1 }= NNI

*(*

_{G'}*v*). Hence {

*G*

^{1},

*G*'}

*E*($\mathcal{X}$), and consequently,

*G*' is a degree 1 vertex in $\mathcal{X}$.

**Case 3: ***y ***is an internal vertex**. Let *y*_{1 }= *Pa _{G}*(

*y*) and

*y*

_{2 }

*Ch*(

_{G}*y*). Let

*G*

^{1 }:= SPR

*(*

_{G}*v, y*

_{1}), thus

*G*

^{1 }= NNI

*(*

_{G'}*v*). Let

*G*

^{2 }:= SPR

*(*

_{G}*v, y*

_{2}), thus

*G*' = NNI

*(*

_{G}^{2}*v*). Since

*y*has one parent and two children in

*G*, thus

*G*' is a degree 3 vertex in $\mathcal{X}$.

This completes the proof.

### The score difference of consecutive trees in $\mathcal{X}$

To solve the R-SEC-Γ problems we traverse tree $\mathcal{X}$. Two adjacent trees in *V*($\mathcal{X}$) are one NNI operation apart. We show that ${\mathcal{C}}_{\Gamma}$ score of a tree can be computed in constant time from the LCA computation of its adjacent tree.

Let *e *:= (*G', G*'') be an edge in $\mathcal{X}$. Let *x *:= *Pa*(*v*), *y *:= *Sb*(*v*), and *z, z*' *Ch*(*y*) in *G*' (see Figure 2(b)). Without loss of generality, let *G*'':= NNI* _{G'}*(

*z*). (Observe,

*G*'' is similar to ${G}_{r}^{{}^{\prime}}$ of Figure 2(b).)

**Lemma 2**. * _{G'',S}*(

*y*) =

*(*

_{G',S}*x*).

*Proof*. From NNI operation, *v, z*' *Ch _{G''}*(

*x*) and

*z, x*

*Ch*(

_{G''}*y*). Also, ${G}_{z}^{{}^{\prime}}\simeq {G}_{z}^{{}^{\u2033}},\phantom{\rule{2.77695pt}{0ex}}{G}_{{z}^{\prime}}^{{}^{\prime}}\simeq {G}_{{z}^{\prime}}^{{}^{\u2033}},{G}_{v}^{{}^{\prime}}\simeq {G}_{v}^{{}^{\u2033}}$, so $Le\left({\mathsf{\text{G}}}_{y}^{{}^{\u2033}}\right)=Le\left({\mathsf{\text{G}}}_{x}^{{}^{\prime}}\right)$. Thus, ${{\mathcal{M}}_{{G}^{\prime}}}_{,S}\left(x\right)=\mathsf{\text{LCA}}\left({\mathcal{L}}_{{G}^{\prime},S}\left(Le\left({G}_{x}^{{}^{\prime}}\right)\right)\right)=\mathsf{\text{LCA}}\left({\mathcal{L}}_{{G}^{\u2033},S}\left(Le\left({G}_{y}^{{}^{\u2033}}\right)\right)\right)={{\mathcal{M}}_{{G}^{\u2033}}}_{,S}\left(y\right)$. □

**Lemma 3**. * _{G'',S}*(

*w*) =

*(*

_{G',S}*w*),

*for all w*

*V*(

*G*')\{

*x, y*}.

*Proof*. For $g\in V\left({G}_{v}^{{}^{\prime}}\right)\cup \left({G}_{z}^{{}^{\prime}}\right)\cup \left({G}_{{z}^{\prime}}^{{}^{\prime}}\right)$, since ${G}_{g}^{{}^{\prime}}\simeq {G}_{g}^{{}^{\u2033}}$, therefore * _{G',S}*(

*g*) =

*(*

_{G'',S}*g*). Also, except for subtree ${G}_{x}^{{}^{\prime}}$, the rest of the tree remains the same in ${G}_{x}^{{}^{\u2033}}$. Thus by Lemma 2,

*(*

_{G',S}*Pa*(

_{G' }*x*)) =

*(*

_{G'',S}*Pa*(

_{G''}*y*)). Inductively,

*(*

_{G',S}*g*) =

*(*

_{G'',S}*g*), for all

*g*

*V*(

*G*')\

*V*(

*G'*). □

_{x}**Lemma 4**. * _{G''},_{S}*(

*x*) =

*LCA*(

*(*

_{G',S}*v*),

*(*

_{G', S}*z*')).

*Proof*. From Lemma 3, * _{G'',S}*(

*v*) =

*(*

_{G',S}*v*) and

*(*

_{G'',S}*z*') =

*(*

_{G',S}*z*'). Thus,

*(*

_{G'',S}*x*) = LCA(

*(*

_{G'',S}*v*),

*(*

_{G'',S}*z*')) = LCA(

*(*

_{G',S}*v*),

*(*

_{G',S}*z*')). □

**Lemma 5**. ${\mathcal{C}}_{\Gamma}\left({G}^{\u2033},S,g\right)={\mathcal{C}}_{\Gamma}\left({G}^{\prime},S,g\right)$, *for all g * *V*(*G*'')\{*x, y*} *and *Γ {*D, DL, DC*}.

*Proof*. The gene duplication and loss status of a vertex, and the number of lineages from a vertex to its children in *G*' can change in *G*'' if its mapping or mapping of any of its children changes in * _{G'',S}*. From Lemma 3, and also, since

*(*

_{G''},_{S}*w*) =

*(*

_{G',S}*w*), for

*w*

*Ch*(

*Pa*(

_{G'}*x*)), must have ${\mathcal{C}}_{\Gamma}\left({G}^{\u2033},S,P{a}_{{G}^{\prime}}\left(x\right)\right)={\mathcal{C}}_{\Gamma}\left({G}^{\prime},S,P{a}_{{G}^{\prime}}\left(x\right)\right)$. Thus the Lemma follows. □

Let *e *:= (*G', G*'') *E*($\mathcal{X}$) and Γ {D, DL, DC}. We define $\Gamma e:={\mathcal{C}}_{\Gamma}\left({G}^{\u2033},S\right)-{\mathcal{C}}_{\Gamma}\left({G}^{\prime},S\right)$ with respect to the given species tree *S*. Observe that this score can be negative too. We study how Γ* _{e }*can be computed efficiently for each edge

*e*in $\mathcal{X}$.

**Theorem 2**. ${\Gamma}_{e}=\sum _{g\in \left\{x,y\right\}}\left({\mathcal{C}}_{\Gamma}\left({G}^{\u2033},\phantom{\rule{2.77695pt}{0ex}}S,\phantom{\rule{2.77695pt}{0ex}}g\right)-{\mathcal{C}}_{\Gamma}\left({G}^{\prime},\phantom{\rule{2.77695pt}{0ex}}S,\phantom{\rule{2.77695pt}{0ex}}g\right)\right)$.

*Proof *.$\begin{array}{c}{\Gamma}_{e}={\mathcal{C}}_{\Gamma}\left({G}^{\u2033},S\right)-{\mathcal{C}}_{\Gamma}\left({G}^{\prime},S\right)=\sum _{g\in V\left({G}^{\u2033}\right)}\left({\mathcal{C}}_{\Gamma}\left({G}^{\u2033},S,g\right)-{\mathcal{C}}_{\Gamma}\left({G}^{\prime},S,g\right)\right)=\sum _{g\in V\left({G}^{\u2033}\right)\backslash \left\{x,y\right\}}({\mathcal{C}}_{\Gamma}\left({G}^{\u2033},S,g\right)-\\ {\mathcal{C}}_{\Gamma}\left({G}^{\prime},S,g\right))+\sum _{g\in \left\{x,y\right\}}\left({\mathcal{C}}_{\Gamma}\left({G}^{\u2033},S,g\right)-{\mathcal{C}}_{\Gamma}\left({G}^{\prime},S,g\right)\right)=\sum _{g\in \left\{x,y\right\}}\left({\mathcal{C}}_{\Gamma}\left({G}^{\u2033},S,g\right)-{\mathcal{C}}_{\Gamma}\left({G}^{\prime},S,g\right)\right).\\ \end{array}$

□

**Definition 11**. *Let *$\overline{G}:=SP{R}_{G}\left(v,Ro\left(G\right)\right)$, *and let P _{G' }be a path from *$\overline{G}$

*to G*

^{' }

*in*$\mathcal{X}$.

*For G*

^{'},

*we define the*score-difference ${\Gamma}_{\overline{G},G\prime}$

*as*${\Gamma}_{\overline{G},G\prime}:=\sum _{e\in E\left({P}_{G\prime}\right)}{\Gamma}_{e}$.

**Theorem 3**. *For given S, G, and v * *V*(*G*), *the tree G*' *V*($\mathcal{X}$) *is the output of a R-SEC*-Γ *problem iff *${\Gamma}_{\overline{G},{G}^{\prime}}=mi{n}_{G\u201d\in V\left(\mathcal{X}\right)\phantom{\rule{0.3em}{0ex}}}{\Gamma}_{\overline{G},G\u201d}$.

*Proof*. Let ${\Gamma}_{\overline{G},{G}^{\prime}}=mi{n}_{{G}^{\u2033}\in V\left(\mathcal{X}\right)\phantom{\rule{0.3em}{0ex}}}{\Gamma}_{\overline{G},{G}^{\u2033}}$. We prove that *G*' is the output of R-SEC-Γ problem. Since ${{\Gamma}_{\u1e20,G}}_{{}^{\prime}}=\sum _{e\in E\left({{P}_{G}}_{{}^{\prime}}\right)}{\Gamma}_{e}=\Gamma \left({G}^{\prime},\phantom{\rule{2.77695pt}{0ex}}S\right)-\Gamma \left(\u1e20,\phantom{\rule{2.77695pt}{0ex}}S\right)$, thus *G*' gives the minimum normalized ${\mathcal{C}}_{\Gamma}$ score over all trees in *V*($\mathcal{X}$). Hence, *G*' must be the output of the R-SEC-Γ problem. The other direction follows similarly. □

### The algorithm

We describe a general algorithm, called Algo-R-SEC-Γ, to solve the R-SEC-Γ problem for each Γ {*D, DL, DC*}. Initially Algo-R-SEC-Γ computes (i) the root vertex of the NNI-adjacency graph $\mathcal{X}$, which we call $\overline{G}$, by regrafting the subtree *G _{v }*above the root of

*G*, (ii) the LCA mapping from $\overline{G}$ to

*S*, and (iii) the Γ score from $\overline{G}$ to

*S*. Then recursively Algo-R-SEC-Γ computes the LCA mapping and Γ score for every vertex

*G*' in $\mathcal{X}$ when the LCA mapping and Γ score of its parent vertex in $\mathcal{X}$ is known. Algorithm 1 details Algo-R-SEC-Γ.

### Algorithm 1 - Algo-R-SEC-Γ

**Input: **A gene tree G, a species tree S, and v *V*(*G*)

* Output: A tree G**

*SPR*(

_{G}*v*)

*such that*${\mathcal{C}}_{\Gamma}\left({G}^{*},\phantom{\rule{2.77695pt}{0ex}}S\right)={\text{min}}_{{G}^{\prime}\in SP{R}_{G}\left(v\right)}{\mathcal{C}}_{\Gamma}\left({G}^{\prime},\phantom{\rule{2.77695pt}{0ex}}S\right)$

*01. Compute *$\overline{G}$*by pruning G _{v }and regrafting at Ro(G)*

*02. Compute LCA mapping *${\mathcal{M}}_{\u1e20,S}$

*03. Call *${\mathcal{C}}_{\mathsf{\text{G}}}\left(\overline{G},S\right)\mathsf{\text{}}=Algo-Comp-Score\left(\overline{G},S,{\mathcal{M}}_{\overline{G},S}\right)$

*04. Set *$BestTree=\overline{G}$, *BestScore *= 0

*05. Set *${G}^{\prime}=\u1e20$, ${\mathcal{M}}_{{G}^{\prime},S}={\mathcal{M}}_{\u1e20,S}$, ${\mathcal{C}}_{\Gamma}\left({G}^{\prime},\phantom{\rule{2.77695pt}{0ex}}S\right)={\mathcal{C}}_{\Gamma}\left(\u1e20,\phantom{\rule{2.77695pt}{0ex}}S\right)$, ${{\Gamma}_{\u1e20,G}}_{\prime}=0$

*06. For each *$k\ne Ro\left({\u1e20}_{Sb\left(v\right)}\right)$

*in preorder traversal of*${\u1e20}_{Sb\left(v\right)}$,

*do**07*. **If **not backtracking, **then**

*08. Set x = Pa _{G'}*(

*v*),

*y*=

*Sb*'(

_{G}*v*)

*09. Set G*'' = *NNI _{G'}*(

*Sb*(

_{G'}*k*))

*10. Set ** _{G''.S }*=

*,*

_{G',S}*G'',*(

_{S}*y*) =

*(*

_{G',S}*x*)

*11*. * _{G'',S}*(

*x*) =

*LCA*(

*(*

_{G',S}*k*),

*(*

_{G',S}*v*))

*12. Call *${\Gamma}_{\left\{{G}^{\prime},G\u201d\right\}}={\sum}_{h\in \left\{x,y\right\}}Algo-G-Score\left(G\u201d,\phantom{\rule{2.77695pt}{0ex}}S,\phantom{\rule{2.77695pt}{0ex}}{\mathcal{M}}_{G\u201d,S},\phantom{\rule{2.77695pt}{0ex}}h\right)-Algo-G-Score\left({G}^{\prime},\phantom{\rule{2.77695pt}{0ex}}S,\phantom{\rule{2.77695pt}{0ex}}{\mathcal{M}}_{{G}^{\prime},S},\phantom{\rule{2.77695pt}{0ex}}h\right)$

*13*. ${\Gamma}_{\u1e20,G\u201d}={{\Gamma}_{\u1e20,}}_{{G}^{\prime}}+{\Gamma}_{\left\{{G}^{\prime},G\u201d\right\}}$

*14*. ** If**${\Gamma}_{\u1e20,G\u201d}<BestScore$,

*then**15. Set BestTree *= *G*'', $BestScore={\Gamma}_{\u1e20,G\u201d}$

*16*. ** Else**,

*17. Set *$x\mathsf{\text{}}=\mathsf{\text{}}P{{a}_{G}}_{{}^{\prime}}\left(v\right),\mathsf{\text{}}y\mathsf{\text{}}=\mathsf{\text{}}P{{a}_{G}}_{{}^{\prime}}\left(x\right)$

*18. Set G*'' = *NNI _{G'}*(

*v*)

*19. Set *${\mathcal{M}}_{{G}^{\u2033},S}={\mathcal{M}}_{{G}^{\prime},S},{\mathcal{M}}_{{G}^{\u2033},S}\left(x\right)={\mathcal{M}}_{G\prime ,S}\left(y\right)$

*20. Set *${\mathcal{M}}_{{G}^{\u2033},S}(y)=LCA\left({\mathcal{M}}_{{G}^{\prime},S}\left(S{b}_{{G}^{\prime}}(x)\right),{\mathcal{M}}_{{G}^{\prime},S}(k)\right)$

*21. Call *${\Gamma}_{\left\{{G}^{\u2033},{G}^{\prime}\right\}}={\sum}_{h\in \left\{x,y\right\}}Algo-G\phantom{\rule{0.3em}{0ex}}-\phantom{\rule{0.3em}{0ex}}Score\left({G}^{\prime},S,{\mathcal{M}}_{{G}^{\prime},S},h\right)-Algo\phantom{\rule{0.3em}{0ex}}-\phantom{\rule{0.3em}{0ex}}G\phantom{\rule{0.3em}{0ex}}-\phantom{\rule{0.3em}{0ex}}Score\left({G}^{\u2033},S,{\mathcal{M}}_{{G}^{\u2033},S},h\right)$

*22. Set *${\Gamma}_{\u1e20,{G}^{\u2033}}={\Gamma}_{\u1e20,{G}^{\prime}}\phantom{\rule{2.77695pt}{0ex}}-{\Gamma}_{\left({G}^{\u2033},{G}^{\prime}\right)}$

*23. Set *${G}^{\prime}={G}^{\u2033},{\mathcal{M}}_{{G}^{\prime},S}={\mathcal{M}}_{{G}^{\u2033},S},{\Gamma}_{\u1e20,{G}^{\prime}}={\Gamma}_{\u1e20,{G}^{\u2033}}$

24. **Return **BestTree

### Algorithm 2 - Algo-Comp-Score

**Input: **A gene tree G, a species tree S, and LCA mapping _{G,S}

** Output:**${\mathcal{C}}_{\Gamma}$(

*G,S*)

01. score = 0

*02. For each g *

*I*(

*G*)

*in preorder traversal of G*,

*do**03*. $Call\mathsf{\text{}}score\mathsf{\text{}}=\mathsf{\text{}}score\mathsf{\text{}}+\mathsf{\text{}}Algo-G-Score\left(G,S,{{\mathcal{M}}_{G}}_{,S},\mathsf{\text{}}g\right)$

*04. If *Γ

*is DC,*

**then***05. score = score *- |*I*(*S*)|

06. **Return **score

### Algorithm 3 - Algo-G-Score

*Input: A gene tree G, a species tree S, LCA mapping *_{G}_{,S}*, and g * *I*(*G*)

** Output:**${\mathcal{C}}_{\Gamma}$(

*G, S, g*)

*01. If *Γ

*is D,*

**then***02*. ** If**(

*g*) (

*Ch*(

*g*)),

*then**03*. *Return **1*

*04. ElseIf *Γ

*is DL,*

**then***05 * $ls={\sum}_{h\in Ch\left(g\right)}|dp\left(\mathcal{M}\left(h\right)\right)-dp\left(\mathcal{M}\left(g\right)\right)-1|$

*06*. ** If**(

*g*) (

*Ch*(

*g*)),

*then**07*. *Return **ls + 1*

*08*. *Else*

*09*. *Return **ls*

*10. Else //*Γ

*is DC*

*11 * ** Return**${\sum}_{h\in Ch\left(g\right)}|dp\left(\mathcal{M}\left(h\right)\right)-dp\left(\mathcal{M}\left(g\right)\right)|$

**Lemma 6**. *The R-SEC-*Γ *problem is correctly solved by Algo-R-SEC-*Γ.

*Proof*. Lemma 1-5 and Theorem 1-3 directly imply that in order to prove the correctness of algorithm Algo-R-SEC-Γ, it is sufficient to prove that it correctly returns *G*' of minimum ${\Gamma}_{\u1e20,G\prime}$ among all *G*' *V*($\mathcal{X}$). We will show that algorithm Algo-R-SEC- accounts each *G*' *V*($\mathcal{X}$), correctly computes ${\Gamma}_{\u1e20,G\prime}$ for Γ {*D, DL, DC*}, and returns the right *G*' as output.

From Definition 10, *V*($\mathcal{X}$) = SPR* _{G}*(

*v*). In Algo-R-SEC-Γ, step 1 prunes subtree

*G*and regrafts it above the root of

_{v }*G*to create $\overline{G}$. Step 5 sets

*G*' to $\overline{G}$. The for-loop in step 6 traverses subtree ${\u1e20}_{Sb\left(v\right)}$ in preorder. For each traversed vertex $k\ne Ro\left({\u1e20}_{Sb\left(v\right)}\right)$, step 9 builds the tree

*G*'':= SPR

*(*

_{G}*v, k*) by applying NNI operation on the last build

*G*''. Each for-loop iteration sets

*G*' to the last build

*G*'' in step 23. $\overline{G}$ and

*G*''s constitute all the trees in

*SPR*(

_{G}*v*).

For $\overline{G}$, step 2 computes the LCA mapping and step 5 sets ${\Gamma}_{\u1e20,{G}^{\prime}}$ to zero. Following Lemma 2-4 and Theorem 2, step 10 and 11 update the LCA of G'' and step 12 computes ${\Gamma}_{\left\{{G}^{\prime},{G}^{\u2033}\right\}}$ by calling algorithm Algo-G-Score. Depending on Γ {*D, DL, DC*}, there are three cases:

**Case 1: **Γ **is D**. Algo-G-Score returns 1, if the vertex g *V*(*G*'') maps to the same vertex in *S *as any of its children maps to, otherwise 0.

**Case 2: **Γ **is DL**. Algo-G-Score computes losses by applying the formula of Definition 4. Further, it adds 1 if there is a duplication.

**Case 3: **Γ **is DC**. Algo-G-Score, returns the number of lineages from g to each of its children *h * *Ch*(*g*) in *S*. For each *h * *Ch*(*g*), depth of (*g*) is subtracted from depth of (*h*) to count number of edges between (*g*) and (*h*).

In Algo-R-SEC-Γ, step 13 computes ${\Gamma}_{\overline{G},{G}^{\u2033}}$ by adding ${\Gamma}_{\overline{G,}{G}^{\prime}}$ and ${\Gamma}_{\left\{{G}^{\prime},{G}^{\u2033}\right\}}$. When backtracking, steps 17-22 are executed to restore the right *G*' to compute the next unique *G*'' *Ch*_{$\mathcal{X}$}(*G*). This ensures that the correct ${\Gamma}_{\u1e20,{G}^{\prime}}$ is computed for each *G*' *V*($\mathcal{X}$).

In Algo-R-SEC-Γ, step 4 sets $\overline{G}$ as the BestTree and ${\Gamma}_{\u1e20,\overline{G}}\phantom{\rule{0.3em}{0ex}}\mathsf{\text{=}}\phantom{\rule{0.3em}{0ex}}\mathsf{\text{0}}$ as BestScore. Every time a new *G*'' *Ch*_{$\mathcal{X}$}(*G*) is encountered, step 14 compares ${{\Gamma}_{\u1e20,}}_{{G}^{\u2033}}$ with BestScore, and updates BestTree with *G*'' of the minimum ${{\Gamma}_{\u1e20,}}_{{G}^{\u2033}}$. After the for-loop, step 24 returns the BestTree. □

**Lemma 7**. *The R-SEC*-Γ *and SEC-*Γ *problems can be solved in *Θ(*n*) *and *Θ(*n*^{2}) *time, respectively*.

*Proof*. We will prove that the algorithm Algo-R-SEC-Γsolves the restricted SPR based error-correction problems for each Γ {*D, DL, DC*} in Θ(*n*) time. In Algo-R-SEC-Γ, step 1 takes constant time. Step 2 precomputes LCA values for species tree in O(n) time [24], and so, finds LCA mapping from $\overline{G}$ to *S *in *O*(*n*) time in bottom-up manner. Step 3 computes the duplication, duplication-loss or deep coalescence score of $\overline{G}$ and *S *by calling Algo-Comp-Score. In Algo-Comp-Score, step 1 and step 2 runs for *O*(1) and *O*(*n*) time, respectively. Step 3 calls Algo-G-Score in each iteration of for-loop. Algo-G-Score runs for *O*(1) time for Γ {*D, DL, DC*}.

When Γ is DC, steps 4 and 5 are further executed in Algo-Comp-Score for constant time. Thus in Algo-R-SEC-Γ, step 3 runs for *O*(*n*) time. Further, steps 4 and 5 take constant time. The loop of step 6 runs for Θ(*n*) time. If condition of step 7 is true, steps 8-10 executes in constant time. With precomputed LCA values from step 2, step 11 executes in constant time. Algo-G-Score runs for constant time for Γ {*D, DL, DC*}, and lets step 12 to execute in constant time. Further, steps 13-15 execute for constant time too. If the condition in step 7 is false, then steps 17-22 execute in constant time, similarly. Finally, step 23 runs for constant time, and hence, the R-SEC-Γ problem can be solved in Θ(*n*) time. From Observation 1, Algo-R-SEC-Γ is called Θ(*n*) time to solve SEC-Γ problem. Thus, the SEC-Γ problem can be solved in Θ(*n*^{2}) time. □

### Solving the TEC-Γ problems

In this section we study the TBR based error-correction problems, for duplication (D), duplication-loss (DL), and deep coalescence (DC). More precisely, we extend our solution for the SEC-Γ problems to solve the TEC-Γ problems. A TBR operation can be viewed as an SPR operation, except that the pruned subtree can be rerooted before it is regrafted. Our speed-up for the SEC-Γ problems is achieved by observing that the scores Γof any re-rooted pruned subtree and its remaining pruned tree are independent of each other. We define the R-TEC-Γ problems for the TEC-Γ problems, as we defined the R-SEC-Γ problems for the SEC-Γ problems. We will show that the R-TEC-Γ problems can be solved by solving two smaller problems separately and combining their solutions.

**Definition 12**. *Let T be a tree and x * *V*(*T*). *RR*(*T, x*) *is defined to be the tree T , if x *= *Ro*(*T*) *or x * *Ch*(*Ro*(*T*)). *Otherwise, RR*(*T, x*) *is the tree obtained by suppressing Ro*(*T*), *and subdividing the edge *(*Pa*(*x*), *x*) *by the new root node*.

**Lemma 8**. *Given a tuple **G, S, v*, and *G*'':= *TBR _{G}*(

*v, x, y*),

*for x*

*V*(

*G*),

_{v}*y*

*V*(

*G*)\

*V*(

*G*).

_{v}*Then*, ${\mathcal{C}}_{\Gamma}({G}^{\prime}\prime ,\text{\hspace{0.17em}}S){\le}_{{G}^{\prime}\in TB{R}_{G}(v)}{\mathcal{C}}_{\Gamma}({G}^{\prime},\text{\hspace{0.17em}}S)\text{\hspace{0.17em}}iff{\mathcal{C}}_{\Gamma}(RR({G}_{v},\text{\hspace{0.17em}}x),\text{\hspace{0.17em}}S){\le}_{{x}^{\prime}\in V({G}_{v}}{}_{)}{\mathcal{C}}_{\Gamma}(RR({G}_{v},\text{\hspace{0.17em}}{x}^{\prime}),\text{\hspace{0.17em}}S)$

*and*${\mathcal{C}}_{\Gamma}({{G}^{\prime}}^{\prime},\text{\hspace{0.17em}}S){\le}_{{G}^{\prime}\in TB{R}_{G}(v}{{}_{,}}_{x)}{\mathcal{C}}_{\Gamma}({G}^{\prime},\text{\hspace{0.17em}}S)$.

Proof. () Let *G*^{1 }:= *TBR _{G}*(

*v, x*

_{1, }

*y*), for

*x*

_{1 }

*V*(

*G*), and

_{v}*x*

_{1 }≠

*x*. Now observe that, $\forall g\in V\left(G\right)\backslash V\left({G}_{v}\right),\phantom{\rule{2.77695pt}{0ex}}{\mathcal{C}}_{\Gamma}\left({G}^{\u2033},\phantom{\rule{2.77695pt}{0ex}}S,\phantom{\rule{2.77695pt}{0ex}}g\right)={\mathcal{C}}_{\Gamma}\left({G}^{1},\phantom{\rule{2.77695pt}{0ex}}S,\phantom{\rule{2.77695pt}{0ex}}g\right)$ Also, let

*G*

^{2 }:=

*TBR*(

_{G}*v, x, y*

_{1}), for

*y*

_{1 }

*V*(

*G*)\

*V*(

*G*), and

_{v}*y*

_{1 }≠

*y*. Observe that, $\forall g\in V\left({G}_{v}\right),\phantom{\rule{2.77695pt}{0ex}}{\mathcal{C}}_{\Gamma}\left({G}^{\u2033},\phantom{\rule{2.77695pt}{0ex}}S,\phantom{\rule{2.77695pt}{0ex}}g\right)={C}_{\Gamma}\left({G}^{2},\phantom{\rule{2.77695pt}{0ex}}S,\phantom{\rule{2.77695pt}{0ex}}g\right)$. Thus, if

*G*'' gives the minimum duplication, duplication-loss, or deep coalescence score among all trees in

*TBR*(

_{G}*v*), then the score contribution of vertices in

*V*(

*G*) and

_{v}*V*(

*G*)\

*V*(

*G*) is independent. Now looking at vertices of

_{v}*G*, the best score is achieved when

*G*is rooted at

_{v }*x*, i.e. ${\mathcal{C}}_{\Gamma}\left(RR\left({G}_{v},\phantom{\rule{2.77695pt}{0ex}}x\right),\phantom{\rule{2.77695pt}{0ex}}S\right){\le}_{{x}^{\prime}\in V\left({G}_{v}\right)}{\mathcal{C}}_{\Gamma}\left(RR\left({G}_{v},\phantom{\rule{2.77695pt}{0ex}}{x}^{\prime}\right),\phantom{\rule{2.77695pt}{0ex}}S\right)$; also the best score is achieved when

*RR*(G

_{v, }

*x*) is regrafted at

*y*, i.e., ${\mathcal{C}}_{\Gamma}\left({G}^{\u2033},\phantom{\rule{2.77695pt}{0ex}}S\right){\le}_{{G}^{\prime}\in \mathsf{\text{TB}}{\mathsf{\text{R}}}_{G}\left(v,x\right)}{\mathcal{C}}_{\Gamma}\left({G}^{\prime},\phantom{\rule{2.77695pt}{0ex}}S\right).\phantom{\rule{0.3em}{0ex}}\left(\Leftarrow \right)$. This follows similarly. □

Lemma 8 implies that a tree in TBR* _{G}*(

*v*) with the minimum duplication, duplication-loss, or deep coalescence cost can be obtained by optimizing the rooting for the pruned subtree, and the regraft location, separately. A best rooting for the pruned subtree is linear time computable [17,25], and the solution to the R-SEC problem identifies a best regraft location in Θ(

*n*) time. This allows to obtain a tree in TBR

*(*

_{G}*v*) with the minimum duplication, duplication-loss, or deep coalescence cost by evaluating only Θ(

*n*) trees. Thus the R-TEC-Γ problem can be solved in Θ(n) time. The TEC-Γ problem can be solved by calling the solution of R-TEC-Γ problem Θ(

*n*) times, and Theorem 4 follows.

**Theorem 4**. *The TEC-*Γ *problem can be solved in *Θ(*n*^{2}) *time*.

### Experimental results

We tested the performance of the gene tree rearrangement algorithms on a set of 106 gene alignments containing sequences from 8 yeast taxa from Rokas et al. [26]. There is a well accepted phylogeny for the yeast species, and the data set has been used to test algorithms for gene tree parsimony based on the deep coalescence problem [27,28]. We constructed maximum likelihood gene trees for each gene using RAxML-VI-HPC version 7.0.4 [29], the gene trees were rooted with the outgroup *Candida albicans*. We used the new error correction algorithms to examine how much a single SPR rearrangement in the gene tree reduces the reconciliation cost based on deep coalescence and also gene duplications and losses. Over all genes the SPR error correction reduced the total deep coalescence cost from 151 to 53 (Table (Table1)1) and the duplication and loss cost from 481 to 175 (Table (Table2).2). Both the algorithms took only seconds to run for all 106 genes on a standard laptop.

We also implemented a protocol to use the gene rearrangement algorithm to correct for gene tree error in gene tree parsimony phylogenetic analyses. We first took a collection of input gene trees and performed a SPR species tree search using Duptree [30], which seeks the species tree with the minimum gene duplication cost. We used the duplication only cost (instead of duplications and losses) because when there is no complete sampling of all existing genes, the loss estimates may be inflated by missing sequences. After finding the locally optimal species tree, we used our SPR gene tree rearrangement algorithm to find gene tree topologies with a lower duplication cost. We then performed another SPR species tree search using Duptree, starting from the locally optimal species tree and using the new gene tree topologies. This search strategy is similar to re-rooting protocol in Duptree, which checks for better gene tree roots after a SPR species tree search [30,31]. We tested this protocol on data set of 6,084 genes (with a combined 81,525 leaves) from 14 seed plant taxa. This is the same data set used by [31], except that all gene tree clades containing sequences from a single species were collapsed to a single leaf. Our original SPR tree search found a species tree with 23,500 duplications. The SPR tree search after the gene tree rearrangements identified the same species tree, but the new gene trees had a reconciliation cost of only 18,213. This tree search protocol took just under 4 hours on a Mac Powerbook with a 2 GHz Intel Core 2 Duo processor and 2 GB memory.

## Conclusion

GT-ST reconciliation provides a powerful approach to study the patterns and processes of gene and genome evolution. Yet it can be thwarted by the error that is an inherent part of gene tree inference. Any reliable method for GT-ST reconciliation must account for gene tree error; however, any useful method also must be computationally tractable for large-scale genomic data. We introduce fast and effective algorithms to correct error in the gene trees. These algorithms, based on SPR and TBR rearrangements, greatly extend upon the range of possible errors in the gene tree from existing algorithms [17,18], while remaining fast enough to use on data sets with thousands of genes. These algorithms can correct trees based on a broad variety of evolutionary factors that can cause conflict between gene trees and species trees, including gene duplication, duplications and losses, and deep coalescence.

Our analysis on 106 yeast gene trees demonstrates that even a single SPR correction on the gene trees can radically improve upon the reconciliation cost. Our results in the yeast analysis are very similar to the 2-3 fold improvement in implied duplications and losses reported from the parametric gene tree estimation and reconciliation method of Rasmussen and Kellis [5]. However, in contrast, to this computationally complex method, the gene tree rearrangement algorithm is extremely fast, does not require assumption about the rates of duplication and loss, and is also amenable to corrections based on deep coalescence and duplications as well as duplications and losses. We do not claim that the gene correction algorithms produce a more accurate reconciliation than these parametric methods. However, they do present an extremely fast and flexible alternative.

We also demonstrated that this error correction protocol could easily be incorporated into a gene tree parsimony phylogenetic analysis. Previous studies have emphasized that gene tree parsimony is sensitive to the topology of the input trees. For example, the species tree may differ whether the gene trees are made using parsimony or maximum likelihood [8,10]. In our study, although the gene tree rearrangement did not affect the species tree inference, it did greatly reduce the gene duplication reconciliation cost.

While the results of the experiments are promising, they also suggest several directions for future research. First, further investigation is needed to characterize the effects of error on gene tree topologies. For example, it seems likely that gene tree errors may extend beyond a single SPR or TBR neighborhood. Yet, if we allow unlimited rearrangements, the gene trees will simply converge on the species tree topology. One simple improvement may be to weight the possible gene tree rearrangements based on support for different clades in the gene tree. Thus, well-supported clades may be rarely or never be subject to rearrangement, while poorly supported clades may be subject to extensive rearrangements. Finally, these approaches implicitly assume that all differences between gene trees and species trees are due to either coalescence, duplications, or duplications and losses. Future work will seek to combine these objectives and also address lateral transfer.

## Competing interests

The authors declare that they have no competing interests.

## Author's contributions

RC was responsible for algorithm design and program implementation, and wrote major parts of the paper. JGB performed the experimental evaluation and the analysis of the results, and contributed to the writing of the paper. OE supervised the project, contributed to the algorithmic design and writing of the paper.

All authors read and approved the final manuscript.

## Acknowledgements

The authors thank André Wehe for his generous support with the implementation. This work was conducted in parts with support from the Gene Tree Reconciliation Working Group at NIMBioS through NSF award EF-0832858, with additional support from the University of Tennessee. R.C. and O.E. were supported in parts by NSF awards #0830012 and #10117189.

This article has been published as part of *BMC Bioinformatics *Volume 13 Supplement 10, 2012: "Selected articles from the 7th International Symposium on Bioinformatics Research and Applications (ISBRA'11)". The full contents of the supplement are available online at http://www.biomedcentral.com/bmcbioinformatics/supplements/13/S10.

## References

- Maddison WP. Gene Trees in Species Trees. Systematic Biology. 1997;46:523–536. doi: 10.1093/sysbio/46.3.523. [Cross Ref]
- Goodman M, Czelusniak J, Moore GW, Romero-Herrera AE, Matsuda G. Fitting the gene lineage into its species lineage. A parsimony strategy illustrated by cladograms constructed from globin sequences. Systematic Zoology. 1979;28:132–163. doi: 10.2307/2412519. [Cross Ref]
- Guigó R, Muchnik I, Smith TF. Reconstruction of Ancient Molecular Phylogeny. Molecular Phylogenetics and Evolution. 1996;6(2):189–213. doi: 10.1006/mpev.1996.0071. [PubMed] [Cross Ref]
- Slowinski JB, Knight A, Rooney AP. Inferring Species Trees from Gene Trees: A Phylogenetic Analysis of the Elapidae (Serpentes) Based on the Amino Acid Sequences of Venom Proteins. Molecular Phylogenetics and Evolution. 1997;8:349–362. doi: 10.1006/mpev.1997.0434. [PubMed] [Cross Ref]
- Rasmussen MD, Kellis M. A Bayesian approach for fast and accurate gene tree reconstruction. Molecular Biology and Evolution. 2011;28:273–290. doi: 10.1093/molbev/msq189. [PMC free article] [PubMed] [Cross Ref]
- Burleigh JG, Bansal MS, Wehe A, Eulenstein O. Locating Large-Scale Gene Duplication Events through Reconciled Trees: Implications for Identifying Ancient Polyploidy Events in Plants. Journal of Computational Biology. 2009;16:1071–1083. doi: 10.1089/cmb.2009.0139. [PubMed] [Cross Ref]
- Hahn MW. Bias in phylogenetic tree reconciliation methods: implications for vertebrate genome evolution. Genome Biology. 2007;8:R141. doi: 10.1186/gb-2007-8-7-r141. [PMC free article] [PubMed] [Cross Ref]
- Burleigh JG, Bansal MS, Eulenstein O, Hartmann S, Wehe A, Vision TJ. Genome-scale phylogenetics: inferring the plant tree of life from 18,896 discordant gene trees. Systematic Biology. 2011;60(2):117–125. doi: 10.1093/sysbio/syq072. [PMC free article] [PubMed] [Cross Ref]
- Huang H, Knowles LL. What Is the Danger of the Anomaly Zone for Empirical Phylogenetics? Systematic Biology. 2009;58:527–536. doi: 10.1093/sysbio/syp047. [PubMed] [Cross Ref]
- Sanderson MJ, McMahon MM. Inferring angiosperm phylogeny from EST data with widespread gene duplication. BMC Evolutionary Biology. 2007;7(suppl 1:S3) [PMC free article] [PubMed]
- Berglund-Sonnhammer A, Steffansson P, Betts MJ, Liberles DA. Optimal Gene Trees from Sequences and Species Trees Using a Soft Interpretation of Parsimony. Journal of Molecular Evolution. 2006;63:240–250. doi: 10.1007/s00239-005-0096-1. [PubMed] [Cross Ref]
- Vernot B, Stolzer M, Goldman A, Durand D. Reconciliation with non-binary species trees. Computational Systems Bioinformatics. 2007;53:441–452. [PubMed]
- Yu Y, Warnow T, Nakhleh L. In: RECOMB, Volume 6577 of Lecture Notes in Computer Science. Bafna V, Sahinalp SC, editor. Springer; 2011. Algorithms for MDC-Based Multi-locus Phylogeny Inference; pp. 531–545.
- Cotton JA, Page RDM. Going nuclear: gene family evolution and vertebrate phylogeny reconciled. P Roy Soc Lond B Biol. 2002;269:1555–1561. doi: 10.1098/rspb.2002.2074. [PMC free article] [PubMed] [Cross Ref]
- Joly S, Bruneau A. Measuring Branch Support in Species Trees Obtained by Gene Tree Parsimony. Systematic Biology. 2009;58:100–113. doi: 10.1093/sysbio/syp013. [PubMed] [Cross Ref]
- Arvestad L, Berglund A, Lagergren J, Sennblad B. Gene tree reconstruction and orthology analysis based on an integrated model for duplications and sequence evolution. RECOMB. 2004. pp. 326–335.
- Chen K, Durand D, Farach-Colton M. Notung: a program for dating gene duplications and optimizing gene family trees. Journal of Computational Biology. 2000;7:429–447. doi: 10.1089/106652700750050871. [PubMed] [Cross Ref]
- Durand D, Halldórsson BV, Vernot B. A Hybrid Micro-Macroevolutionary Approach to Gene Tree Reconstruction. Journal of Computational Biology. 2006;13(2):320–335. doi: 10.1089/cmb.2006.13.320. [PubMed] [Cross Ref]
- Allen BL, Steel M. Subtree transfer operations and their induced metrics on evolutionary trees. Annals of Combinatorics. 2001;5:1–13. doi: 10.1007/s00026-001-8006-8. [Cross Ref]
- Bordewich M, Semple C. On the computational complexity of the rooted subtree prune and regraft distance. Annals of Combinatorics. 2004;8:409–423.
- Zhang L. On a Mirkin-Muchnik-Smith Conjecture for Comparing Molecular Phylogenies. Journal of Computational Biology. 1997;4(2):177–187. doi: 10.1089/cmb.1997.4.177. [PubMed] [Cross Ref]
- Page RDM. Maps between trees and cladistic analysis of historical associations among genes, organisms, and areas. Systematic Biology. 1994;43:58–77.
- Eulenstein O. Predictions of gene-duplications and their phylogenetic development. PhD thesis. University of Bonn, Germany 1998. [GMD Research Series No. 20/1998, ISSN: 1435-2699]
- Bender MA, Farach-Colton M. The LCA Problem Revisited. LATIN. 2000. pp. 88–94.
- Górecki P, Tiuryn J. Inferring phylogeny from whole genomes. ECCB (Supplement of Bioinformatics) 2006. pp. 116–122. [PubMed]
- Rokas A, Williams BL, King N, Carroll SB. Genome-scale approaches to resolving incongruence in molecular phylogenies. Nature. 2003;425(6960):798–804. doi: 10.1038/nature02053. [PubMed] [Cross Ref]
- Than C, Nakhleh L. Species tree inference by minimizing deep coalescences. PLoS Comput Biol. 2009;5(9):e1000501. doi: 10.1371/journal.pcbi.1000501. [PMC free article] [PubMed] [Cross Ref]
- Bansal MS, Burleigh JG, Eulenstein O. Efficient genome-scale phylogenetic analysis under the duplication-loss and deep coalescence cost models. BMC Bioinformatics. 2010;11(Suppl 1):S42. doi: 10.1186/1471-2105-11-S1-S42. [PMC free article] [PubMed] [Cross Ref]
- Stamatakis A. RAxML-VI-HPC: maximum likelihood-based phylogenetic analyses with thousands of taxa and mixed models. Bioinformatics. 2006;22(21):2688–2690. doi: 10.1093/bioinformatics/btl446. [PubMed] [Cross Ref]
- Wehe A, Bansal MS, Burleigh JG, Eulenstein O. DupTree: a program for large-scale phylogenetic analyses using gene tree parsimony. Bioinformatics. 2008;24(13) [PubMed]
- Chang W, Burleigh JG, Fernández-Baca D, Eulenstein O. An ILP solution for the gene duplication problem. BMC Bioinformatics. 2011;12(Suppl 1):S14. doi: 10.1186/1471-2105-12-S1-S14. [PMC free article] [PubMed] [Cross Ref]

**BioMed Central**

## Formats:

- Article |
- PubReader |
- ePub (beta) |
- PDF (445K)

- Efficient genome-scale phylogenetic analysis under the duplication-loss and deep coalescence cost models.[BMC Bioinformatics. 2010]
*Bansal MS, Burleigh JG, Eulenstein O.**BMC Bioinformatics. 2010 Jan 18; 11 Suppl 1:S42. Epub 2010 Jan 18.* - Algorithms: simultaneous error-correction and rooting for gene tree reconciliation and the gene duplication problem.[BMC Bioinformatics. 2012]
*Górecki P, Eulenstein O.**BMC Bioinformatics. 2012 Jun 25; 13 Suppl 10:S14. Epub 2012 Jun 25.* - Algorithms for genome-scale phylogenetics using gene tree parsimony.[IEEE/ACM Trans Comput Biol Bioinform. 2013]
*Bansal MS, Eulenstein O.**IEEE/ACM Trans Comput Biol Bioinform. 2013 Jul-Aug; 10(4):939-56.* - Models, algorithms and programs for phylogeny reconciliation.[Brief Bioinform. 2011]
*Doyon JP, Ranwez V, Daubin V, Berry V.**Brief Bioinform. 2011 Sep; 12(5):392-400.* - Computational approaches to unveiling ancient genome duplications.[Nat Rev Genet. 2004]
*Van de Peer Y.**Nat Rev Genet. 2004 Oct; 5(10):752-63.*

- Polytomy refinement for the correction of dubious duplications in gene trees[Bioinformatics. 2014]
*Lafond M, Chauve C, Dondi R, El-Mabrouk N.**Bioinformatics. 2014 Sep 1; 30(17)i519-i526* - Gene tree correction guided by orthology[BMC Bioinformatics. ]
*Lafond M, Semeria M, Swenson KM, Tannier E, El-Mabrouk N.**BMC Bioinformatics. 14(Suppl 15)S5*

- MedGenMedGenRelated information in MedGen
- PubMedPubMedPubMed citations for these articles
- TaxonomyTaxonomyRelated taxonomy entry
- Taxonomy TreeTaxonomy Tree

- Efficient error correction algorithms for gene tree reconciliation based on dupl...Efficient error correction algorithms for gene tree reconciliation based on duplication, duplication and loss, and deep coalescenceBMC Bioinformatics. 2012; 13(Suppl 10)S11PMC

Your browsing activity is empty.

Activity recording is turned off.

See more...