- Journal List
- Bioinformatics
- PMC2832820

# Correcting population stratification in genetic association studies using a phylogenetic approach

^{1,}

^{*}Muredach P. Reilly,

^{2}Daniel J. Rader,

^{2}and Li-San Wang

^{3,}

^{4,}

^{5,}

^{*}

^{1}Department of Biostatistics and Epidemiology,

^{2}Cardiovascular Institute,

^{3}Department of Pathology and Laboratory Medicine,

^{4}Penn Center for Bioinformatics and

^{5}Institute on Aging, University of Pennsylvania School of Medicine, Philadelphia, PA 19104, USA

## Abstract

**Motivation:** The rapid development of genotyping technology and extensive cataloguing of single nucleotide polymorphisms (SNPs) across the human genome have made genetic association studies the mainstream for gene mapping of complex human diseases. For many diseases, the most practical approach is the population-based design with unrelated individuals. Although having the advantages of easier sample collection and greater power than family-based designs, unrecognized population stratification in the study samples can lead to both false-positive and false-negative findings and might obscure the true association signals if not appropriately corrected.

**Methods:** We report PHYLOSTRAT, a new method that corrects for population stratification by combining phylogeny constructed from SNP genotypes and principal coordinates from multi-dimensional scaling (MDS) analysis. This hybrid approach efficiently captures both discrete and admixed population structures.

**Results:** By extensive simulations, the analysis of a synthetic genome-wide association dataset created using data from the Human Genome Diversity Project, and the analysis of a lactase-height dataset, we show that our method can correct for population stratification more efficiently than several existing population stratification correction methods, including EIGENSTRAT, a hybrid approach based on MDS and clustering, and STRATSCORE , in terms of requiring fewer random SNPs for inference of population structure. By combining the flexibility and hierarchical nature of phylogenetic trees with the advantage of representing admixture using MDS, our hybrid approach can capture the complex population structures in human populations effectively.

**Software Availability:** Codes can be downloaded from http://people.pcbi.upenn.edu/~lswang/phylostrat/

**Contact:** ude.nnepu@oaygnim; ude.nnepu@gnawsi.

**Supplementary information:** Supplementary data are available at *Bioinformatics* online.

## 1 INTRODUCTION

The rapid development of genotyping technology and extensive cataloguing of single nucleotide polymorphisms (SNPs) across the human genome have made genetic association studies the mainstream for gene mapping of complex human diseases. For many diseases, the most practical approach is the population-based design with unrelated individuals. Although having the advantages of easier sample collection and greater power than family-based designs, population-based design is prone to population stratification (Marchini *et al.*, 2004). Population stratification refers to the presence of a systematic difference in allele frequencies between subpopulations in a study due to ancestry difference between study subjects. Unrecognized population stratification can lead to both false-positive and false-negative findings and can obscure the true association signals if not appropriately corrected.

There are three types of population structures that might be observed in genetic association studies: *discrete population structure* consists of populations that are remotely related (such as Europeans, Africans and Asians) and the population structure is easy to discern as the individuals are clearly separated. *Admixed population structure* consists of subjects of admixed ancestry (such as African Americans and Hispanic Americans) with different individuals having different degrees of admixture, and that cannot be separated into discrete clusters. Intercontinental gradients can also be considered as admixed, although the degree of admixture is smaller than African Americans and Hispanic Americans. In other scenarios, we may see *hierarchical population structure* that consists of both discrete and admixed population structures. Hierarchical population structures may be seen in studies that involve multi-ethnic cohorts, which are becoming increasingly common in genetics consortiums (Serre *et al.*, 2008).

Recognizing the issue of population stratification induced by population structures, various methods have been developed to control for population stratification. Two early approaches are genomic control (Devlin and Roeder, 1999) and structured association (Pritchard *et al.*, 2000). The genomic control method corrects for stratification by adjusting association statistics with an overall inflation factor obtained from a set of random markers that are not associated with the phenotypes of interest. However, some markers differ in their allele frequencies across ancestral populations more than others. Thus, the uniform adjustment may be insufficient at markers having strong differentiation across ancestral populations and may be superfluous at markers lacking such differentiation. Structured association uses STRUCTURE program (Pritchard and Rosenberg, 1999) to assign the study subjects to discrete subpopulations and then aggregates evidence of association within each subpopulation. This method is computationally intensive, and assignments of subjects to clusters are sensitive to the number of clusters, which is often ill defined in many real studies.

The current state-of-the-art approach for the correction of population stratification is EIGENSTRAT (Price *et al.*, 2006), which computes principal components for SNPs across the genome to identify population structure. In this approach, a small number of ‘top’ principal components will capture the main axes of genetic variation in the study subjects. Correction for population stratification is carried out by including these top principal components as covariates in a regression framework. Although popular, several studies have demonstrated that EIGENSTRAT will fail to correct for population stratification in certain scenarios (Epstein *et al.*, 2007; Kimmel *et al.*, 2007; Luca *et al.*, 2008).

Recently, Li and Yu (2008) proposed an extension of EIGENSTRAT by incorporating cluster information obtained from multi-dimensional scaling (MDS) analysis as additional covariates in the adjustment. This MDS clustering approach tries to identify both discrete and admixed patterns of genetic variation and correct for their potential confounding effects by adjusting each position of subject along identified axes of genetic variation and the cluster membership simultaneously. This method is a direct extension of EIGENSTRAT when the metric used by EIGENSTRAT is adopted for measuring the genetic correlation between two subjects. Simulation results demonstrate that the MDS clustering method provides a more appropriate correction for population stratification than EIGENSTRAT under simulation settings that they considered (Li and Yu, 2008).

The goal of this article is to utilize phylogenetic trees to correct for population stratification in genetic association studies with unrelated individuals. Widely used in the study of evolution and other fields of biology, a phylogeny represents the evolutionary relationship between species as a tree structure, where each leaf is an observed species, each internal node corresponds to the most recent common ancestors of all species below it and each internal edge represents a bipartition of leaves due to evolutionary divergence. The use of phylogenetics in the study of human genetic diversity has a long history dating back to the sixties: the approach was first proposed by Cavalli-Sforza and Edwards (1967) who developed likelihood estimation methods using allelic frequencies in subpopulations. Distance measures that adjust allelic frequencies are also available (Goldstein *et al.*, 1995; Nei, 1972). The phylogenetic approach has been used extensively in the analysis of the Human Genome Diversity Project (HGDP) (http://www.stanford.edu/group/morrinst/hgdp.html), which genotyped more than 1000 individuals collected at more than 50 geographic locations around the world. The HGDP dataset has well-defined subpopulations and complete population identification. The resulting phylogenies, using microsatellites and SNPs, have been highly consistent and compatible with the widely accepted pattern of human migration (Jakobsson *et al.*, 2008; Li *et al.*, 2008; Rosenberg *et al.*, 2002).

We propose a phylogenetics-based approach for correction of population stratification based on several motivations. First, widely used and thoroughly tested for decades to study evolution, phylogenetics is a natural choice for detecting divergence in human subpopulations. Phylogenetic analysis of the HGDP dataset shows that this approach is robust and sensitive to subtle population structures (Jakobsson *et al.*, 2008; Li *et al.*, 2008). Second, thanks to decades of work by an active research community, many phylogenetic reconstruction algorithms have been developed, and efficient and versatile programs are widely available. Third, the hierarchical characteristic of a phylogeny is easy to interpret and visualize. Finally, phylogenetic trees are more flexible to represent highly complex spatial structures than clusters obtained from clustering-based algorithms (Li and Yu, 2008).

To correct for discrete, admixed and hierarchical population structures, we propose to combine information from phylogeny and MDS together with the phylogenetic tree representing discrete population structure and the principal coordinates of MDS analysis representing admixed population structure. Given the flexible nature and the hierarchical characteristic of phylogenetic trees, we expect this hybrid approach to perform well under complex population structures, such as those from multi-ethnic studies with some of the study samples showing admixed population structure, whereas other study samples showing discrete population structure (Serre *et al.*, 2008).

## 2 METHODS

### 2.1 Construction of a phylogenetic tree

The first step in our method is to construct a phylogenetic tree of subjects from the genetic marker data. We opt to use the distance-based approach, which accepts as input a distance matrix, i.e. the pairwise dissimilarities between every pair of individuals based on SNP genotypes and constructs trees entirely from the distance matrix (Saitou and Nei, 1987; Studier and Keppler, 1988). In our analysis, we code the SNP genotypes as 0, 1 and 2, representing the number of minor alleles, and calculate the distance as ‘2—the number of alleles that are identical by state’ between two individuals. We then built the phylogenetic tree using the FastME algorithm (Desper and Gascuel, 2002), a very fast distance-based phylogeny reconstruction algorithm that shows better topological accuracy than the commonly used neighbor joining algorithm (Saitou and Nei, 1987) in simulation studies. Compared with other more computationally intensive methods such as maximum likelihood or maximum parsimony, the distance-based approach is much more tractable, especially when the number of individuals or the number of markers becomes large. Note that the leaves of the constructed phylogenetic tree are individual subjects in the study sample instead of subpopulations.

### 2.2 Reduced representation for the phylogenetic tree

We reduce the phylogenetic structure into a collection of bipartitions on subjects in order for us to incorporate information from the phylogeny in the association tests as covariates in a regression framework. Each bipartition corresponds to an internal edge in a phylogenetic tree, which divides the data into two groups: a phylogenetic tree with *n* leaves (subjects) will have up to *n*−3 internal edges; in turn, the entire phylogenetic tree can be fully recovered by these (*n*−3) bipartitions. For each bipartition, we can construct a 0-1 vector indicating the bipartition membership by assigning all members from one of the two subsets in a bipartition to have value 0, and all members from the other set to have value 1. We cannot use all of the bipartitions in the regression analysis, because (i) the degrees of freedom in the regression is close to the number of observations (subjects) and significance will never be reached; (ii) most bipartitions, in particular, bipartitions that separate a very small number of subjects from the rest, are not informative for the purpose of population stratification correction; and (iii) the bipartitions are not entirely independent; for example, bipartitions for adjacent edges may only differ by a small number of subjects. We select a subset of representative bipartitions based on the following criteria:

- The relative size of either side of a selected bipartition is above some given threshold. We used 2.5% in our analysis.
- Filter bipartitions by the correlation threshold so that each remaining bipartition is correlated with at least one selected bipartition. We used 0.7 as the correlation threshold for discrete population structures, and 0.1 for admixed population structures in the simulation studies. For the analysis of the HGDP data and the lactase-height data, we also used 0.7 as the threshold. We discuss the selection of correlation threshold in Section 4.

The bipartition selection problem can be formulated as the NP-hard minimum dominating set problem in graph theory as follows (Garey and Johnson, 1979): let *G*=(*V*, *E*) be a graph where each vertex in the vertex set *V* corresponds to a bipartition passing the size threshold. We add an edge between any two vertices (*u*, *v*) to the edge set *E* if the absolute value of the correlation between bipartitions associated with *u* and *v* is above the threshold. The *minimum dominating set* problem finds a smallest set of vertices *V*′*V* such that for every vertex *u**V*′−*V*, there exists a vertex *v* in *V*′ such that (*u*, *v*)*E*. Our problem can then be solved by finding such a minimum dominating set for *G*; then every bipartition is correlated with at least one bipartition associated with a vertex in the dominating set. To select bipartitions, we implemented a simple approximation algorithm [where the size of the solution is at most 1 + ln the size of the optimal solution (Garey and Johnson, 1979)] by iteratively (i) selecting a vertex with largest degree and add to the cover, then (ii) removing all adjacent vertices and their incident edges from the graph. The selection step is repeated until all vertices are removed. Figure 1 illustrates the bipartition selection procedure.

### 2.3 MDS analysis

MDS is a statistical technique that aims at displaying the similarity of members of a set of objects. This technique starts with a matrix of similarities or dissimilarities between a set of observations, and embeds the observations as points in a low-dimensional Euclidean space so that Euclidean distances between points in the plot are close to the original dissimilarities. Suppose that **T** is a (*n* × *n*) positive-semidefinite symmetric matrix of similarities among a set of *n* observations. From the spectral decomposition of **T**, we have

where τ_{1}≥τ_{2}≥…≥τ_{n} are the eigen values of **T** and **b**_{1}, **b**_{2},…, **b**_{n} are the corresponding eigen vectors. Alternatively, this may be written as

where *c*_{j}=τ_{j}^{1/2}**b**_{j}, *j*=1, 2,…, *n*. Now consider the *n* observations as points in *n* dimensional space with the *j*-th coordinate for the *i*-th observation equal to *c*_{ij}, the *i*-th element of *c*_{j}. With this geometric interpretation of the *n* observations, the Euclidean distance between the *h*-th and *i*-th observations is

MDS analysis attempts to find the optional *q* dimensional (*q*<*n*) approximation to the *n* dimensional representation so that the distance is preserved.

### 2.4 Association test with adjustment of phylogenetic bipartitions and principal coordinates from MDS analysis

The phylogenetic bipartitions can effectively capture the population structure information in a dataset when the structure is discrete or hierarchical. On the other hand, some of the populations, such as admixed populations, may contain continuous patterns of genetic variation. To incorporate both types of population structures, similar to MDS clustering, a hybrid approach proposed by Li and Yu (2008), we adjust for the population structure by the phylogenetic bipartitions and the principal coordinates from MDS analysis. This is done by representing the population structure as a collection of selected bipartitions and principal coordinates from the MDS analysis and introducing them together with the genotypes of the SNP as independent variables, and the binary phenotype as the dependent variable in a regression framework. To test for genetic association for case–control studies, we conduct logistic regression with the following model:

where *Y* represents disease status (1: affected; 0: unaffected), Ψ represents the selected phylogenetic bipartitions, Γ represents the selected principal coordinates from the MDS analysis, ** X** represents a set of random markers that are used for inference of population structure and

*g*is the genotype score for the testing SNP, with (0, 1, 2) for a multiplicative model, (0, 1, 1) for a dominant model and (0, 0, 1) for a recessive model. To test for association between the SNP and the disease status, either a likelihood ratio test, a score test, or a Wald test can be carried out. For continuous phenotypes, we can conduct linear regression with similar adjustments. We note that principal components analysis (PCA) can be used instead of MDS and the computation for PCA is faster than similarity matrix. We choose to use MDS because the similarity matrix is already calculated when constructing the phylogenetic tree; moreover, the results of MDS and PCA are generally similar.

Note that the selected phylogenetic bipartitions and principal coordinates might be correlated because both of them represent population structure in the data, although with emphasis on different types of variation. To avoid the issue of multi-collinearity, when the correlation between a phylogenetic bipartition and a principal coordinate is greater than 0.7, we will keep only the principal coordinate in the regression model. It is worth noting that multi-collinearity is also a concern for the MDS clustering approach. Similar to what we did for PHYLOSTRAT, when testing the MDS clustering method by Li and Yu (2008), we also used 0.7 as the correlation cut-off point to remove a correlated cluster dummy variable.

### 2.5 Simulation set up

We conducted extensive simulations under various settings to compare the performance of PHYLOSTRAT with four other methods, including the standard Cochran–Armitage trend test without corrections (Armitage, 1955), the EIGENSTRAT approach (Price *et al.*, 2006), the MDS clustering approach (Li and Yu, 2008) and the STRATSCORE approach (Epstein *et al.*, 2007). We designed three sets of simulations, one for discrete population structures, one for admixed populations and the other based on genotype data from the HGDP samples (Li *et al.*, 2008). In all scenarios, we coded the genotype score for the testing SNP assuming a multiplicative model. In the four methods we tested, either top 10 principal components (EIGENSTRAT and STRATSCORE) or top 10 principal coordinates (MDS clustering and PHYLOSTRAT) were included in the analysis.

*Setting 1*: Discrete population structures were simulated in a similar method as Price *et al.* (2006) and Li and Yu (2008). We considered six configurations (Table 1), representing two, three and four subpopulations. In each setting, we generated simulated datasets each consisting of 500 cases and 500 controls, with varying numbers of random SNPs carrying information capable of differentiating among populations. To generate genotypes for the random SNPs, we followed the algorithm of Price *et al.* (2006). Specifically, for each subpopulation, the allele frequency for each SNP was generated using the Balding–Nichols model (Balding and Nichols, 1995) using *F*_{ST}=0.01. For each SNP, an ancestral population allele frequency *p* was drawn from the uniform distribution on (0.1, 0.9). The allele frequencies for each subpopulation were drawn from β-distribution with parameters *p*(1 − *F*_{ST})/*F*_{ST} and (1 − *p*)(1 − *F*_{ST})/*F*_{ST}. This distribution has mean *p* and variance *F*_{ST}*p*(1 − *p*).

To evaluate the performance of different population stratification correction methods, we considered four categories of testing SNPs: (i) the first category (random SNPs without association with disease) was generated the same way as those SNPs chosen for detecting population structure, i.e. *F*_{ST}=0.01. (ii) For the second category (differentiated SNPs without association with disease), we assumed a large allele frequency difference between the subpopulations. More specifically, for C1 and C2, we chose allele frequencies of 0.2 for population 1 and 0.8 for population 2; for C3 and C4, the allele frequencies are 0.8, 0.8 and 0.2, respectively, for the three subpopulations; and for C5 and C6, the allele frequencies are 0.2, 0.8, 0.2 and 0.8, respectively, for the four subpopulations. (iii) The third category of SNPs (random causal SNPs with association with disease) was for power evaluation in which the allele frequency was generated the same way as those random SNPs, i.e. *F*_{ST}=0.01; we then assumed a multiplicative model with a genotype relative risk of 1.5 for the causal allele to generate genotypes for the causal SNPs conditioned on the disease status. (iv) The fourth category of SNPs (differentiated causal SNPs with association with disease) was generated in a similar fashion as category (iii) except that the marker allele frequency was generated the same way as those from category (ii). Testing SNPs in categories (i) and (ii) allow us to evaluate type I error rates of different methods, whereas testing SNPs in categories (iii) and (iv) allow us to evaluate the power when modest or extreme population stratifications are present.

To evaluate the type I error and power under each population structure, we generated 100 datasets of 500 cases and 500 controls with each dataset consisting of 1000 testing SNPs for each of the above-mentioned four SNP categories. Moreover, for each of the 100 datasets, we also simulated *m*=100, 300 or 500 random SNPs with *F*_{ST}=0.01 to infer population structure. Type I error and power were estimated based on 100 (datasets) × 1000 (testing SNPs) = 100 000 tests.

*Setting 2*: Cases and controls from an admixed population were simulated similar to that as described by Price *et al.* (2006). Disease status for individuals with ancestry proportions *a* from population 1 and (1 − *a*) from population 2 were simulated using disease risk proportional to *r*^{a}, where *r* is the ancestry risk and *a* is uniformly distributed on (0, 1). To insure an average value of 0.5 across possible values of *a*, the probability of being affected was set to 0.5 log(*r*)*r*^{a}/(*r* − 1). The risk model with a genotype relative risk of 1.5 for the disease allele was implemented the same way as discrete populations, with allele frequency *ap*_{1} + (1 − *a*)*p*_{2}. Similar to the simulations for discrete populations, we also considered two categories of SNPs to evaluate the type I errors and two categories of SNPs to evaluate the power.

*Setting 3*: A case–control dataset of hierarchical population structure was simulated based on individuals genotyped in HGDP (Li *et al.*, 2008), an international project for studying the diversity and unity of the entire human population. A total of 1064 individuals in this project, representing individuals from 51 populations from sub-Saharan Africa, North Africa, Europe, the Middle East, South/Central Asia, East Asia, Oceania and the Americas, were genotyped by the Illumina HumanHap 650K SNP array, which includes 650 000 SNPs. We downloaded the genotype data and sample description information from http://hagsc.org/hgdp/files.html.

After merging genotype data and sample description and data cleaning, 995 individuals remained for analysis. To obtain case–control data with population structure, we created three artificial subpopulations: (i) subpopulation 1 consists of 107 individuals from Africa, (ii) subpopulation 2 consists of 170 individuals from Middle East and 153 individuals from Europe; and (iii) subpopulation 3 consists of 107 individuals from America, 192 individuals from Central South Asia, 232 individuals from East Asia and 34 individuals from Oceania. For each of the three subpopulations, we selected cases and controls based on the numbers specified in Table 2. To infer population structure, we randomly selected 10 000 autosomal SNPs that have no missing genotypes and are in linkage equilibrium with each other (at *r*^{2} < 0.05). We then tested for association with the case–control status using 515 710 autosomal SNPs that satisfy the following quality control criteria: (i) minor allele frequency >1% in both cases and controls, (ii) Hardy–Weinberg equilibrium test *P*-value >1 × 10^{−7} and (iii) fraction of missingness <5%. For each method, we estimated the type I error rate at various levels (α = 0.01, 0.005, 0.001 and 0.0005 level) and calculated the genomic control inflation factor (Devlin and Roeder, 1999).

### 2.6 Application to lactase-height data

A classic way to test the performance of a population stratification correction method is to examine whether the method is able to remove the effect of population stratification between the lactase (*LCT*) gene and height (Campbell *et al.*, 2005). As we do not have access to the original data reported by Campbell *et al.* (2005), we created a lactase-height dataset using data from PennCAC, an ongoing candidate-gene study on coronary artery classification that we are working on. PennCAC includes 1361 Caucasians with phenotypes on height. These individuals were genotyped using the ITMAT/Broad/CARe (IBC) 50K SNP array (Keating *et al.*, 2008), which includes 1755 autosomal ancestry informative markers (AIMs) and 21 *LCT* SNPs. The originally reported *LCT* SNP, rs4988235, is not included in the IBC array, but two other *LCT* SNPs, rs3769005 and rs7579771, have strong LD with rs4988235 (*r*^{2} = 0.72 in HapMap CEU samples). We, therefore, tested association between height and these two SNPs. For all population stratification correction methods that we considered for comparison, we inferred population structure using 100, 200, 250, 300, 500, 700, 1000 and 1755 autosomal AIMs.

## 3 RESULTS

To evaluate our proposed method, we carried out extensive simulations, including discrete population structure, admixed population structure and a synthetic case–control GWAS dataset generated from the HGDP data, which represents hierarchical population structure. We assessed whether the proposed method can appropriately correct for population stratification by estimating type I error rate, and also assessed its power in detecting disease association. We compared PHYLOSTRAT with four other methods, including (i) the conventional Cochran–Armitage trend test (Armitage, 1955), which does not control for population stratification, (ii) the EIGENSTRAT approach (Price *et al.*, 2006), (iii) the MDS clustering approach (Li and Yu, 2008); and (iv) the STRATSCORE approach (Epstein *et al.*, 2007). For STRATSCORE, as suggested by the authors (Dr Michael Epstein, personal communication), we adjusted the continuous stratification scores (obtained from principal components) rather than the quartiles of the stratification scores because this modified version of STRATSCORE generally leads to smaller type I errors than the original method under the simulation settings we considered. We did not compare with the genomic control approach because Price *et al.* (2006) and Li and Yu (2008) have demonstrated its unsatisfactory performance. For type I error and power estimation, significance was evaluated at the 1% level.

### 3.1 Setting 1: discrete population structure

Tables 3–4 display the results for discrete population structures with two and four subpopulations, respectively. Results for three subpopulations are similar (Supplementary Table 1). In all situations we considered, PHYLOSTRAT has type I error rates that are close to the nominal level. The MDS clustering approach performs well when there are two discrete subpopulations; but when the number of discrete subpopulations is three or four and the population stratification is extreme, its type I error rates can be greater than the nominal level, especially when the number of random SNPs is small. For example, when there are four discrete subpopulations and when the degree of population stratification is extreme (i.e. configuration C6 in Table 4), the type I error rate of the MDS clustering approach can be as high as 10.19% with 100 random SNPs, 2.06% with 300 random SNPs, even with 500 random SNPs, the type I error rate is still slightly inflated. Similar results are observed for EIGENSTRAT, which also yields inflated type I errors. In contrast, for this extreme situation, the type I error rate of PHYLOSTRAT is close to the nominal level even with only 100 random SNPs, much less than the number of random SNPs required by other methods to achieve the same level of type I error rate. This implies that PHYLOSTRAT uses the ancestry information contained in the random SNPs more efficiently. We observed that STRATSCORE can yield either inflated or conservative type I errors. As suggested by the authors (Dr Glen Satten, personal communication), we also implemented a modified version of STRATSCORE with 20 strata. This modified version yields appropriate type I errors when there are two underlying subpopulations; however, when the number of subpopulations is greater than 2, e.g. configurations C4 and C6, the type I errors are still inflated even with 500 random SNPs. It is possible that more strata are needed to appropriately control the type I errors when the number of subpopulations is more than two and the degree of population stratification is extreme.

For causal SNPs in category (iii), PHYLOSTRAT, MDS clustering and EIGENSTRAT yield similar power, but the power for STRATSCORE is generally lower than the other three methods. For causal SNPs in category (iv), PHYLOSTRAT is more powerful than the other three methods under several settings. For example, for configuration C6 in Table 4, with 300 random SNPs, the power for PHYLOSTRAT is 51.27%, whereas the powers for EIGENSTRAT, MDS clustering and STRATSCORE are 39.06, 39.49 and 20.77%, respectively. This is because EIGENSTRAT and MDS clustering cannot completely remove the confounding effect due to population stratification, which obscures the true association signal, whereas STRATSCORE has conservative type I error rate. For causal SNPs in category (iv), we observed noticeable power change for each method as the number of random SNPs, *m*, increases, and such power change is also due to difference in ability to remove the confounding effect of population stratification.

### 3.2 Setting 2: admixed population structure

Table 5 shows the results for admixed populations. We observed similar patterns for PHYLOSTRAT, MDS clustering, EIGENSTRAT and STRATSCORE. All these methods yield type I error rates that are close to the nominal level with STRATSCORE being slightly conservative. The power for detecting causal SNPs is similar for all methods.

### 3.3 Setting 3: HGDP data

We applied our method to a dataset of 955 individuals from the HGDP data genotyped on the Illumina HumanHap 650 SNP array (Li *et al.*, 2008). To simulate a dataset with population structure, we artificially created three populations (Table 2). The phylogenetic tree built from 10 000 randomly selected autosomal SNPs is shown in Figure 2. With the same 10 000 random SNPs, we also conducted MDS analysis and plotted the first two principal coordinates (Supplementary Fig. 1). As shown in both figures, this synthetic GWAS dataset contains both discrete and admixed population structures. The genomic control inflation factor for unadjusted trend test with 515 710 autosomal SNPs is 17.3, indicating strong population stratification in the data. Such a complex population structure poses a challenge to genetic association analysis, but also offers an opportunity to evaluate various methods.

We analyzed the 515 710 autosomal SNPs using EIGENSTRAT, MDS clustering, STRATSCORE and PHYLOSTRAT, and then estimated type I error rate for each method based on the 515 710 tests as none of the SNPs are associated with case–control status by design. At α = 0.01 significance level, the type I error rates of EIGENSTRAT, MDS clustering, STRATSCORE and PHYLOSTRAT are 0.0428, 0.0290, 0.0373 and 0.0232, respectively; when α = 0.001, the type I error rates of the four methods are 0.0087, 0.0047, 0.0067 and 0.0016, respectively; when α = 0.0005, the corresponding type I error rates are 0.0054, 0.0026, 0.0039 and 0.00048, respectively. We also estimated the genomic control inflation factor for each of the four methods: 1.66 for EIGENSTRAT, 1.45 for MDS clustering, 1.59 for STRATSCORE and 1.35 for PHYLOSTRAT. We also investigated the performance of these three methods with larger number of random SNPs (*m* = 30 000, 50 000 and 70 000), and obtained similar results. As the continent information is known for each individual, one might consider controlling population stratification by adjusting continent; however, the genomic control inflation factor for this simple approach is 2.67, much higher than the other three methods, suggesting that simply adjusting for continent is not sufficient. We also explored a hybrid approach by adjusting MDS principal coordinates and continent; the genomic control inflation factor for this approach is 1.45, similar to that of MDS clustering. Although none of the methods we considered completely corrected for population stratification for this complex synthetic GWAS dataset, PHYLOSTRAT did show more encouraging result than the other methods.

### 3.4 Analysis of lactase-height data

Using the naïve Armitage trend test, we observed significant associations between the *LCT* SNPs and height after adjusting sex (rs3769005: *P*-value=1.8 × 10^{−6}; rs7579771: *P*-value=2.1 × 10^{−6}), suggesting the presence of population stratification. We then analyzed this dataset with various population stratification correction methods with different numbers of AIMs (Table 6). We adjusted sex in all analyses.

Our results indicate that PHYLOSTRAT performs favorably against the other methods. For example, with 250 AIMs, among the four methods we considered for comparison, only PHYLOSTRAT yields *P*-values >0.05 for both SNPs; whereas the other three methods require more AIMs to remove the effect of population stratification. Our results are consistent with Price *et al.* (2006) and Epstein *et al.* (2007), who also observed that EIGENSTRAT cannot completely resolve the confounding issue between *LCT* and height when only a small number of AIMs were used in the analysis.

## 4 DISCUSSION

We have developed a new method to correct for population stratification in genetic association analysis by combining information obtained from phylogenetic trees and MDS analysis. Our method represents relations between individual's genetic background using a set of phylogenetic bipartitions and principal coordinates from MDS analysis, and incorporates them as covariates in a regression framework to adjust for the confounding effect due to hidden population stratification.

As shown in our simulations, this hybrid approach effectively captures both discrete and admixed population structures. It yields a more appropriate correction for population stratification than EIGENSTRAT (Price *et al.*, 2006), MDS clustering (Li and Yu, 2008) and STRATSCORE (Epstein *et al.*, 2007) under discrete population structures; its performance is similar to these three approaches under admixed population structures. To evaluate the performance of our method when the population structure is hierarchical, we applied our method to the HGDP dataset, which contains real genetic variation patterns. Although none of the methods could completely remove the confounding effect of population stratification, PHYLOSTRAT performs favorably against the other methods and yields type I error rates that are closer to the nominal level. To test the performance of our method in real genetic association studies, we applied our method to a lactase-height dataset and found that PHYLOSTRAT is able to correct for population stratification with only 250 AIMs, smaller than the number of AIMs required by the other methods. Our results suggest that phylogenetics is a robust and useful tool for inferring complex population structures, and appropriate utilization of information captured by phylogenetics trees can help correct for population stratification in genetic association analysis, especially when the number of random SNPs is small.

We note that as the number of random SNPs used for inference of population structure increases (e.g. when *m* = 50 000), the type I errors of PHYLOSTRAT, EIGENSTRAT and MDS clustering are all close to the nominal level under simulation settings we considered, but the type I errors of STRATSCORE are conservative with the patterns similar to those seen in Tables 3–4 and Supplementary Table 1. These results suggest that when only a small number of random SNPs are available, one might consider using PHYLOSTRAT to control for population stratification, but when the number of random SNPs is large, EIGENSTRAT would be a preferable approach as it is computationally faster. It is worth noting that the bipartitions obtained from the phylogenetics tree can be used together with principal components as basis functions to build the stratification scores (Dr Glen Satten, personal communication), and such a modified version may improve the performance of STRATSCORE.

Our method shares similarity with another hybrid approach MDS clustering (Li and Yu, 2008) in that both methods use the principal coordinates from the MDS analysis to capture admixed population structure. To capture discrete population structure, the MDS clustering method assigns each individual a group membership based on clustering of the MDS principal coordinates, where the number of clusters is determined by the gap statistic (Tibshirani *et al.*, 2001). However, the problem of estimating the number of clusters can be difficult, because in many situations there is no clear definition of a ‘cluster’. Moreover, for data that are not clearly separated into groups, e.g. when there are overlapping classes, determining the number of distinct clusters can be highly subjective. In contrast, the use of phylogenies in our method circumvents this problem because our method does not require such parameter to be predefined. It is worth noting that clustering is a degenerate or a simplified version of phylogenetic tree. Unlike clustering, which can only handle simple population structures, phylogenetic trees are suitable for handling more complex, hierarchical population structures as demonstrated in our analysis of the HGDP data.

Compared with existing methods for population stratification correction, our method has two distinct advantages. First, the phylogenetic approach allows better interpretation and visualization of the population structure in the study sample, especially when the data contain a hierarchical structure. Many tools have been developed for molecular phylogenetic studies since the fifties, and it will be an important research direction to find how these methods can be applied for the population stratification problem. Second, as shown in our simulations and the analysis of the lactase-height data, our method requires fewer markers to infer population structure than other existing methods; therefore our method is ideal for candidate gene studies or replication study of GWAS, in which a large number of random SNPs may not be available. Although we considered a small number of random SNPs in our simulations, our method can be applied to GWAS as demonstrated by the analysis of the HGDP dataset.

Our method has to make a decision on how a set of bipartitions is selected without losing too much information for subsequent association analysis. If the population has a small number of subpopulations, most bipartitions will be similar to one of the bipartitions selected by our bipartition reduction algorithm. Having too many bipartitions retained in the stratification correction procedure will introduce many partially correlated covariates in logistic regression, and can have an adverse effect on the numerical regression procedure; on the contrary, over-reduction of bipartitions may lead to loss of important information on the population structure. Both scenarios can hurt the performance of our algorithm. In our analysis, we tried various thresholds for bipartition selection. We found that using 2.5% as the threshold for the number of leaves and 0.7 as the threshold for the correlation coefficient generally leads to stable results for discrete population structures, and the corresponding thresholds are 2.5% and 0.1 for admixed population structures. In general, we recommend the users to try multiple sets of thresholds and select the threshold that gives the smallest genomic control inflation factor. We recognize that there are other methods such as bootstrapping that can reduce bipartitions in the phylogeny (Felsenstein, 1985); however, we expect these methods are very sensitive to any leaves (individuals) in the tree that cannot be properly placed, which we expect to happen very often in human genetic data. What methods best reduce correlated bipartitions and how the bipartition reduction step affects the stratification correction is an important future research direction.

For PHYLOSTRAT, the running time is dominated by the pairwise distance computation as FastME is a very fast algorithm with sub-quadratic asymptotic running time in practice. Because pairwise distance computation is more time-consuming than PCA-based approaches, the running time of PHYLOSTRAT is longer than EIGENSTRAT and STRATSCORE. For example, for a dataset consisting of 500 cases and 500 controls with 500 random SNPs and 1000 testing SNPs, using an Intel Xeon CPU (2.66 GHz, 8 GB RAM, linux), it took 9 s for EIGENTRAT, 14 s for STRATSCORE, 19 s for PHYLOSTRAT and 40 s for MDS clustering. However, given that high-performance and low-cost computational capabilities are easily accessible, the required computing time for pairwise distance matrix calculation in PHYLOSTRAT would be a small overhead. One possible approach to reduce the running time is to limit the number of markers by LD pruning. Our experience with the analysis of the HGDP data and several other GWAS datasets suggests that this approach generally works well in GWAS.

In summary, we have proposed a new method that combines information from phylogenetic tree and MDS together. Given the flexible nature and the hierarchical characteristic, this hybrid approach is expected to perform well under complex population structures. We expect our method will provide a useful tool in the analysis of both candidate gene and GWAS studies.

## ACKNOWLEDGEMENTS

We thank Drs Michael Epstein, Glen Satten, Maja Bucan, Junhyong Kim and the late Richard Spielman for discussions. We also thank three anonymous reviewers for their helpful comments that greatly improved the manuscript.

*Funding*: Penn Genomics Frontier Institute (an internal grant to M.L. and L.-S.W.). National Institutes of Health (grant R01HG004517 to M.L.).

*Conflict of Interest*: none declared.

## REFERENCES

- Armitage P. Tests for linear trends in proportions and frequencies. Biometrics. 1955;11:375–386.
- Balding DJ, Nichols RA. A method for quantifying differentiation between populations at multi-allelic loci and its implications for investigating identity and paternity. Genetica. 1995;96:3–12. [PubMed]
- Campbell CD, et al. Demonstrating stratification in an European American population. Nat. Genet. 2005;37:868–872. [PubMed]
- Cavalli-Sforza LL, Edwards A.WF. Phylogenetic analysis: models and estimation procedures. Am. J. Hum. Genet. 1967;19:233–257. [PMC free article] [PubMed]
- Desper R, Gascuel O. Fast and accurate phylogeny reconstruction algorithms based on the minimum-evolution principle. J. Comput. Biol. 2002;19:687–705. [PubMed]
- Devlin B, Roeder K. Genomic control for association studies. Biometrics. 1999;55:997–1004. [PubMed]
- Epstein MP, et al. A simple and improved correction for population stratification in case-control studies. Am. J. Hum. Genet. 2007;80:921–930. [PMC free article] [PubMed]
- Felsenstein J. Confidence limits on phylogenies: an approach using the bootstrap. Evolution. 1985;39:783–791.
- Garey MR, Johnson DS. Computers and Intractability: A Guide to the Theory of NP-Completeness. New York, NY, USA: WH Freeman; 1979. p. 190.
- Goldstein DB, et al. An evaluation of genetic distances for use with microsatellite loci. Genetics. 1995;139:463–471. [PMC free article] [PubMed]
- Jakobsson M, et al. Genotype, haplotype and copy-number variation in worldwide human populations. Nature. 2008;451:998–1002. [PubMed]
- Keating BJ, et al. Concept, design and implementation of a cardiovascular gene-centric 50K SNP array for large-scale genomic association studies. PLoS ONE. 2008;3:e3583. [PMC free article] [PubMed]
- Kimmel G, et al. A randomization test for controlling population stratification in whole-genome association studies. Am. J. Hum. Genet. 2007;81:895–905. [PMC free article] [PubMed]
- Li Q, Yu K. Improved correction for population stratification in genome-wide association studies by identifying hidden population structures. Genet. Epid. 2008;32:215–226. [PubMed]
- Li JZ, et al. Worldwide human relationships inferred from genome-wide patterns of variation. Science. 2008;319:1100–1104. [PubMed]
- Luca D, et al. On the use of general control samples for genome-wide association studies: genetic matching highlights causal variants. Am. J. Hum. Genet. 2008;82:453–463. [PMC free article] [PubMed]
- Marchini J, et al. The effects of human population structure on large genetic association studies. Nat. Genet. 2004;36:512–517. [PubMed]
- Nei M. Genetic distance between populations. Am. Naturalist. 1972;106:283–292.
- Price AL, et al. Principal components analysis corrects for stratification in genome-wide association studies. Nat. Genet. 2006;38:904–909. [PubMed]
- Pritchard JK, Rosenberg NA. Use of unlinked genetic markers to detect population stratification in association studies. Am. J. Hum. Genet. 1999;65:220–228. [PMC free article] [PubMed]
- Pritchard JK, et al. Association mapping in structured populations. Am. J. Hum. Genet. 2000;67:170–181. [PMC free article] [PubMed]
- Rosenberg NA, et al. Genetic structure of human populations. Science. 2002;298:2381–2385. [PubMed]
- Saitou N, Nei M. The neighbor-joining method: a new method for reconstructing phylogenetic trees. Mol. Biol. Evol. 1987;4:406–425. [PubMed]
- Serre D, et al. Correction of population stratification in large multi-ethnic association studies. PLoS ONE. 2008;1:e1382. [PMC free article] [PubMed]
- Studier JA, Keppler KL. A note on the neighbor-joining algorithm of Saitou and Nei. Mol. Biol. Evol. 1988;5:729–731. [PubMed]
- Tibshirani R, et al. Estimating the number of clusters in a data set via the gap statistic. J. R. Stat. Soc. B. 2001;63:411–423.

**Oxford University Press**

## Formats:

- Article |
- PubReader |
- ePub (beta) |
- PDF (233K) |
- Citation

- Correction for population stratification in random forest analysis.[Int J Epidemiol. 2012]
*Zhao Y, Chen F, Zhai R, Lin X, Wang Z, Su L, Christiani DC.**Int J Epidemiol. 2012 Dec; 41(6):1798-806. Epub 2012 Nov 12.* - Population stratification and spurious allelic association.[Lancet. 2003]
*Cardon LR, Palmer LJ.**Lancet. 2003 Feb 15; 361(9357):598-604.* - Improved correction for population stratification in genome-wide association studies by identifying hidden population structures.[Genet Epidemiol. 2008]
*Li Q, Yu K.**Genet Epidemiol. 2008 Apr; 32(3):215-26.* - Interrogating local population structure for fine mapping in genome-wide association studies.[Bioinformatics. 2010]
*Qin H, Morris N, Kang SJ, Li M, Tayo B, Lyon H, Hirschhorn J, Cooper RS, Zhu X.**Bioinformatics. 2010 Dec 1; 26(23):2961-8. Epub 2010 Sep 30.* - [Genome-wide association study on complex diseases: genetic statistical issues].[Yi Chuan. 2008]
*Yan WL.**Yi Chuan. 2008 May; 30(5):543-9.*

- Increasing the power of association studies with affected families, unrelated cases and controls[Frontiers in Genetics. ]
*Stewart WC, Cerise J.**Frontiers in Genetics. 4200* - Special considerations in prognostic research in cancer involving genetic polymorphisms[BMC Medicine. ]
*Savas S, Liu G, Xu W.**BMC Medicine. 11149* - Diagnostic tools for hypertension and salt sensitivity testing[Current opinion in nephrology and hypertens...]
*Felder RA, White MJ, Williams SM, Jose PA.**Current opinion in nephrology and hypertension. 2013 Jan; 22(1)65-76* - Sparse Principal Component Analysis for Identifying Ancestry-Informative Markers in Genome Wide Association Studies[Genetic epidemiology. 2012]
*Lee S, Epstein MP, Duncan R, Lin X.**Genetic epidemiology. 2012 May; 36(4)293-302* - Correction for population stratification in random forest analysis[International Journal of Epidemiology. 2012...]
*Zhao Y, Chen F, Zhai R, Lin X, Wang Z, Su L, Christiani DC.**International Journal of Epidemiology. 2012 Dec; 41(6)1798-1806*

- PubMedPubMedPubMed citations for these articles

- Correcting population stratification in genetic association studies using a phyl...Correcting population stratification in genetic association studies using a phylogenetic approachBioinformatics. 2010 Mar 15; 26(6)798

Your browsing activity is empty.

Activity recording is turned off.

See more...