![]() | ![]() |
Formats:
|
||||||||||||||||||||||||||||||||
Copyright © 2009 Ogbuanu et al; licensee BioMed Central Ltd. Can we apply the Mendelian randomization methodology without considering epigenetic effects? 1Department of Epidemiology and Biostatistics, Norman J Arnold School of Public Health, University of South Carolina, USA Corresponding author.Ikechukwu U Ogbuanu: dr_iyke/at/yahoo.com; Hongmei Zhang: hzhang/at/mailbox.sc.edu; Wilfried Karmaus: karmaus/at/mailbox.sc.edu Received February 21, 2008; Accepted May 11, 2009. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited. This article has been cited by other articles in PMC.Abstract Introduction Instrumental variable (IV) methods have been used in econometrics for several decades now, but have only recently been introduced into the epidemiologic research frameworks. Similarly, Mendelian randomization studies, which use the IV methodology for analysis and inference in epidemiology, were introduced into the epidemiologist's toolbox only in the last decade. Analysis Mendelian randomization studies using instrumental variables (IVs) have the potential to avoid some of the limitations of observational epidemiology (confounding, reverse causality, regression dilution bias) for making causal inferences. Certain limitations of randomized controlled trials, such as problems with generalizability, feasibility and ethics for some exposures, and high costs, also make the use of Mendelian randomization in observational studies attractive. Unlike conventional randomized controlled trials (RCTs), Mendelian randomization studies can be conducted in a representative sample without imposing any exclusion criteria or requiring volunteers to be amenable to random treatment allocation. Within the last decade, epigenetics has gained recognition as an independent field of study, and appears to be the new direction for future research into the genetics of complex diseases. Although previous articles have addressed some of the limitations of Mendelian randomization (such as the lack of suitable genetic variants, unreliable associations, population stratification, linkage disequilibrium (LD), pleiotropy, developmental canalization, the need for large sample sizes and some potential problems with binary outcomes), none has directly characterized the impact of epigenetics on Mendelian randomization. The possibility of epigenetic effects (non-Mendelian, heritable changes in gene expression not accompanied by alterations in DNA sequence) could alter the core instrumental variable assumptions of Mendelian randomization. This paper applies conceptual considerations, algebraic derivations and data simulations to question the appropriateness of Mendelian randomization methods when epigenetic modifications are present. Conclusion Given an inheritance of gene expression from parents, Mendelian randomization studies not only need to assume a random distribution of alleles in the offspring, but also a random distribution of epigenetic changes (e.g. gene expression) at conception, in order for the core assumptions of the Mendelian randomization methodology to remain valid. As an increasing number of epidemiologists employ Mendelian randomization methods in their research, caution is therefore needed in drawing conclusions from these studies if these assumptions are not met. Introduction The use of genotypes that affect modifiable risk factors to make causal inferences falls under the umbrella of Mendelian Randomization (MR) studies [1,2]. Instrumental variable (IV) methods – the statistical methods that underlie such inferences – have been widely used in econometrics, but not in epidemiology [1,3]. Mendelian randomization refers to the random assortment of alleles inherited by offspring from their parents at conception [4,5]. This random assortment of inherited alleles has been likened to a randomized clinical trial (RCT), in which the research subjects are randomly allocated to different genotypes rather than to medical interventions [4]. Mendelian randomization studies include any study that uses genetic variation as a robust proxy for a potential disease risk (which cannot be assessed without biases) for the purpose of making causal inferences about the outcomes of the modifiable exposure [1]. To date, the potential impact of epigenetics on the core assumptions that underlie the use of genes as instrumental variables has not been addressed. This paper opens up this inquiry by assessing the appropriateness of the use of Mendelian randomization as an instrumental variable in the presence of epigenetic modifications of gene expression, and cautions investigators to, at the least, recognize the existence of these limitations. We will delineate the major rationale and the core assumptions of the Mendelian randomization methodology, explore the current understanding of epigenetics, and discuss the methodological challenges that arise from the use of genotypes as instrumental variables for modifiable exposures when epigenetic modifications of gene expression are present. The goal of this paper is to emphasize that effect sizes will be biased when the presence of epigenetic phenomena violate the implicit fundamental assumptions in Mendelian randomization studies (and are not compensated for in the analytic models). We will illustrate the occurrence of the epigenetic bias both algebraically and with a data simulation. What is currently known Mendelian randomization and its shortfalls Mendelian randomization studies exploit the idea that the genotype only affects the disease status indirectly and is assigned randomly at meiosis, independent of measured and unmeasured (or measured-with-error) confounders [1,5]. These properties define an instrumental variable (IV), which is a variable associated with the outcome only through its robust association with an intermediary variable – the exposure of interest [1]. If the levels but not the function of a potential disease risk factor is determined by a genetic polymorphism, then the levels of the risk factor will effectively be assumed to have been randomly assigned at conception. This 'randomization' will potentially obviate the effect of confounding in the test of genotype-disease associations [6]. In order to illustrate the principles of Mendelian randomization, we will use a familiar methodological concept that is well-recognized in randomized controlled trials – the intention-to-treat concept, due to the similarity between the two concepts (i.e. indirect effect and randomized allocation). Randomized controlled trials (RCTs) currently provide the best evidence for potentially therapeutic or prophylactic interventions. RCTs use intention-to-treat (ITT) analysis to assess therapeutic effects [7]. ITT analyses assess allocated treatment as the predictor of outcome, and are assumed to be unconfounded because of randomization, irrespective of compliance, adherence and contamination [4,8]. Thus, the ITT effect is the effect of allocating a treatment rather than the biologic effect of received treatment (Figure (Figure1)1 Core Assumptions Implied in Mendelian Randomization Studies In order to understand the bias introduced by epigenetic modifications of gene expression, the underlying statistical assumptions in MR studies are outlined next. For this and subsequent sections, let the causal effect of X (intermediate phenotype) on Y be the relationship of primary interest, and let G (genotype) be the variable we want to use as the instrumental variable (IV). Also, let U be an unobservable variable that confounds the effect of X on Y. A. G is independent of the confounding factors U that confound the association of X and the outcome Y. This assumption accrues from the random allocation of alleles at conception. Any event that alters this allocation could lead to nullification of this assumption (Figure (Figure2A2A
B. The instrumental variable G is associated with the exposure of interest X (i.e. must not be (marginally) independent of X). The stronger this association, the "better" an instrument G is, providing more information on the causal association between X and Y (small standard errors and narrow confidence intervals) [5]. It is important to state at this point that G does not need to be causal for X, i.e. to be useful as an IV, G does not have to be the "right" gene. The association could instead be due to a mediator variable or through another unobserved variable that affects both G and X [5]. This may occur in situations where there is linkage disequilibrium (LD) between G (G1) and another genotype (G2) (Figure (Figure2B2B C. Conditional on X and U, the instrument and the response are independent. There are several methodological advantages of MR studies. Unlike conventional RCTs, MR studies can be conducted in a representative sample without imposing any exclusion criteria or requiring volunteers to be amenable to random treatment allocation [1]. Secondly, "randomization" in MR studies occurs at conception while RCT studies randomize patients in adulthood. This minimizes biases due to canalization and developmental adaptation [2,4]. Mendelian randomization studies may also counteract some key shortcomings of randomized controlled trials (RCTs), such as high cost, unfeasibility with some exposures, and problems with generalizeability [1,4]. Previous studies have addressed some of the key potential shortfalls of MR studies [2,4,10-14]. These include the paucity of suitable genetic variants, unreliable (genetic) associations, genetic confounding by population stratification, linkage disequilibrium (LD), pleiotropy, functional genomic confounding due to developmental canalization and gene imprinting, the need for large sample sizes and some potential problems with binary outcomes [1]. Other factors that may adversely impact MR studies include selective survival, gene-covariate (environment) interactions and gene-gene interactions. In addition to these potential shortfalls is the potentially distorting effect of epigenetics. This "epigenetic bias" is the focus of this paper. What is Epigenetics? Classical Mendelian inheritance of traits from parents to offspring follows the DNA pairing and transmission patterns as illustrated by the Watson-Crick model of DNA. However, there is an emerging consensus among experts in genetic epidemiology that DNA is not the sole unit of heredity and that genotype and environment are not the only determinants of phenotype [15]. A growing body of evidence suggests that the impact of environmental influences may extend beyond the DNA sequence [16]. The emerging field of epigenetics studies heritable changes in gene expression that occur without directly altering the DNA sequence [17]. Thus, epigenetics is dedicated to the study of non-Mendelian (meiotically and mitotically), heritable changes in gene expression not accompanied by a change in genotype/DNA sequences [14,18-20]. These changes generally involve DNA modification (without change in nucleotide sequence), histone protein modifications, and regulation of gene expression by microRNAs. MicroRNAs (miRNAs) are small (approximately 22 nucleotides long) RNA molecules that may be involved in post-transcriptional control of gene expression [21]. These regulatory mechanisms specify which regions of the genome are active in any given cell at any one time [16,20]. The cells of eukaryotic organisms contain an additional level of information superimposed on the DNA double helix, a nucleoprotein entity known as "chromatin". This "DNA packaging" (or "epigenome") has recently been implicated in the regulation of the complex interactions of the enzymatic processes of replication, transcription, recombination, and DNA repair [16]. The molecular mechanisms of epigenetic modifications include DNA methylation and chromatin structure and histone modifications [19]. Acetylation, methylation, phosphorylation, and ubiquitylation are implicated in activation; while methylation, ubiquitylation, sumoylation, deimination and proline isomerization are involved in gene repression [18]. However, depending on the location, any given modification is capable of either activation or repression [18]. While acetylation and phosphorylation are thought to be responsible for short-term reversible changes in gene expression, methylation is generally more stable and involved in the long term maintenance of expression status [19]. Inherited changes in the "epigenome" have been postulated as a possible pathway explaining the differences in gene expression seen in individuals with identical "genomes" [22]. A major difference between genetic and epigenetic outcomes is that, while DNA sequence is static, the epigenome is dynamic and changes with cell type, during the cell cycle, in response to biologic signals, and with the environment [16]. Epigenetic effects have been shown to occur not just in utero, but over the life course [14]. Certain features of complex diseases that have defied classical Mendelian genetics may be explained, at least in part, by the inheritability, partial stability and reversibility of epigenetic regulation. Gluckman et al. recently proposed that maternally-mediated changes in gene expression may be more relevant in elucidating the etiology of disease in the offspring than the inheritance pattern of the genetic code [23]. In agreement with a possible epigenetic inheritance pattern, a recent study in mice showed that experimentally-induced contact dermatitis in the mother prior to conception resulted in an increased asthma incidence in the offspring [24]. Further strengthening this evidence in humans, Li et al. demonstrated that grandmaternal smoking was associated with an increased risk of asthma in grandchildren, independent of maternal smoking status, suggesting a transmission of epigenetic effects inherited from the grandmother to the grandchild [25]. Analysis Statistical Implications Using the RCT analogy for explaining Mendelian randomization in epidemiology, the random allocation G affects the outcome (Y) only through received treatment (X), whereas receipt of treatment may be confounded by other variables – known and unknown confounders (U). In the presence of complete blinding, the relation between G and X (i.e. between allocated genotype and intermediate phenotype), βXG, is such that G has the same effect on X regardless of compliance; and X has the same effect on Y regardless of the confounding factors (Figure (Figure1).1
Although a more complicated model is possible, to illustrate the IV approach we assume linear relationships among G, X, and Y (i.e. "a one-unit change in G is estimated to result in a β increase in X, and this increase in X in turn is estimated to cause a further increase of βIV in Y, which, multiplied together, gives the total βITT increase from G to Y" [4]). Following core assumptions A, B, and C (as stated above), Figure Figure33
In equations (1) and (3), both βYU1 and βYU2 denote the effect of U on Y. The effect of U is likely to be different when evaluating the contribution of U and G to Y (equation (1)) and the contribution of U and X to Y (equation (3)). Thus, we use different coefficients (βYU1 and βYU2) to denote the effects under these two situations. Since U and X are correlated and U is not observable, it is not possible to directly estimate βIV. However, since U and G are independent, regressing X on G will provide an estimate of βXG even though U can not be observed. Using the same argument, we can obtain an estimate of βITT by regressing Y on G. Applying some algebra to the above three equations, specifically by first substituting equation (2) for X in equation (3), and then comparing the effect of G in equation (1) and equation (3), we have:
which leads to
Note that in the above derivation, the intercepts are not related to the relationship between βITT, βXG, and βIV. From Figure Figure3,3 In Mendelian randomization studies, βIV would be equivalent to the effect of the intermediate phenotype on the outcome (disease) and βITT to the (direct) genetic effect on disease, while the denominator in equation (5) would capture the observed, or presumed, relation between genetic allocation, G, and its gene product, the intermediate phenotype X [4]. The Impact of Epigenetics on Mendelian Randomization Inherited epigenetic effects may alter the ideal gene → "gene product" association discussed above (i.e. in the situation when Mendelian randomization is applicable). From Figure Figure33
We use E(X)' to denote the expected gene expression when there is possible gene-environment interaction. Here "E × G" denotes the interaction between the environmental factor E and the genotype G. βEG measures the strength of the interaction and is assumed to be non-zero. We now show that the environmental factor at the maternal level changes the relationship stated in equation (5). If a subject is not exposed, (E = 0; i.e. no interaction effect), equation 2' is exactly the same as equation 2. In the same vein, the relationship between βITT, βXG, and βIV remains as given by equation (5). However, if a subject is exposed to the environmental factor E (i.e. there is an interaction effect), then E = 1. From equation 2', we have
Let βXG* = βXG+ βEG. βXG* may be greater or less than βXG depending on the predominant mechanism (activation vs. repression, for instance). Note that βXG* includes the regular effect of G on X in addition to the effect of gene-environmental interaction that altered the gene expression of the mother's gene. This gene-environment interaction by definition is the epigenetic effect only if it is heritable. As indicated in Figure Figure4,4 Further, we use βIV' to denote the effect of gene expression under this assumption, and thus equation (3) becomes:
Applying the same algebra as before to equations (1), (3'), and (6), we have:
which gives βIV' = βITT/(βXG+ βEG) = βITT/βXG*, where βXG* = βXG+ βEG. This new relationship does not agree with that given by equation (5), which is derived based on the MR assumptions. The additional effect (βEG) is what we have termed the "epigenetic bias." It is noteworthy that a gene-environment interaction in parents may lead to an epigenetic effect only when it is inherited by the offspring. Certain gene-environment interactions (in ancestral parents) are thought to be mediated through molecular changes in the epigenome. The non-random nature [18] of such alterations may necessitate caution in the interpretation of the estimates from the Mendelian randomization (instrumental variable) analyses. In recognition of the presence of this "epigenetic bias," Bjornsson et al. have suggested that including epigenotypes in models of disease causation might act as a surrogate of parental environmental exposure and thus increase the power of epidemiological studies [20]. Figure Figure55
Further illustrating conceptually with the randomized clinical trial (RCT) analogy, if an RCT is blinded, intention-to-treat (ITT) cannot be influenced by external factors such as motivation or education (non-differential compliance). However, in a non-blinded trial, participants in the control or treatment arm may choose to alter treatment or compliance (differential compliance, see Figure Figure1).1 Data Simulation Example We use simulations to illustrate our findings given in Analysis section. The goal of this simulation is to demonstrate the bias in the estimates of the β coefficients if epigenetic effects transmitted from mother to child are ignored. For this simulation, we assume that a mother smoked in adolescence, stopped smoking as an adult, and then conceived the index study child. Thus, non-epigenetic effects of tobacco smoke exposure in utero did not occur. However, gene expression (epigenetic) changes in the mother prior to the index pregnancy were inherited by the child as discussed in Analysis section. To demonstrate the scenario outlined in Table 1, we assume that we have 10,000 pregnant mothers resulting in 10,000 mother-infant pairs (see attached SAS data and program in additional file 1). For simplicity, we focus on one (asthma) gene (IL13 gene) and one single nucleotide polymorphism (SNP) with three possible genotypes (CC, CG and GG). Our simulated data are generated based on the following data scenario:
1) Of 10,000 mothers in the simulated data, 30.5% (n = 3,050) smoked in adolescence, while 69.5% (n = 6,950) did not. 2) The genotypes of mothers who smoked in adolescence and of those who did not were distributed at random: 7.2% of the never-smoking mothers had the GG genotype compared to 9.8% of ex-smoking mothers; 41.7% of never-smoking mothers had the CG genotype compared to 39.3% in ex-smoking mothers; and about 51% in both groups were CC. These percentages were selected using the probabilities that each genotype will be present in a mother. 3) We also assumed that the gene × smoking (G × E) interaction resulted in changes in gene expression in the mother that were inherited by the offspring, leading to asthma manifestation in the offspring. 4) The inheritance of gene expression is assumed to be complete and therefore G and X at the maternal level are consistent with the G and X at the child's level; also paternal genes were assumed not to play any role. 5) Next, we assumed that smoking among the offspring varied with history of maternal smoking: 36.1% of the offspring whose mother smoked in adolescence also smoked, while only 28.2% of the offspring whose mother never smoked also smoked. The overall smoking prevalence for both groups of children was 30.6%. These percentage values were generated from a normal distribution with mean 0.30 and standard deviation 0.10. 6) The data were also simulated such that there was altered gene expression in 25% of the children of ex-smoking mothers compared to 7.4% of the children with never-smoking mothers. 7) Next, 3.6% of the children with ex-smoking mothers had childhood asthma, compared to 1.4% of the children with never-smoking mothers. These percentages were derived from the assumed probabilities of asthma depending on smoking exposure. 8) This simplification is to enable demonstration of the epigenetic effect illustrated in Figure Figure5.5 As outlined, β's were derived for the following associations: (1) the effect of the genetic polymorphism on outcome Y (in this case, asthma) estimating βITT; (2) the effect of the genetic polymorphism on X (in this case, gene expression) estimating βXG* (3) the effect of X (gene expression) on Y (asthma) estimating βIV' The significance level was selected as α = 0.05. If we ignore the inherited altered gene expression due to maternal smoking in adolescence, we will find a statistically significant crude effect of the CC-genotype on the gene expression (βXG* = 0.367, p-value = 0.0001). However, this effect actually includes contributions from both the CC-genotype and from the gene-smoking interaction (G × E interaction) in the mother leading to an epigenetic effect. The contribution from each of these two can be estimated by including a "gene by smoking" interaction term in the model. Inclusion of this term showed a significant gene-smoking interaction effect (βEG = 0.269, p-value= 0.015). Regarding the outcome, asthma (Y), we found a statistically significant effect of the CC-genotype (βITT = 0.458, p-value < 0.0012). The above observations imply two important cautionary findings. Firstly, this data simulation demonstrates that the gene effect, even if randomly distributed on the exposure, may be overestimated when the gene × "maternal smoking in adolescence" interaction is ignored. Secondly, we show in this scenario that when the epigenetic effect is ignored, a significant epigenetic effect (gene × smoking interaction) tends to violate the core assumptions of Mendelian randomization. This interaction results in variations in gene-expression and subsequently in increased or reduced risk of the outcome (i.e. an epigenetic effect) Hence, βIV' = βITT/(βXG+ βEG) = βITT/βXG* as demonstrated earlier, but βIV' is not equal to βITT/βXG as given by equation (4). This is due to the inclusion of gene-smoking interaction, which causes βXG* to deviate from βXG. As seen in our example, βITT = 0.458, βXG* = 0.367, and βXG = 0.215, so we have βIV' = 0.458/0.367 = 1.248 while βIV = 0.458/0.215 = 2.130. This implies a tendency for βIV' and βIVto differ systematically, if evaluated from a study where the gene by "prior maternal smoking" interaction is not taken into account. We refer to this bias as the "epigenetic bias". Conclusion As an increasing number of epidemiologic researchers employ Mendelian randomization in their research, the impact of epigenetics on the core assumptions that drive the use of genotypes as instrumental variables deserves attention. Our work demonstrates that epigenetic bias may distort the effects detected in MR studies. It is important to differentiate between gene-environment interactions that affect MR studies in the same generation, and epigenetic effects inherited through subsequent generations and that may invalidate MR studies in the second or third generation. Additional tools, such as molecular methods to assess the level of DNA and histone modifications may soon be widely available. Future research in the field of Mendelian randomization needs to collect information on epigenetic changes (e.g. gene expression) of the various genes tested. These additional data would enable adjustment for "epigenetic bias" as described in this paper. Such tools may make it possible to apply certain "correction factors" or to stratify future analyses by "methylation status" (or "expression status"), in the assessment of gene effect [20]. Until such a time, caution is needed in the interpretation of Mendelian randomization studies. Abbreviations LD: Linkage Disequilibrium; DNA: deoxyribonucleic acid; MR: Mendelian Randomization; RCT: randomized controlled trial; ITT: Intention to treat analysis; IV: instrumental variable. Competing interests The authors declare that they have no competing interests. Authors' contributions This paper originated from an epidemiology doctoral class project taught by WK at the University of South Carolina. IUO and WK originated the study idea. IUO wrote the article while WK provided guidance and reviewed initial drafts of the article. HZ offered biostatistical oversight. All authors read and approved the final draft of the manuscript for submission. Additional File 1 ogbuanu data. ogbuanu data simulation program for table 1 Click here for file(5.3K, sas) Acknowledgements Sources of Funding: This study was funded in part by the National Institutes of Health R01 AI061471. References
|
PubMed related articles
Your browsing activity is empty. Activity recording is turned off. |
|||||||||||||||||||||||||||||||
Stat Med. 2008 Apr 15; 27(8):1133-63.
[Stat Med. 2008]Int J Epidemiol. 2003 Feb; 32(1):1-22.
[Int J Epidemiol. 2003]Int J Epidemiol. 2000 Aug; 29(4):722-9.
[Int J Epidemiol. 2000]Am J Epidemiol. 2006 Mar 1; 163(5):397-403.
[Am J Epidemiol. 2006]Stat Methods Med Res. 2007 Aug; 16(4):309-30.
[Stat Methods Med Res. 2007]Stat Med. 2008 Apr 15; 27(8):1133-63.
[Stat Med. 2008]Stat Methods Med Res. 2007 Aug; 16(4):309-30.
[Stat Methods Med Res. 2007]Int J Epidemiol. 2006 Aug; 35(4):935-43.
[Int J Epidemiol. 2006]Epidemiol Rev. 2002; 24(1):26-38.
[Epidemiol Rev. 2002]Am J Epidemiol. 2006 Mar 1; 163(5):397-403.
[Am J Epidemiol. 2006]Epidemiol Rev. 2002; 24(1):85-90.
[Epidemiol Rev. 2002]Stat Methods Med Res. 2007 Aug; 16(4):309-30.
[Stat Methods Med Res. 2007]QJM. 2004 Mar; 97(3):163-6.
[QJM. 2004]Am J Epidemiol. 2006 Mar 1; 163(5):397-403.
[Am J Epidemiol. 2006]Stat Med. 2008 Apr 15; 27(8):1133-63.
[Stat Med. 2008]Stat Methods Med Res. 2007 Aug; 16(4):309-30.
[Stat Methods Med Res. 2007]Stat Methods Med Res. 2007 Aug; 16(4):309-30.
[Stat Methods Med Res. 2007]Stat Med. 2008 Apr 15; 27(8):1133-63.
[Stat Med. 2008]Int J Epidemiol. 2003 Feb; 32(1):1-22.
[Int J Epidemiol. 2003]Am J Epidemiol. 2006 Mar 1; 163(5):397-403.
[Am J Epidemiol. 2006]Int J Epidemiol. 2003 Feb; 32(1):1-22.
[Int J Epidemiol. 2003]Am J Epidemiol. 2006 Mar 1; 163(5):397-403.
[Am J Epidemiol. 2006]Am J Hum Genet. 1988 Oct; 43(4):520-6.
[Am J Hum Genet. 1988]Environ Health Perspect. 2006 Mar; 114(3):A160-7.
[Environ Health Perspect. 2006]Stat Med. 2008 Apr 15; 27(8):1133-63.
[Stat Med. 2008]Curr Biol. 2003 Jan 8; 13(1):R6.
[Curr Biol. 2003]Environ Health Perspect. 2006 Mar; 114(3):A140-1.
[Environ Health Perspect. 2006]Am J Respir Crit Care Med. 2008 Mar 15; 177(6):567-73.
[Am J Respir Crit Care Med. 2008]Environ Health Perspect. 2006 Mar; 114(3):A160-7.
[Environ Health Perspect. 2006]Pediatr Res. 2007 May; 61(5 Pt 2):1R-4R.
[Pediatr Res. 2007]Environ Health Perspect. 2006 Mar; 114(3):A140-1.
[Environ Health Perspect. 2006]Respir Res. 2006 Feb 6; 7():21.
[Respir Res. 2006]Pediatr Res. 2007 May; 61(5 Pt 2):1R-4R.
[Pediatr Res. 2007]N Engl J Med. 2007 Feb 15; 356(7):731-3.
[N Engl J Med. 2007]Environ Health Perspect. 2006 Mar; 114(3):A140-1.
[Environ Health Perspect. 2006]Environ Health Perspect. 2006 Mar; 114(3):A160-7.
[Environ Health Perspect. 2006]N Engl J Med. 2008 Jul 3; 359(1):61-73.
[N Engl J Med. 2008]Respir Res. 2007 Jul 27; 8():56.
[Respir Res. 2007]Chest. 2005 Apr; 127(4):1232-41.
[Chest. 2005]Int J Epidemiol. 2000 Aug; 29(4):722-9.
[Int J Epidemiol. 2000]Int J Epidemiol. 2002 Oct; 31(5):1030-7.
[Int J Epidemiol. 2002]Am J Epidemiol. 2006 Mar 1; 163(5):397-403.
[Am J Epidemiol. 2006]Am J Epidemiol. 2006 Mar 1; 163(5):397-403.
[Am J Epidemiol. 2006]Am J Epidemiol. 2006 Mar 1; 163(5):397-403.
[Am J Epidemiol. 2006]Stat Med. 2008 Apr 15; 27(8):1133-63.
[Stat Med. 2008]Am J Epidemiol. 2006 Mar 1; 163(5):397-403.
[Am J Epidemiol. 2006]Am J Epidemiol. 2006 Mar 1; 163(5):397-403.
[Am J Epidemiol. 2006]Pediatr Res. 2007 May; 61(5 Pt 2):1R-4R.
[Pediatr Res. 2007]Trends Genet. 2004 Aug; 20(8):350-8.
[Trends Genet. 2004]Chest. 2005 Apr; 127(4):1232-41.
[Chest. 2005]Respir Res. 2008 Jan 10; 9():2.
[Respir Res. 2008]Contemp Clin Trials. 2006 Jun; 27(3):227-37.
[Contemp Clin Trials. 2006]Trends Genet. 2004 Aug; 20(8):350-8.
[Trends Genet. 2004]