• We are sorry, but NCBI web applications do not support your browser and may not function properly. More information
Logo of bmcbioiBioMed Centralsearchsubmit a manuscriptregisterthis articleBMC Bioinformatics
BMC Bioinformatics. 2008; 9: 204.
Published online Apr 21, 2008. doi:  10.1186/1471-2105-9-204
PMCID: PMC2375907

Major copy proportion analysis of tumor samples using SNP arrays

Abstract

Background

Single nucleotide polymorphisms (SNPs) are the most common genetic variations in the human genome and are useful as genomic markers. Oligonucleotide SNP microarrays have been developed for high-throughput genotyping of up to 900,000 human SNPs and have been used widely in linkage and cancer genomics studies. We have previously used Hidden Markov Models (HMM) to analyze SNP array data for inferring copy numbers and loss-of-heterozygosity (LOH) from paired normal and tumor samples and unpaired tumor samples.

Results

We proposed and implemented major copy proportion (MCP) analysis of oligonucleotide SNP array data. A HMM was constructed to infer unobserved MCP states from observed allele-specific signals through emission and transition distributions. We used 10 K, 100 K and 250 K SNP array datasets to compare MCP analysis with LOH and copy number analysis, and showed that MCP performs better than LOH analysis for allelic-imbalanced chromosome regions and normal contaminated samples. The major and minor copy alleles can also be inferred from allelic-imbalanced regions by MCP analysis.

Conclusion

MCP extends tumor LOH analysis to allelic imbalance analysis and supplies complementary information to total copy numbers. MCP analysis of mixing normal and tumor samples suggests the utility of MCP analysis of normal-contaminated tumor samples. The described analysis and visualization methods are readily available in the user-friendly dChip software.

Background

A normal human cell has 23 pairs of chromosomes. For each of the autosomal chromosomes (1 to 22), there are two copies of homologous chromosomes inherited respectively from the father and mother of an individual. However, in a tumor cell, the copy number may be different from two at certain chromosomal regions due to deletion and amplification events. Loss of the contribution of one parent in selected chromosome regions can also happen due to hemizygous deletion or mitotic gene conversion (termed loss of heterozygosity or LOH). When such alterations affect tumor-suppressor genes (TSG) or oncogenes and confer growth advantage to cells, they will be selected in descendant cells and contribute to cancer formation [1]. Identifying such abnormal copy number and LOH regions in tumor samples may thus help to identify cancer-related genes and provide clues about cancer initiation or growth [2,3].

Single nucleotide polymorphisms (SNP) are the most common genetic variations in the human genome. Oligonucleotide SNP microarrays have been developed for high-throughput genotyping of up to 900,000 human SNPs [4,5]. They contain probe sequences complementary to the DNA sequences surrounding the interrogated SNPs. The genomic DNA is amplified, fragmented and labeled, and then hybridized to a SNP array. The scanned array images are analyzed to obtain the genotype calls of all the interrogated SNPs at a high accuracy (>99.3%) [6]. Compared with other experimental techniques, SNP arrays have high throughput and high marker resolution, and they require small amount of DNA per sample (250 ng). They have been utilized in linkage and association studies to identify disease genes [7,8] and in genomics studies to identify LOH and copy number alterations in cancer samples and copy number variation in normal samples [9-11].

The initial methods for analyzing cancer samples using SNP arrays perform copy number and LOH analysis separately [10,12], so each analysis yields genomic alteration information that another analysis may not provide. Recently, allele-specific and parent-specific copy numbers have been developed to utilize allele-specific signals obtained from SNP arrays [13-15]. Allele-specific copy numbers (ASCN) can be estimated from allelic signals at heterozygous SNPs. However, a pair of copy numbers is not straightforward to summarize across multiple samples into a single statistic indicating the excess of genomic alterations. In addition, Hidden Markov Models (HMM) that can successfully smooth total copy number or LOH do not work as efficiently on allele-specific copy numbers due to large number of ASCN states for a pair of copy numbers. In this paper, we defined major copy proportion as a quantity that contains the information difference between the total copy number and ASCN at a locus, and used a HMM algorithm to estimate it from allelic signals. We used 10 K, 100 K and 250 K SNP datasets to demonstrate the method performance and compare it to LOH and copy number analysis.

Results and Discussion

Definition of major copy proportion

The major copy proportion (MCP) of a SNP is defined as C2/(C1 + C2), where C1 and C2 are the parental copy numbers at this SNP in a sample and C1 ≤ C2. The value of MCP is between 0.5 and 1 by definition, with various values corresponding to different relative proportions of parental copy numbers. The MCP is 0.5 for normal loci or balanced copy alterations, 1 for LOH, and a value between 0.5 and 1 for allelic imbalanced copy number alterations. MCP therefore quantifies allelic imbalance and is a natural extension of LOH analysis. MCP and total copy number (C1 + C2) together provide the same amount of information as allele-specific copy numbers, while each of them is a scalar quantity that can be more efficiently estimated and conveniently used in downstream analysis.

We describe here two examples that can benefit from estimating MCP values. First, normal sample contamination in tumors often leads to conservative "No Call" genotypes and intervening LOH or retention calls (see below for specific examples). MCP can better quantify the proportion of normal sample contamination while still identify allelic-imbalanced regions due to LOH. Second, tumors with hyperploidy often contain allelic-imbalanced regions with both parental alleles kept. If the total copy number in such regions is close to the cell ploidy, copy number analysis will reveal a normal relative copy and LOH analysis will show retention. However ASCN or MCP analysis can discover allelic-imbalance as genomic alteration in such regions.

Hidden Markov Model for estimating MCP

SNP-based LOH or copy number data along a chromosome are locally correlated and HMM is an effective analytic method for such data structure. HMMs have been utilized to analyze array-based copy number changes [12,16-21] and to infer LOH from unpaired tumor samples [22]. Here we used a similar HMM for the MCP inference.

The normalized probe intensity values (Figure (Figure1)1) were used to compute allele-specific SNP signals and raw copy numbers (see "Methods"). We then used HMM to model the MCP correlation of neighboring SNPs on a chromosome. The MCP values to be inferred are between the range of 0.5 to 1 and have 11 states under the default increasing step of 0.05 (comparable to the noise level in our data). The observed data is the raw allele A proportion (RAP), defined as RA/(RA + RB), where RA and RB are the raw allelic copy numbers of the two genotype alleles (A and B) at a SNP. For a heterozygous SNP in a sample, RAP should vary by a certain noise level around the unobserved MCP (when A is the major copy allele) or 1 – MCP (when A is the minor copy allele); for a homozygous SNP, RAP is close to 1 for genotype AA and close to 0 for genotype BB, since one of RA and RB is close to 0. These considerations motivate the function form of the HMM emission distribution (see "Methods").

Figure 1
The probe level data of one SNP. (A) Left: The SNP has 20 probe pairs, whose normalized intensity values in one array are displayed and connected in blue (perfect match or PM) and gray (mismatch or MM) lines. The probe set has probe pairs for both A and ...

The HMM with emission and transition distributions specify the joint probability of the unobserved MCP and the observed RAP of all SNPs in a chromosome of a sample. The Viterbi algorithm [23] was then used to obtain the most probable MCP state path as the inferred MCP values. The procedure was run separately for all chromosomes and all samples in a dataset.

Datasets used

We used several SNP array datasets to illustrate the analysis and visualization methods and to compare the results. (1) 10 K SNP dataset. Zhao et al. [12,24] generated Early Access 10 K SNP array data for 14 breast and lung carcinoma cell lines and their paired normal cell lines, as well as 4 primary lung carcinomas and their paired normals. The array contains 10,043 SNPs with an average resolution of 300 kb. This work is one of the first demonstrations of combined copy number and LOH analysis using SNP arrays. (2) 100 K SNP dataset. Zhao et al. [25,26] generated 100 K SNP array data for 70 primary human lung carcinoma specimens and 31 cell lines derived from human lung carcinomas. 12 unpaired normal samples were used as reference in copy number analysis. The array contains 115,593 SNP with an average resolution of 24 kb. LaFramboise et al. [13] further analyzed this dataset to develop allele-specific copy number analysis and generated allele-specific quantitative PCR (Q-PCR) measurements for selected loci to compare allele-specific copy numbers from Q-PCR and SNP arrays. (3) 250 K cell line dataset. Affymetrix has made freely available a 500 K (consisting two 250 K SNP arrays) SNP dataset consisting of 9 tumor/normal pairs derived from breast and lung cancer cell line [27]. The average marker resolution is 5.8 kb and 85% of the human genome is within 10 kb of a SNP. In this work we used the subset of the 250 K STY array data. (4) 250 K lung tumor dataset. Weir et al. [28] generated 250 K STY SNP array data for 371 primary lung adenocarcinomas and 242 matched normal samples. We used a subset of 45 pairs of normal and tumor samples that are publicly available [29].

Visualizing MCP

The dChip software [30,31] was used to implement the methods and visualize the analysis results. Figure Figure22 compares the observed LOH view in dChip with the new MCP view using the chromosome 7 of the 10 K SNP dataset. In the MCP view (Figure (Figure2B),2B), different shades of gray correspond to MCP values greater than 0.5, highlighting allelic imbalanced regions. Comparing to the raw LOH calls on the left, MCP discovers more allelic-imbalanced regions that could cause excessive No Calls (sample H128t) or intervening LOH and retention calls (sample 57588T) in genotype-based LOH analysis.

Figure 2
The LOH and MCP data views of a chromosome. The tumor samples are displayed on columns and the SNPs are ordered on rows by their chromosome positions. (A) Observed LOH calls by comparing normal (N) and tumor (T) genotypes at the same SNP. Yellow: retention ...

In another example, we compared different SNP data views of a lung cancer cell line with paired normal (sample H1395 from the 10 K dataset). The most interesting region in chromosome 18 is indicated by braces in Figure Figure3.3. The tumor sample contains many No Call genotypes in this region (white colors in Figure Figure3C),3C), and the paired LOH analysis yields intervening retention, LOH and No Calls (Figure (Figure3A).3A). The raw copy numbers of this region center around ploidy or the relative copy number 2 (Figure (Figure3B).3B). The raw major allele proportion curve in Figure Figure3C3C reveals that most values are either close to 1 (corresponding to homozygous SNPs) or between 0.6 and 0.7. A likely explanation for these data is that this chromosome region has three copies and the whole genome is near triploid, which is confirmed by spectral karyotyping data [32]. Two copies of this region are from one parent and one copy is from another, creating underlying MCP of two thirds (0.67), close to the inferred MCP value of 0.65 (blue curve in Figure Figure3D).3D). Interestingly, the chromosome region below this region has retention of heterozygosity, a MCP of 0.5, but copy numbers below ploidy (indicated by arrow in Figure Figure3).3). This region most likely has one copy of each parental chromosome, creating copy number decrease from ploidy while retaining the heterozygosity.

Figure 3
The LOH, copy number, genotype and MCP data views of chromosome 18 of sample H1395t. (A) LOH from paired analysis, similar to Figure 2A. (B) Raw copy numbers. (C) Genotype calls. The red, yellow, blue and white colors represent genotype AA, AB, BB and ...

Therefore, genotype-based LOH analysis suggests the middle region in Figure Figure33 to be unusual, but the MCP analysis helps to pinpoint the underlying cause of the abnormality. The MCP result also reveals that the heterozygous SNPs in this region have real genotype AAB or ABB. The standard genotyping algorithm are trained by normal samples [6,33], thus making conservative No Call or incorrect AB or AA/BB call for these complex genotypes and leading to intervening LOH, retention or No Calls in genotype-based LOH analysis. Combining MCP and total copy number, we can thus obtain a more complete understanding of the genomic structure of tumor samples.

Comparing MCP and LOH

We then used 18 pairs of normal and tumor samples in the 10 K dataset to compare the paired LOH and MCP analysis. 14 of these pairs are normal and tumor cell line samples. SNPs were classified as LOH or retention SNPs based on paired LOH analysis (Figure (Figure2A)2A) and then compared with their MCP values. Figure Figure4A4A orders these tumor samples by their increasing sample-wise LOH rates (1.2% to 75%, curve 1). In all the samples, more than 90% LOH SNPs have MCP ≥ 0.6 (curve 2); in all but two samples, more than 80% LOH SNPs have MCP ≥ 0.9 (curve 3). The two samples 83437 and 57588 both have LOH rate below 20% and most of their LOH SNPs are in the intervening LOH and retention regions (the last two columns of Figure Figure2A).2A). MCP values between 0.6 and 0.9 correctly identified these regions as allelic imbalance rather than LOH. In fact, these two samples are primary tumor samples and could contain normal sample contamination [12], which likely cause most LOH areas in pure tumor cells to become allelic imbalance in the normal-contaminated tumor samples. In contrast to the LOH SNPs, the retention SNPs seldom have MCP value ≥ 0.9 in all the samples (curve 5), although in many samples more than 20% of the retention SNPs have MCP value ≥ 0.6 (curve 4). These regions often have copy number alterations that cause allelic imbalance but not LOH, leading to intervening retention and LOH calls (the last three columns of Figure Figure2A2A).

Figure 4
Comparing LOH and MCP from paired analysis. The samples are ordered on the X-axis by their sample LOH percentage from paired LOH analysis. (A) 10 K SNP data. (B) 250 K cell line data. (C) 250 K lung tumor data, where the sample names are omitted.

We also made similar comparison using the two 250 K datasets. Figure Figure4B4B shows the same percentages as Figure Figure4A4A for the 250 K cell line dataset of 9 sample pairs. All percentages have similar performance as the 10 K data. The percent of MCP ≥ 0.9 at paired LOH calls (curve 3) is low at the sample CRL-2338D. Inspecting the paired LOH calls in this sample reveals that most LOH in them are intervened with retention calls (Figure (Figure5A),5A), indicating allelic-imbalance rather than LOH. In contrast, the MCP analysis inferred smooth and moderate MCP values in this sample (Figure (Figure5B),5B), better discovering the underlying genomic alterations. Figure Figure4C4C shows the same comparison percentages for the 250 K lung primary tumor dataset of 45 sample pairs. All samples except one have paired LOH call percentage below 20% (curve 1). This can be due that the LOH events are at a lower frequency in these primary tumors or that the homozygous genotypes in LOH regions of tumor cells are masked by normal sample contamination up to 30% [28]. The portions of MCP ≥ 0.6 among paired LOH or retention calls both drop as paired LOH percentage drops (curve 2 and 4), while the portions of MCP ≥ 0.9 among paired LOH are near zero for all samples (curve 3, which overlays with curve 5), supporting the existence of normal sample contamination in most samples.

Figure 5
The LOH, MCP and copy number data of chromosome 1 of the 250 K cell line data. (A) The LOH calls from paired normal and tumor analysis. (B) The inferred MCP values. (C) The copy number of tumor samples is displayed in log2 ratio scale relative to the ...

In summary, MCP analysis is able to discover real LOH and retention events. It also discriminates allelic-imbalanced regions from LOH through intermediate MCP values between 0.5 and 1, instead of yielding intervening LOH and retention calls.

Comparing MCP and copy numbers

It is of interest in cancer research whether copy number gains or amplifications are allelic-balanced or imbalanced events, since the genes in the imbalanced events could have a variant or mutant form preferentially amplified [13]. SNP arrays have the advantage of providing both allelic-imbalance and copy number information. We have previously used the 10 K dataset to show that the LOH events can involve copy number deletion, copy-neutral or amplification events, while retention mostly occur at copy-neutral or amplification events [22]. With the inferred MCP as the extension of LOH calls, we now ask how allelic imbalanced events correlate with copy numbers. A visual comparison of LOH, MCP and copy number using the 250 K cell line dataset is in Figure Figure5.5. In the p-arm of sample CRL-2324D, LOH events correspond to both copy number amplifications and deletions.

We then stratified SNPs by copy number bins and computed the distribution of MCP values at various copy numbers. In the 10 K data (mostly cell lines, Figure Figure6A)6A) and the 250 K cell line data (Figure (Figure6B),6B), the copy numbers below 1.5 mostly correspond to MCP values ≥ 0.95 (LOH or extreme allelic imbalance). As copy number increases, the percent of "MCP ≥ 0.95" decreases while the percent of "MCP ≤ 0.6" (retention or near allelic balance) increases, indicating that larger copy number gains or amplifications involve less frequently with LOH and more frequently with allelic balanced and imbalanced events. In both 10 K and 250 K cell line data, there is a noticeable drop of allelic-balanced events ("MCP ≤ 0.6") around copy number of 3. The fact that 3 copies can have balanced amplifications is due to that the copy numbers from SNP arrays are not absolute copy numbers but relative to the ploidy of tumor cells (see "Methods"). Similarly, there are SNPs with MCP values close to 0.5 but copy number below 1, since in hyper-diploid samples the real copy number 2 has array-based relative copy number below 2. The peak at copy number 0.4 in Figure Figure6A6A is likely due to the small sample variation (4 of 39 data points at the copy bin 0.4 have MCP of 0.5) or inaccurately inferred MCP values.

Figure 6
Stratifying MCP according to copy numbers. The 5-SNP smoothed copy numbers were scaled to have mode at two copies for each sample, and then were binned into copy number intervals of a width of 0.2. For example, on the X-axis, 0 indicates the copy number ...

In contrast, different patterns emerge from the 250 K tumor dataset (Figure (Figure6C).6C). The percent of "MCP ≥ 0.95" is nearly zero at all copy numbers, and the portion of allelic-balanced events has a single peak around copy number of 2 and drops rapidly as copy number goes lower or higher. These could be explained by potentially prevalent normal sample contamination in these primary tumors, which could cause the attenuation of aberrant copy number values toward the normal copy of 2, as well as make the LOH or allelic-imbalanced amplification events in tumor cells to appear less allelic-imbalanced in contaminated tumor, leading to high percent of MCP values between 0.55 and 0.75.

Next we used the 100 K SNP array dataset with allele-specific copy numbers measured by quantitative PCR (Q-PCR) to compare the MCP based on SNP arrays and Q-PCR. We used the same SNPs to design the primers for Q-PCR and to obtain their array-based signals for comparison. Since Q-PCR measures allele-specific copy numbers rather than parent-specific copy numbers, we defined major allele proportion (MAP) as Max(A, B)/(A + B) and used it in the comparison, where A and B are Q-PCR or array-based allelic copy numbers. Table Table11 shows that most array-based MCP and the Q-PCR-based MAP values agree within a difference of 0.15 ("PCR MAP" and "Array MCP" columns). The largest difference of 0.44 (bold values in the table) occurs at SNP 589797 in sample S0515T. This SNP has homozygous genotype in the sample (both PCR and array-based MAP values are close to 1), but its multiple neighboring SNPs have heterozygous genotypes and MAP values close to 0.5 (data not shown), which contributes to the final inference of MCP 0.55 at the SNP 589797. Together with an amplified total copy number, we conclude that the DNA at the SNP is about equally amplified for both parental alleles.

Table 1
Comparison of MCP based on SNP arrays and major allele proportions (MAP, Max(A, B)./(A+B)) based on allele-specific Q-PCR or array-based allelic signals.

MCP analysis of normal contaminated samples

We next checked how well MCP can address two challenges of applying SNP arrays in cancer genomics: tumor samples frequently lack paired normal samples to perform paired LOH or MCP analysis, and tumor tissue samples often contain normal stromal cell contamination. The HMM emission distributions can flexibly use either paired normal genotypes in paired MCP analysis or population-based normal genotype distribution in tumor-only analysis (see "Methods"). We checked how well the MCP estimated using paired normal and tumor samples agree with the MCP estimated using only tumor samples. In the 10 K dataset, the sample-wise absolute MCP differences between the two methods in the 18 samples range from 0.0006 to 0.025, and the sample-wise standard deviations of the MCP differences range from 0.013 to 0.075. In the 250 K lung tumor dataset, these two differences measures are larger across the 45 tumors, ranging from 0.011 to 0.041 and 0.050 to 0.114 respectively. Visual inspection of the MCP inferred from the 250 K data reveals many small regions that have MCP value ≥ 0.5 in tumor-only analysis but have MCP value of 0.5 in paired analysis. They are caused by stretches of homozygous genotypes that are in linkage disequilibrium, in a similar way as the false positives in tumor-only LOH analysis [22]. By utilizing the genotype dependence of neighboring 5 SNPs in the HMM emission probabilities of tumor-only MCP analysis (see "Methods"), the two differences measures are smaller (ranges are 0.0001 – 0.026 and 0.008 – 0.097). Overall the differences between paired and tumor-only MCP inferences are fairly small compared to the values that MCP can take (0.5 to 1).

We next asked how much the tumor-only MCP method is tolerant to normal contamination. The 10 K dataset contains a mixing experiment of paired normal and tumor samples [12]. A tumor cell line (HCC38t) was mixed with its paired normal cell line (HCC38) at various proportions and then hybridized to 10 K SNP arrays. In Figure Figure7,7, sample HCC38M9 to HCC38M6 are mixture samples with tumor content of 90%, 80%, 70% and 60% respectively. The LOH regions in the pure tumor sample should become allelic-imbalanced regions in the mixture samples. Figure Figure77 shows a typical example of inferred LOH and MCP data using unpaired analysis (paired analysis for the column labeled with "HCC38t" in blue color). Compared to the LOH data (Figure (Figure7A),7A), MCP analysis better identified the boundaries of the allelic-imbalanced regions in all the mixture samples (Figure (Figure7B).7B). The values of estimated MCP for the LOH regions are less than 1 in the mixture samples (Figure (Figure7C),7C), corresponding to allelic-imbalance created by normal sample contamination. Interestingly, both LOH and MCP analysis performs better for the bottom LOH region than the top LOH region in the mixture samples, due to copy-neutral LOH in the bottom region and hemizygous deletion in the top region (copy number data not shown).

Figure 7
Comparing LOH and MCP using the 10 K mixing samples. The inferred LOH (A) and MCP (B, C) are displayed for chromosome 4. In the tumor-only LOH inference (the columns except column 1 in A), the inferred probability of LOH is displayed using a blue (1 – ...

Figure Figure88 shows the whole-genome MCP values inferred for paired analysis (column 1) and for tumor-only analysis of tumor (column 2) and mixture samples (column 3–6). The MCP patterns largely preserve but MCP values attenuate toward 0.5 as tumor content decreases. If a threshold of "MCP ≥ 0.6" is used to call allele-imbalanced SNPs (red vertical line in the shaded boxes) and we regard paired MCP analysis as the ground truth, at tumor content of 80% (column 4) we could achieve 88.5% for sensitivity and 88.2% for specificity. But at tumor content of 70% (column 5) the sensitivity and specificity dropped to 82.6% and 60.4%. This shows that normal contamination of up to 20% is tolerable when calling allele-imbalanced regions in MCP analysis.

Figure 8
The genome-wide view of inferred MCP in the mixture samples. The red vertical lines in the gray boxes represent a MCP threshold of 0.6. See the legend of Figure 2B and 3D for color schemes.

Major and minor copy alleles

One feature of the MCP algorithm is that it also infers the major and minor copy alleles for SNPs that are heterozygous in normal sample and undergo LOH or allele-imbalance in tumor (see "Methods"). In Figure Figure7B,7B, a SNP is colored in red or blue for major copy allele A or B if its major copy allele (MCA) can be inferred and is different from the minor copy allele, which is not displayed. In the paired MCP analysis (Figure (Figure7B,7B, column "HCC38t" with blue color), the MCA is inferred to be different from minor copy allele for many SNPs since the normal sample contains information on heterozygous SNPs and LOH in the tumor sample provides information on the kept allele as MCA. In contrast, in the tumor-only MCP analysis (Figure (Figure7B,7B, column "HCC38t" with black color), we can infer two regions of LOH (MCP is 1) as well as MCA, but there is no information on minor copy allele, so no SNP is colored. However, as normal contamination increases from sample HCC38M9 to HCC38M6, the minor copy allele of more and more SNPs can be estimated from the mixing normal sample, so more SNPs are colored to indicate MCA is different from minor copy allele (Figure (Figure7B).7B). These results show that allelic-imbalances (such as those in the mixture samples) can help to distinguish major and minor copy alleles, while LOH or allelic-balanced events can not.

Therefore in tumor-only MCP analysis, normal contamination at low percentage (≤ 20%) can be turned beneficial through MCP analysis. The normal contaminated samples contain the information of both normal sample genotypes and tumor genome alterations (LOH and copy number changes). In the tumor-only MCP analysis, the normal genotype information is utilized in the form of allele-specific raw copy numbers in the HMM emission distributions (see "Methods"). As the result, the allele-imbalanced regions are identified in a similar way to paired LOH analysis via normal-tumor genotype comparison rather than tumor-only LOH inference, which resorts to unrelated reference normal genotypes to distinguish between LOH and homozygous haplotype blocks [22]. The normal contaminated samples also help to provide information on both major and minor copy allele at allelic-imbalanced regions, which can be useful in downstream analysis. If the contamination percentage can be estimated by other experimental measures, the inferred MCP or copy number from normal contaminated samples can be adjusted proportionally to obtain the MCP/LOH and copy number values of the unavailable pure tumor samples. However, efforts should be made to obtain pure tumor samples and their paired normals for separate hybridization whenever possible, as paired MCP analysis can better recover allele-imbalance information than tumor-only MCP analysis of contaminated samples (Figure (Figure88).

Downstream analysis and related analysis methods

MCP is an extension of LOH and contains complementary information to total copy numbers. Similar to LOH and copy number analysis of a set of tumor samples, a MCP summary score for each SNP may be computed across samples, such as the average MCP value across all samples. Then the chromosome regions can be permuted within samples, and the MCP scores computed from the permuted data can be compared to the original MCP scores to assess the significance of the latter [34]. A composite alteration score using both MCP and total copy number may also be used, such as the proportion of samples with copy > 3 and MCP > 0.65 to capture only allelic imbalanced amplifications.

There are several allele-specific copy number (ASCN) analysis methods for SNP arrays [13,14,16,35]. While total copy number plus MCP provide the same amount of information as allele-specific copy numbers, MCP extends the LOH analysis in a natural way and offers a univariate statistic to capture both LOH and allele-imbalance events. Such univariate quantity is more efficiently estimated and easily used in downstream analyses than a pair of allelic copy numbers. If needed, the total copy number and MCP can be combined to be equal to the analysis using allelic-specific copy numbers. The MCP analysis also reports major and minor copy alleles for allelic comparisons in allele-imbalanced regions. Several of the above ASCN methods also use probe sequence and restriction fragment length to adjust for probe signals to improve signal to noise ratios. Such adjusted raw allelic copy numbers can be conveniently used as the input of the MCP analysis through the dChip software.

Similar to all copy number analysis of SNP arrays, ideally we need paired normal samples for MCP analysis. When such paired samples are not available and an independent set of normal samples are used for reference signals, copy number variations (CNV) in normal samples may confound tumor copy number analysis [36,37]. To address this issue, we have implemented a trimming method. Specifically, we assumed that in reference normal samples, for any SNP at most a certain percent (such as 10%) of the samples have abnormal copy numbers. Then for each SNP, 5% of samples with extreme signals are trimmed from the high and low end of the raw signal distribution and the rest samples are used to compute the signal mean and standard deviations of normal copy numbers at the SNP. This trimming method is designed to accommodate a small amount of CNVs in reference normal samples and has proven useful in copy number analysis with unpaired or limited number of normal samples. The same trimming method can be used to obtain raw allele-specific copy numbers in the MCP analysis.

Conclusion

In this paper, we have focused on allelic imbalance analysis of tumor samples using SNP arrays. We proposed to estimate major copy proportion, which is an extension of LOH analysis and complements total copy number analysis. HMM is used to bridge unobserved states (MCP) and observed data (allele specific signals) through emission and transition distributions. We compared the inferred MCP with LOH and copy number analysis and demonstrated that MCP performs better than LOH analysis in allelic-imbalanced regions and normal contaminated samples. The major and minor copy alleles can also be inferred at allelic-imbalanced regions by MCP analysis. The described analysis and visualization methods are readily available in the dChip software.

Methods

Computing allele-specific raw copy numbers

We use the Invariant Set Normalization method to normalize all the arrays at the probe intensity level to a baseline array with moderate overall intensity [38]. Due to the fact that same amount of DNA sample are hybridized onto arrays and the normalization procedure, the total copy numbers estimated from SNP arrays are relative to sample ploidy. However, the inferred MCP estimates the real MCP in tumor cells, since hybridization and normalization affect the raw signals of both alleles proportionally. We then computed the allele-specific signals for each SNP and sample by applying the PM/MM difference model [39] separately to the probe-level data of A alleles and B alleles of all samples at a SNP probe set (Figure (Figure11).

To obtain allele-specific raw copy numbers for a SNP, the allele-specific signal values of all normal samples (usually ≥ 10, e.g. [16]) in a dataset and their genotypes are first used to estimate allele-specific signal distribution. Specifically, for each SNP, the A allele signal of a genotype AB or half of the A allele signal of a genotype AA are regarded as sample data points from the signal distribution of one copy of A allele and are used to estimate the mean and standard deviation of this distribution. The similar is done for the B allele's signal distribution. When there are fewer than six observed data points to estimate the allele-specific distributions, the total signal (sum of A and B allele signals) of all normal samples will be used to construct allele-independent distribution of one copy [12] and used in place of allele-specific distributions. Finally, the allele-specific signals and standard deviations are divided by the allele-specific means to obtain the allele-specific raw copy numbers (RA and RB) and the standard deviation of copy number one (StdA and StdB) for each SNP.

HMM transition distribution

The transition probability specifies the probability of changing from the MCP state at one SNP (denoted by MCP1) to the MCP state at the next adjacent SNP (denoted by MCP2). Similar to the LOH and copy number HMM [12,22], we assumed that MCP changes are caused by genetic recombination events and close SNP markers are more likely to have the same MCP, and used the Haldane's map function θ = (1 - e-2D)/2 [40] to convert the chromosomal distance D (in the unit of 100 Mb ≈ 1 Morgan) between two SNPs to the probability 2θ (denoted by P0) that MCP2 will return to the background MCP distribution in this sample and thus independent of MCP1. The background MCP probabilities (Pb) are set non-informatively to be 0.9 for MCP of 0.5 (normal locus) and 0.1/N for the rest N MCP states. The transition probabilities are thus:

P(MCP2|MCP1) = P0 × Pb(MCP2) if MCP1 ≠ MCP2
(1-P0) + P0 × Pb(MCP1) if MCP1 = MCP2.

Although Haldane's map function is traditionally used in linkage analysis to describe meiotic crossover events, the motivations of applying it here are that allelic-imbalance or copy number changes can be caused by mitotic recombination events, and mitotic recombination events may share similar initiation mechanisms and hot spots with the meiotic crossover events [41].

HMM emission distribution

The emission distribution specifies the probability or density of the observed RAP (raw allele A proportion, defined as RA/(RA + RB)) given the unobserved MCP of a SNP in a sample. If the ordered genotype alleles (G1, G2) for the minor and major parental copy in normal sample (paired or unavailable) are known, the function relating RAP to MCP and ordered genotype is:

RAPNormal(μ,σ2),  and μ(G1, G2)={1if (G1, G2)=(A, A)MCPif (G1, G2)=(B, A)1MCPif (G1, G2)=(A, B)0if (G1, G2)=(B, B)
(1)

For example, if the ordered genotype is (A, B) and MCP is 0.5 (a normal locus), then RAP should have a mean of 0.5; if the ordered genotype is (A, A) and MCP is 0.66 (e.g. one parental chromosome has 1 copy and another has 2 copies), then RAP has mean of 1 since both parental alleles have genotype A. The standard deviation of RAP (σ) has default value of 0.1, which was chosen based on empirical observation of noise level from data.

In practice, the ordered normal genotypes are only partially known in paired normal samples (as unordered genotypes) or unavailable in tumor-only samples. We averaged all the four possibilities of ordered genotype in Equation 1 to obtain the emission density function:

P (RAP|MCP)=(G1,G2)ϕ(RAPμ(G1,G2)σ)×P(G1,G2)
(2)

where ϕ is the standard normal density function and P(G1, G2) is the probability of a ordered genotype. When the paired normal sample is available, we let P(G1, G2) be determined mainly by the observed normal genotypes and the genotyping error rate e (default value 0.01): P(A, A), P(A, B), P(B, A) and P(B, B) will be {1 - e, e/4, e/4, e/2} for observed genotype AA, {e/2, e/4, e/4, 1 - e} for BB, and {e/2, (1 - e)/2, (1 - e)/2, e/2} for AB. This in effect compares the RAP in a tumor sample to the genotype of the paired normal, and is similar to the LOH analysis of paired normal and tumor samples. When the paired normal sample is not available, we used the normal samples in the dataset or an independent reference set of normal samples in the same ethnic group to estimate the probability of AA, BB and AB genotypes and then convert them to P(G1, G2) similar to the above. This is effect similar to the basic HMM for tumor-only LOH inference [22]. The emission distribution through P(G1, G2) can also be flexibly extended to consider haplotype dependence of SNPs, which can cause long stretch of homozygous SNP genotypes in retention regions. Similar to LD-HMM in tumor-only LOH analysis [22], we used adjacent N SNPs in a tumor sample to estimate the genotype distribution of a SNP in the unavailable normal sample to improve the estimation of haplotype dependence.

Inferring major and minor copy allele

We modified the above HMM for inferring MCP to infer the ordered genotypes (G1, G2), where G1 is minor copy allele and G2 is major copy allele. Specifically, the inferred MCP is regarded as known data, so the posterior probability (PG) of different (G1, G2) can be compared and the one with the largest PG is regarded as the inferred ordered genotype:

PG (RAP|(G1,G2))=ϕ(RAPμ(G1,G2)σ)×P(G1,G2)
(3)

List of abbreviations

SNP (Single Nucleotide Polymorphism), LOH (Loss-of-Heterozygosity), CGH (Comparative Genomic Hybridization), HMM (Hidden Markov Model), TSG (Tumor suppressor gene), Q-PCR (Quantitative PCR), MCP (Major copy proportion), MCA (Major copy allele), RAP (raw allele A proportion)

Authors' contributions

CL, WRS and MM conceived the research design. CL carried out the analysis and drafted the manuscript. RB, BAW, WW and LAG participated in the method development. All authors read and approved the final manuscript.

Acknowledgements

We thank Yuhyun Park, Yu Guo, Yunyu Zhang, Thomas Laframboise, Xiaojun Zhao, Edward Fox, David Harrington and Wing Wong for helpful discussions, Dione Bailey for assistance on the 500 K SNP array data, and the anonymous reviewers for their critical comments. This work is supported by NIH grant 5R01 HG002341 (CL), 1P50 CA090578 (MM, CL) and a grant from Claudia Adams Barr Program in Cancer Research (CL).

References

  • Knudson AG. Cancer genetics. Am J Med Genet. 2002;111:96–102. doi: 10.1002/ajmg.10320. [PubMed] [Cross Ref]
  • Li J, Yen C, Liaw D, Podsypanina K, Bose S, Wang SI, Puc J, Miliaresis C, Rodgers L, McCombie R, Bigner SH, Giovanella BC, Ittmann M, Tycko B, Hibshoosh H, Wigler MH, Parsons R. PTEN, a putative protein tyrosine phosphatase gene mutated in human brain, breast, and prostate cancer. Science. 1997;275:1943–1947. doi: 10.1126/science.275.5308.1943. [PubMed] [Cross Ref]
  • Di Fiore PP, Pierce JH, Kraus MH, Segatto O, King CR, Aaronson SA. erbB-2 is a potent oncogene when overexpressed in NIH/3T3 cells. Science. 1987;237:178–182. doi: 10.1126/science.2885917. [PubMed] [Cross Ref]
  • Kennedy GC, Matsuzaki H, Dong S, Liu WM, Huang J, Liu G, Su X, Cao M, Chen W, Zhang J, Liu W, Yang G, Di X, Ryder T, He Z, Surti U, Phillips MS, Boyce-Jacino MT, Fodor SP, Jones KW. Large-scale genotyping of complex DNA. Nat Biotechnol. 2003;21:1233–1237. doi: 10.1038/nbt869. [PubMed] [Cross Ref]
  • Matsuzaki H, Dong S, Loi H, Di X, Liu G, Hubbell E, Law J, Berntsen T, Chadha M, Hui H, Yang G, Kennedy GC, Webster TA, Cawley S, Walsh PS, Jones KW, Fodor SPA, Mei R. Genotyping over 100,000 SNPs on a pair of oligonucleotide arrays. Nature Methods. 2004;1:109–111. doi: 10.1038/nmeth718. [PubMed] [Cross Ref]
  • Liu WM, Di X, Yang G, Matsuzaki H, Huang J, Mei R, Ryder TB, Webster TA, Dong S, Liu G, Jones KW, Kennedy GC, Kulp D. Algorithms for large-scale genotyping microarrays. Bioinformatics. 2003;19:2397–2403. doi: 10.1093/bioinformatics/btg332. [PubMed] [Cross Ref]
  • Klein RJ, Zeiss C, Chew EY, Tsai JY, Sackler RS, Haynes C, Henning AK, Sangiovanni JP, Mane SM, Mayne ST, Bracken MB, Ferris FL, Ott J, Barnstable C, Hoh J. Complement factor H polymorphism in age-related macular degeneration. Science. 2005;308:385–389. doi: 10.1126/science.1109557. [PMC free article] [PubMed] [Cross Ref]
  • Puffenberger EG, Hu-Lince D, Parod JM, Craig DW, Dobrin SE, Conway AR, Donarum EA, Strauss KA, Dunckley T, Cardenas JF, Melmed KR, Wright CA, Liang W, Stafford P, Flynn CR, Morton DH, Stephan DA. Mapping of sudden infant death with dysgenesis of the testes syndrome (SIDDT) by a SNP genome scan and identification of TSPYL loss of function. Proc Natl Acad Sci U S A. 2004;101:11689–11694. doi: 10.1073/pnas.0401194101. [PMC free article] [PubMed] [Cross Ref]
  • Lindblad-Toh K, Tanenbaum DM, Daly MJ, Winchester E, Lui WO, Villapakkam A, Stanton SE, Larsson C, Hudson TJ, Johnson BE, Lander ES, Meyerson M. Loss-of-heterozygosity analysis of small-cell lung carcinomas using single-nucleotide polymorphism arrays. Nat Biotechnol. 2000;18:1001–1005. doi: 10.1038/79269. [PubMed] [Cross Ref]
  • Bignell GR, Huang J, Greshock J, Watt S, Butler A, West S, Grigorova M, Jones KW, Wei W, Stratton MR, Futreal PA, Weber B, Shapero MH, Wooster R. High-resolution analysis of DNA copy number using oligonucleotide microarrays. Genome Res. 2004;14:287–295. doi: 10.1101/gr.2012304. [PMC free article] [PubMed] [Cross Ref]
  • Redon R, Ishikawa S, Fitch KR, Feuk L, Perry GH, Andrews TD, Fiegler H, Shapero MH, Carson AR, Chen W, Cho EK, Dallaire S, Freeman JL, Gonzalez JR, Gratacos M, Huang J, Kalaitzopoulos D, Komura D, MacDonald JR, Marshall CR, Mei R, Montgomery L, Nishimura K, Okamura K, Shen F, Somerville MJ, Tchinda J, Valsesia A, Woodwark C, Yang F, Zhang J, Zerjal T, Armengol L, Conrad DF, Estivill X, Tyler-Smith C, Carter NP, Aburatani H, Lee C, Jones KW, Scherer SW, Hurles ME. Global variation in copy number in the human genome. Nature. 2006;444:444–454. doi: 10.1038/nature05329. [PMC free article] [PubMed] [Cross Ref]
  • Zhao X, Li C, Paez JG, Chin K, Janne PA, Chen TH, Girard L, Minna J, Christiani D, Leo C, Gray JW, Sellers WR, Meyerson M. An integrated view of copy number and allelic alterations in the cancer genome using single nucleotide polymorphism arrays. Cancer Res. 2004;64:3060–3071. doi: 10.1158/0008-5472.CAN-03-3308. [PubMed] [Cross Ref]
  • LaFramboise T, Weir B, Zhao X, Beroukhim R, Li C, Harrington D, Sellers WR, Meyerson M. Allele-Specific Amplification in Cancer Revealed by SNP Array Analysis. PLoS Comput Biol. 2005;1:e65. doi: 10.1371/journal.pcbi.0010065. [PMC free article] [PubMed] [Cross Ref]
  • Huang J, Wei W, Chen J, Zhang J, Liu G, Di X, Mei R, Ishikawa S, Aburatani H, Jones KW, Shapero MH. CARAT: a novel method for allelic detection of DNA copy number changes using high density oligonucleotide arrays. BMC Bioinformatics. 2006;7:83. doi: 10.1186/1471-2105-7-83. [PMC free article] [PubMed] [Cross Ref]
  • Yamamoto G, Nannya Y, Kato M, Sanada M, Levine RL, Kawamata N, Hangaishi A, Kurokawa M, Chiba S, Gilliland DG, Koeffler HP, Ogawa S. Highly sensitive method for genomewide detection of allelic composition in nonpaired, primary tumor specimens by use of affymetrix single-nucleotide-polymorphism genotyping microarrays. Am J Hum Genet. 2007;81:114–126. doi: 10.1086/518809. [PMC free article] [PubMed] [Cross Ref]
  • Nannya Y, Sanada M, Nakazaki K, Hosoya N, Wang L, Hangaishi A, Kurokawa M, Chiba S, Bailey DK, Kennedy GC, Ogawa S. A robust algorithm for copy number detection using high-density oligonucleotide single nucleotide polymorphism genotyping arrays. Cancer Res. 2005;65:6071–6079. doi: 10.1158/0008-5472.CAN-05-0465. [PubMed] [Cross Ref]
  • Scharpf RB, Parmigiani G, Pevsner J, Ruczinski I. Hidden Markov models for the assessment of chromosomal alterations using high-throughput SNP arrays. Annals of Applied Statistics. 2008. [PMC free article] [PubMed]
  • Wang K, Li M, Hadley D, Liu R, Glessner J, Grant SF, Hakonarson H, Bucan M. PennCNV: an integrated hidden Markov model designed for high-resolution copy number variation detection in whole-genome SNP genotyping data. Genome Res. 2007;17:1665–1674. doi: 10.1101/gr.6861907. [PMC free article] [PubMed] [Cross Ref]
  • Fridlyand J, Snijders AM, Pinkel D, Albertson DG, Jain AN. Hidden Markov models approach to the analysis of array CGH data. Journal of Multivariate Analysis. 2004;90:132–153. doi: 10.1016/j.jmva.2004.02.008. [Cross Ref]
  • Lamy P, Andersen CL, Dyrskjot L, Torring N, Wiuf C. A Hidden Markov Model to estimate population mixture and allelic copy-numbers in cancers using Affymetrix SNP arrays. BMC Bioinformatics. 2007;8:434. doi: 10.1186/1471-2105-8-434. [PMC free article] [PubMed] [Cross Ref]
  • Shah SP, Xuan X, DeLeeuw RJ, Khojasteh M, Lam WL, Ng R, Murphy KP. Integrating copy number polymorphisms into array CGH analysis using a robust HMM. Bioinformatics. 2006;22:e431–9. doi: 10.1093/bioinformatics/btl238. [PubMed] [Cross Ref]
  • Beroukhim R, Lin M, Hao K, Zhao X, Garraway LA, Fox EA, Hochberg EP, Hofer MD, Descazeaud A, Rubin MA, Meyerson M, Wong WH, Sellers WR, Li C. Inferring Loss-of-Heterozygosity from Tumor-only Samples Using High-Density Oligonucleotide SNP Arrays. PLOS Computational Biology. 2006;2:e41. doi: 10.1371/journal.pcbi.0020041. [PMC free article] [PubMed] [Cross Ref]
  • Durbin R, Eddy S, Krogh A, Mitchison G. Biological Sequence Analysis: Probabilistic Models of Proteins and Nucleic Acids. Cambridge, Cambridge University Press; 1999. p. 356.
  • Lung cancer 10K SNP array dataset http://research.dfci.harvard.edu/meyersonlab/
  • Zhao X, Weir BA, LaFramboise T, Lin M, Beroukhim R, Garraway L, Beheshti J, Lee JC, Naoki K, Richards WG, Sugarbaker D, Chen F, Rubin MA, Janne PA, Girard L, Minna J, Christiani D, Li C, Sellers WR, Meyerson M. Homozygous deletions and chromosome amplifications in human lung carcinomas revealed by single nucleotide polymorphism array analysis. Cancer Res. 2005;65:5561–5570. doi: 10.1158/0008-5472.CAN-04-4603. [PubMed] [Cross Ref]
  • Lung cancer 100K SNP array dataset http://research2.dfci.harvard.edu/dfci/snp/
  • Affymetrix Sample Data Sets for Copy Number Analysis http://www.affymetrix.com/support/technical/sample_data/copy_number_data.affx
  • Weir BA, Woo MS, Getz G, Perner S, Ding L, Beroukhim R, Lin WM, Province MA, Kraja A, Johnson LA, Shah K, Sato M, Thomas RK, Barletta JA, Borecki IB, Broderick S, Chang AC, Chiang DY, Chirieac LR, Cho J, Fujii Y, Gazdar AF, Giordano T, Greulich H, Hanna M, Johnson BE, Kris MG, Lash A, Lin L, Lindeman N, Mardis ER, McPherson JD, Minna JD, Morgan MB, Nadel M, Orringer MB, Osborne JR, Ozenberger B, Ramos AH, Robinson J, Roth JA, Rusch V, Sasaki H, Shepherd F, Sougnez C, Spitz MR, Tsao MS, Twomey D, Verhaak RG, Weinstock GM, Wheeler DA, Winckler W, Yoshizawa A, Yu S, Zakowski MF, Zhang Q, Beer DG, Wistuba. Watson MA, Garraway LA, Ladanyi M, Travis WD, Pao W, Rubin MA, Gabriel SB, Gibbs RA, Varmus HE, Wilson RK, Lander ES, Meyerson M. Characterizing the cancer genome in lung adenocarcinoma. Nature. 2007;450:893–898. doi: 10.1038/nature06358. [PMC free article] [PubMed] [Cross Ref]
  • Lung cancer 250K SNP array dataset http://www.broad.mit.edu/cancer/pub/tsp/
  • Lin M, Wei LJ, Sellers WR, Lieberfarb M, Wong WH, Li C. dChipSNP: significance curve and clustering of SNP-array-based loss-of-heterozygosity data. Bioinformatics. 2004;20:1233–1240. doi: 10.1093/bioinformatics/bth069. [PubMed] [Cross Ref]
  • dChip software package http://www.dchip.org/
  • Grigorova M, Lyman RC, Caldas C, Edwards PA. Chromosome abnormalities in 10 lung cancer cell lines of the NCI-H series analyzed with spectral karyotyping. Cancer Genet Cytogenet. 2005;162:1–9. doi: 10.1016/j.cancergencyto.2005.03.007. [PubMed] [Cross Ref]
  • Di X, Matsuzaki H, Webster TA, Hubbell E, Liu G, Dong S, Bartell D, Huang J, Chiles R, Yang G, Shen MM, Kulp D, Kennedy GC, Mei R, Jones KW, Cawley S. Dynamic model based algorithms for screening and genotyping over 100 K SNPs on oligonucleotide microarrays. Bioinformatics. 2005;21:1958–1963. doi: 10.1093/bioinformatics/bti275. [PubMed] [Cross Ref]
  • Westfall PH, Young SS. Resampling-based Multiple Testing: Examples and Methods for P-value Adjustment. New York, Wiley; 1993.
  • Ishikawa S, Komura D, Tsuji S, Nishimura K, Yamamoto S, Panda B, Huang J, Fukayama M, Jones KW, Aburatani H. Allelic dosage analysis with genotyping microarrays. Biochem Biophys Res Commun. 2005;333:1309–1314. doi: 10.1016/j.bbrc.2005.06.040. [PubMed] [Cross Ref]
  • Sebat J, Lakshmi B, Troge J, Alexander J, Young J, Lundin P, Maner S, Massa H, Walker M, Chi M, Navin N, Lucito R, Healy J, Hicks J, Ye K, Reiner A, Gilliam TC, Trask B, Patterson N, Zetterberg A, Wigler M. Large-scale copy number polymorphism in the human genome. Science. 2004;305:525–528. doi: 10.1126/science.1098918. [PubMed] [Cross Ref]
  • Iafrate AJ, Feuk L, Rivera MN, Listewnik ML, Donahoe PK, Qi Y, Scherer SW, Lee C. Detection of large-scale variation in the human genome. Nat Genet. 2004;36:949–951. doi: 10.1038/ng1416. [PubMed] [Cross Ref]
  • Li C, Wong WH. Model-based analysis of oligonucleotide arrays: model validation, design issues and standard error application. Genome Biol. 2001;2:RESEARCH0032. [PMC free article] [PubMed]
  • Li C, Wong WH. Model-based analysis of oligonucleotide arrays: expression index computation and outlier detection. Proc Natl Acad Sci U S A. 2001;98:31–36. doi: 10.1073/pnas.011404098. [PMC free article] [PubMed] [Cross Ref]
  • Lange K. Mathematical and statistical methods for genetic analysis. 2. New York, Springer-Verlag; 2002.
  • Jeffreys AJ, May CA. Intense and highly localized gene conversion activity in human meiotic crossover hot spots. Nat Genet. 2004;36:151–156. doi: 10.1038/ng1287. [PubMed] [Cross Ref]

Articles from BMC Bioinformatics are provided here courtesy of BioMed Central

Formats:

Related citations in PubMed

See reviews...See all...

Cited by other articles in PMC

See all...

Links

  • MedGen
    MedGen
    Related information in MedGen
  • PubMed
    PubMed
    PubMed citations for these articles

Recent Activity

Your browsing activity is empty.

Activity recording is turned off.

Turn recording back on

See more...