pmc logo image
Logo of pophmetrBioMed Central web siteReference to the article.Search.Manuscript submission.Registration.Journal front page.
Journal List > Popul Health Metr > v.5; 2007

Formats:
Popul Health Metr. 2007; 5: 11.
Published online 2007 October 29. doi: 10.1186/1478-7954-5-11.
PMCID: PMC2213637
Copyright © 2007 Goldhaber-Fiebert et al; licensee BioMed Central Ltd.
Modeling human papillomavirus and cervical cancer in the United States for analyses of screening and vaccination
Jeremy D Goldhaber-Fiebert,corresponding author1,2 Natasha K Stout,1,2 Jesse Ortendahl,1,2 Karen M Kuntz,3,4 Sue J Goldie,1,2 and Joshua A Salomon1,5,6
1Department of Health Policy and Management, Harvard School of Public Health, Boston, USA
2Program in Health Decision Science, Harvard School of Public Health, Boston, USA
3Departments of Health Policy and Management and Biostatistics, Harvard School of Public Health, Boston, USA
4Division of Health Policy and Management of the School of Public Health, University of Minnesota, Minneapolis, USA
5Department of Population and International Health, Harvard School of Public Health, Boston, USA
6Harvard University Initiative for Global Health, Cambridge, USA
corresponding authorCorresponding author.
Jeremy D Goldhaber-Fiebert: jgoldhab/at/hsph.harvard.edu; Natasha K Stout: nstout/at/hsph.harvard.edu; Jesse Ortendahl: jortenda/at/hsph.harvard.edu; Karen M Kuntz: kmkuntz/at/umn.edu; Sue J Goldie: sue_goldie/at/harvard.edu; Joshua A Salomon: jsalomon/at/hsph.harvard.edu
Received April 4, 2007; Accepted October 29, 2007.
This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.
Small right arrow pointing to: This article has been cited by other articles in PMC.
Abstract
Background
To provide quantitative insight into current U.S. policy choices for cervical cancer prevention, we developed a model of human papillomavirus (HPV) and cervical cancer, explicitly incorporating uncertainty about the natural history of disease.
Methods
We developed a stochastic microsimulation of cervical cancer that distinguishes different HPV types by their incidence, clearance, persistence, and progression. Input parameter sets were sampled randomly from uniform distributions, and simulations undertaken with each set. Through systematic reviews and formal data synthesis, we established multiple epidemiologic targets for model calibration, including age-specific prevalence of HPV by type, age-specific prevalence of cervical intraepithelial neoplasia (CIN), HPV type distribution within CIN and cancer, and age-specific cancer incidence. For each set of sampled input parameters, likelihood-based goodness-of-fit (GOF) scores were computed based on comparisons between model-predicted outcomes and calibration targets. Using 50 randomly resampled, good-fitting parameter sets, we assessed the external consistency and face validity of the model, comparing predicted screening outcomes to independent data. To illustrate the advantage of this approach in reflecting parameter uncertainty, we used the 50 sets to project the distribution of health outcomes in U.S. women under different cervical cancer prevention strategies.
Results
Approximately 200 good-fitting parameter sets were identified from 1,000,000 simulated sets. Modeled screening outcomes were externally consistent with results from multiple independent data sources. Based on 50 good-fitting parameter sets, the expected reductions in lifetime risk of cancer with annual or biennial screening were 76% (range across 50 sets: 69–82%) and 69% (60–77%), respectively. The reduction from vaccination alone was 75%, although it ranged from 60% to 88%, reflecting considerable parameter uncertainty about the natural history of type-specific HPV infection. The uncertainty surrounding the model-predicted reduction in cervical cancer incidence narrowed substantially when vaccination was combined with every-5-year screening, with a mean reduction of 89% and range of 83% to 95%.
Conclusion
We demonstrate an approach to parameterization, calibration and performance evaluation for a U.S. cervical cancer microsimulation model intended to provide qualitative and quantitative inputs into decisions that must be taken before long-term data on vaccination outcomes become available. This approach allows for a rigorous and comprehensive description of policy-relevant uncertainty about health outcomes under alternative cancer prevention strategies. The model provides a tool that can accommodate new information, and can be modified as needed, to iteratively assess the expected benefits, costs, and cost-effectiveness of different policies in the U.S.
Background
In the United States, cervical cancer screening using repeated cervical cytology at frequent intervals has substantially reduced the incidence of invasive cancer, although there are still more than 3,000 deaths annually, and disparities in cancer outcomes persist [1-4]. With the development of reliable assays to detect high-risk, oncogenic types of human papillomavirus (HPV) and vaccines that are highly efficacious in preventing HPV types 16 and 18 in women not previously infected with these types, there are important questions to address with respect to cervical cancer prevention [5-8]. The two prophylactic vaccines that are currently in clinical trials include a quadrivalent vaccine that targets HPV-6/11/16/18 (Gardasil; Merck & Co., Inc., Whitehouse Station, New Jersey) and bivalent vaccine that targets HPV-16/18 (Cervarix; GlaxoSmithKline, Uxbridge, Middlesex, United Kingdom).
From both individual and population perspectives, options for primary and secondary prevention of cervical cancer would ideally be deployed synergistically to improve cancer outcomes, reduce disparities, minimize the risk of over-detection of abnormalities likely to resolve on their own, and enhance the cost-effectiveness of cervical cancer control. However, evaluating outcomes associated with different screening and vaccination strategies is challenging, since the interventions are applied at different time points and target different biologic processes along the spectrum of HPV infection, carcinogenesis, and invasive cancer. As such, no single, empirical study will be able to evaluate all possible strategies, and even studies aimed at assessing the benefits of one or two approaches would require extremely large sample sizes with extensive follow-up because of the long time course over which individuals are vulnerable to acquiring HPV infection and relatively low cancer incidence [6,9]. Integrating the best-available epidemiologic data, computer-based mathematical models used in a decision-analytic framework can identify those factors most likely to influence outcomes and can inform decisions that need to be made amidst considerable uncertainty.
Given the inevitable uncertainty around input parameters to any mathematical model, an important feature of many modeling efforts is the calibration of these parameter values in reference to observed epidemiologic data. Many previous cervical cancer models used in cost-effectiveness analyses have relied on manual calibration methods to fit to select sources of epidemiologic data [10-21], a reasonable approach for the questions addressed in previous analyses [22]. However, the increased availability of epidemiologic data – together with the complexities of comparing vaccination of adolescents against two high-risk HPV types and screening for high-grade cervical intraepithelial neoplasia (CIN) in women throughout much of adulthood – demands a more complex model with a more systematic approach to translating parameter uncertainty into the corresponding uncertainty around policy outcomes. Like others, our group has begun to apply more formal approaches to calibrating to multiple sources of data simultaneously [22]. Our objectives in this paper are to (1) describe a formal approach to the parameterization, calibration, and evaluation of a cervical cancer model for the U.S.; and (2) use this model to predict health outcomes, as well as the uncertainty surrounding these predictions, associated with cervical cancer screening, HPV-16/18 vaccination, and combinations of vaccination and screening.
Methods
Overview
We developed a microsimulation model of cervical carcinogenesis reflecting the best currently available evidence. The model development process included definition of model structure, parameterization, calibration, and evaluation of model performance. Parameter ranges for model inputs relating to natural history were defined from longitudinal cohort studies. Observed epidemiologic data on outcomes such as age-specific HPV prevalence and cervical cancer incidence prior to widespread screening were used to define targets for calibration of model parameters. Parameter values were sampled from the defined ranges, and simulations undertaken for each sampled parameter set. The goodness-of-fit (GOF) of modeled outputs resulting from each candidate set of input parameter values was evaluated using likelihood-based GOF scores calculated based on the full array of calibration targets. We identified a subset of the sampled parameter combinations that had scores that were statistically indistinguishable from that of the best-fitting set. We evaluated model performance in terms of consistency between modeled outcomes and those from large, population-based studies. The types and sources of data used in each of the three steps of model parameterization, calibration, and evaluation of performance are summarized in Table 1[14,20,21,23-102]. To assess the implications of our calibration approach in terms of the uncertainty in modeled outcomes that follows from empirically-calibrated input parameters, we examined the range of modeled cancer incidence reductions that could be expected across the calibrated parameter sets in simulations of screening (following current guidelines), widespread administration of an HPV vaccine, and a combination of vaccination and screening. Additional details of the model type, structure, parameterization, calibration, and evaluation are provided in the Appendix (see Additional File 1).
Table 1
Table 1
Data sources used in model parameterization, calibration, and performance evaluation
Model structure, parameterization, and simulation
The stochastic microsimulation model simulates the transitions of individuals between a set of mutually exclusive health states (Figure (Figure1).1Figure 1). In the model, HPV infection is stratified into 5 categories: not infected; HPV-16; HPV-18; other high-risk types (category includes types 31, 33, 35, 39, 45, 51, 52, 56, 58, 59, and 68); and low-risk types. CIN status is modeled in three categories: no CIN; CIN 1, and CIN2,3. Individual females enter the model at age 9 prior to sexual debut and remain in the model for the entirety of their lives. Transitions between health states occur at monthly intervals and depend on HPV type, age, history of prior HPV infection, type-specific natural immunity, previous treatment for CIN, and screening patterns. Each month, a woman has an age- and type-specific probability of being infected with HPV. Modeled probabilities of age-related HPV infection act as a proxy for the probability of being sexually active combined with the probability of transmission and distribution of HPV types among sexual partners. The model also has the capability of considering the indirect effects on health outcomes associated with herd immunity by modifying incidence rates based on output from a dynamic model [103]. Most women with HPV infections will develop transient abnormalities reflecting productive HPV infection, and some will progress to CIN2,3. Women infected with high-risk HPV types and having persistent high-grade CIN may progress to invasive cancer, and those with invasive cancer can develop symptoms or progress to the next stage of cancer. We assume that symptomatic women with invasive cancer receive stage-specific treatment for their disease and are subject to the corresponding stage-specific survival rates. From every health state and in every month, women face competing mortality risks from all other causes.
Figure 1
Figure 1
Figure 1
Model natural history schematic. Each ellipse represents a state in the natural history model. HPV is stratified by type. Each month, a woman has a chance of transitioning from her current state along one of the arrows emanating from that state to another (more ...)
We derived initial estimates and ranges for monthly transition probabilities required by the model from published literature (Table 2). Because of uncertainty about the estimated quantities within each study and heterogeneity across studies based on methodological and population differences, the upper and lower bound of each search range were defined to be broadly inclusive of (1) study-reported confidence intervals when available; (2) the highest and lowest estimate reported from different data sources; and (3) expert opinion.
Table 2
Table 2
Model natural history parameters, search ranges, and calibrated parameters*
Model calibration
Our approach to model calibration was based on a multi-dimensional random search in which input parameters values were sampled from plausible ranges defined as described above, and then separate simulations of the model were run using each set of sampled parameter values.
Calibration targets
We defined 84 epidemiologic outcomes that comprised targets for calibration, within the following categories: type- and age-specific prevalence of HPV; type- and age-specific duration of HPV infection; age-specific prevalence of CIN1 and CIN2,3; age-specific cancer incidence; lifetime cancer risk; and HPV type-distribution within CIN and cancer. For each calibration target, we determined a 95% confidence interval using data arising from population-based studies [104]. When multiple data sources were available, we used random-effects models for data synthesis to produce combined point estimates and confidence intervals [105]. For some calibration targets, for which the quantities of interest were expected to vary across epidemiologic settings, we limited the range of data sources that informed the definition of our targets. For example, targets on HPV and CIN prevalence were based only on North American studies, despite availability of a wider range of possible data sources. Because the model is intended for policy analyses of screening and vaccination in the United States, targets relating to cancer were based exclusively on data from the U.S.
To establish calibration targets for age-specific prevalence of HPV and CIN we included studies that provided sufficient information on sample size and prevalence of age-specific infection with high-risk or low-risk HPV types [45-61]. Similarly, we included only studies that provided sufficient information on sample size and prevalence of CIN1 or CIN2,3 [45,47,50,62-71]. For targets relating to duration of infection, data were derived from a single, longitudinal Brazilian study that collected frequent, repeated measures of HPV status in a large cohort of women over an average follow-up of 53 months [41], supplemented with secondary data from studies with shorter periods of observation from the U.S.
To calibrate model parameters governing the natural history of disease in the absence of screening, targets on the age-specific incidence of invasive cervical cancer were defined based on 1959–60 data reported from multiple U.S. registries to the International Agency for Research on Cancer (IARC) [43]. Observations from each registry were treated as outcomes of independent experiments and combined using a random-effects model [105]. To define targets on the lifetime risk of cancer, we incorporated the lower and upper confidence intervals from the age-specific cancer incidence rates and all-cause, age-specific U.S. mortality rates in a multiple-decrement, life table approach to account for competing mortality hazards [44,106,107].
We defined targets on HPV type distribution in CIN and cancer based primarily on the systematic reviews of Clifford et al., supplemented by subsequently published studies [58,72-94]. Specifically, we estimated the proportion of patients with CIN2,3 infected with HPV-16, HPV-18, or another high-risk HPV type; the proportion of patients with CIN1 infected with HPV-16/18 or another high-risk type; and the proportion of patients with invasive cervical cancers infected with either HPV-16 or HPV-18.
Parameter set selection
For model inputs, we used age-specific estimates derived from longitudinal studies to define the baseline shape of each parameter curve with respect to age, but searched plausible ranges around these inputs by specifying ranges for scalar multipliers applied to these curves. The plausible ranges around input parameter values comprised a joint uniform prior distribution for the inputs. We randomly sampled 1,000,000 parameter sets from this joint prior distribution.
For each set of sampled parameter values, we simulated a population of 100,000 individuals in the model and then compared the modeled outputs corresponding to each of the 84 calibration targets to the target values for these outputs. The formal comparison was based on a likelihood score, computed under the assumption that calibration targets were characterized by independent, normal probability density functions, with means and standard deviations derived from the empirical 95% confidence intervals. An overall goodness-of-fit (GOF) score was computed as negative two times the sum of the log-likelihood scores for each target. To compare the fit of different parameter sets, we assumed that the distribution of GOF scores across simulations may be approximated by a chi-square distribution with the number of degrees of freedom equal to the number of calibration targets.
With likelihood-based GOF scores, we identified multiple parameter set combinations whose outputs were simultaneously consistent with calibration targets derived from epidemiologic data. In addition to this first criterion of overall goodness-of-fit, we also evaluated candidate parameter sets based on a second criterion, of goodness-of-fit with respect to a subset of high-priority targets, based on their relevance to policy questions regarding vaccination and screening. First, we determined our best-fitting parameter set as the one with the lowest overall GOF score – the model-generated input parameter set whose simulated outputs were simultaneously closest to all calibration targets. We identified those parameter sets with GOF scores that were statistically indistinguishable from the GOF score of the best-fitting set (based on a likelihood ratio test with p < 0.05), and considered these to be good-fitting also. To further restrict the selection of good-fitting parameter values to those that provided the best fit to high-priority targets, we computed a GOF subscore based on the following high-priority targets: prevalence of CIN1 at ages 25–29 and 35–39 years, proportion of HPV-16/18 in CIN1, proportion of HPV-16 in CIN2,3 and cancer, proportion of HPV-18 in cancer, and cancer incidence at ages 45–49, 55–59, and 70–74 years. Finally, we accepted those parameter sets that were good-fitting and had high-priority GOF subscores amongst the top 1% of all parameter sets.
For efficiency, subsequent analyses were based on a random resample of 50 parameter sets from the array of accepted parameter sets to preserve the representation of overall parameter uncertainty while reducing the computational intensity required for the simulations.
Model evaluation
We evaluated the performance of the model in terms of its external consistency and face validity by comparing model output to data from several large U.S. screening studies not used in the parameterization or calibration of the natural history model. These included the ASCUS/LSIL Triage Study for Cervical Cancer (ALTS) and Portland Kaiser Permanente studies as well as data from the NCI's Surveillance Epidemiology and End Results (SEER) Program [95-97]. For all evaluation targets, we derived both point estimates and 95% confidence intervals from the empirical data.
Baseline data from the Portland Kaiser Permanente study were used to calculate the cross-sectional, age-specific prevalence of high-risk HPV and of cervical cytology results that were high-grade squamous intraepithelial lesion or worse (HSIL+). Baseline data from the ALTS study were used to calculate the cross-sectional proportions of HPV-positive persons with CIN1 and CIN2+ (e.g., histology of CIN2 or worse) having HPV-16, HPV-18, or other high-risk HPV types. Data from SEER for 2003 were used to derive incidence of age-specific invasive cervical cancer detected in the presence of cervical cancer screening, and analogous estimates were calculated from IARC data for the U.S. prior to widespread screening. We estimated the incidence reductions due to screening by subtracting SEER incidence rates from IARC rates by age. SEER data from 1996 to 2000 were used to calculate the proportion of invasive cervical cancer cases detected at each SEER historical stage (local, regional, and distant).
To compare consistency of model results to our external evaluation targets, we simulated 5 screening scenarios for each of the 50 parameter sets from the calibrated natural history model. These included no screening and screening using cervical cytology at 4 levels of intensity: every 1, 2, 3, or 5 years from ages 18 to 70. Additional assumptions about screening, diagnosis, and treatment are provided in the Appendix (see Additional file 1). Model outputs for these simulations were based on cohorts of 1,000,000 women.
Because data from these studies were derived from women with different past patterns of screening, we combined modeled outputs from our 5 screening scenarios to produce modeled outputs that would be consistent with a cohort of women whose cervical cancer screening patterns matched nationally observed, age-specific patterns of screening [98,102]. For the ALTS targets, age-specific modeled outputs were then collapsed across age categories using a weighted average based upon the age structure of the ALTS data. Since SEER stage at cancer detection targets were based on women with detected cervical cancer, matched modeled outputs (e.g., the number of cervical cancer cases detected at each stage for each screening scenario) were combined using screening patterns derived from case-control studies of women with diagnosed cervical cancer [99-101]. We assessed model performance in terms of its external consistency and face validity using a benchmark of overlap between the model range and the study's confidence interval or range. Similarity in age patterns between modeled and study outcomes based on visual inspection was used as a further criterion for assessing model performance.
Quantifying the impact of model calibration
A key motivation of this study was to better reflect parameter uncertainty critical to policy analyses, for example, evaluations of cost-effectiveness of vaccination and screening interventions to prevent cervical cancer. While a full consideration of alternative prevention strategies is beyond the scope of this study, we provide an illustrative example by using the empirically calibrated model to project the reduction in cervical cancer that would be expected with HPV vaccination and cytology-based screening at different frequencies. We assumed the prophylactic HPV vaccine would be given to all women prior to age 12, and assumed complete, lifelong protection against HPV-16 and -18. For each of the 50 resampled good-fitting parameter sets, we estimated cumulative cervical cancer incidence with and without vaccination or screening and examined the distribution across parameter sets, of reductions in cervical cancer incidence, expressed as percentages. The distributions of cancer incidence reduction under alternative prevention strategies illustrate how calibration of model input parameters to epidemiologic data can be used to quantify the uncertainty around results of policy interest.
Across the 50 good-fitting parameter sets, we calculated the pair-wise correlation coefficients for expected cervical cancer reduction due to screening at different frequencies, vaccination without screening, and screening at different frequencies and vaccination used in combination. For this analysis, the unit of observation was the parameter set. The significance (p < 0.05) of the correlation was assessed using a Bonferroni correction for multiple comparisons. The aim of the analysis was to evaluate relationship of benefit derived from screening and vaccination used alone or in combination: specifically, whether parameter sets in which screening produced more benefit also showed more benefit from vaccination and whether the benefit from screening used at different frequencies combined with vaccination was correlated within parameter sets.
Statistical analysis
The microsimulation was implemented in C++ on high-performance Linux computer clusters. Analyses of results were performed with Stata/SE 9.2 for Windows (StataCorp LP, College Station, TX) and Microsoft Office Excel 2003 SP2 (Microsoft Corporation, Redmond, WA).
Results
Model calibration
For 1,000,000 randomly generated input parameter sets, approximately 1,000 input parameter sets had GOF scores that were statistically indistinguishable from that of the best-fitting set (at p < 0.05). Of these input parameter sets, 183 met the additional criterion of being in the top 1 percent of fits for the high-priority subset of calibration targets. From the parameter sets accepted based on these two criteria, 50 were randomly resampled for further analyses and evaluation. Table 2 shows the results of calibration on the range of model input parameters. Further details on the results on calibration are documented in the Appendix (see Additional file 1).
Figure Figure22Figure 2 and Figure Figure33Figure 3 compare the calibration targets to the range of model outputs before and after calibration. The process of calibration improved model fit for all calibration targets. The greatest improvement in model fit is noted in age-specific prevalence of CIN2,3 and age-specific incidence of invasive cervical cancer. Observed durations for low-risk HPV in all ages, for HPV-16 in women younger than 30 years, and for HPV-18 in women 30 years or older are overestimated for some parameter sets, but the pattern of the increased duration for higher risk HPV types within age categories is consistent with calibration targets. Age-specific low-risk HPV prevalence is generally low for women under 30, and CIN1 prevalence is low for 25–29 year-olds. HPV type distribution within neoplasia and cancer category, age-specific prevalence of high-risk HPV and CIN2,3, and age-specific incidence of invasive cancer demonstrate consistency between modeled outcomes and calibration targets.
Figure 2
Figure 2
Figure 2
Calibration to empirical data. (Panels A through D) Black horizontal bars represent the upper and lower bounds of the 95% confidence intervals of each calibration target. Dashed gray lines represent model outputs prior to calibration and selection. Green (more ...)
Figure 3
Figure 3
Figure 3
Calibration to empirical data. (Panels A through C) Black horizontal bars represent the upper and lower bounds of the 95% confidence intervals of each calibration target. Dashed gray lines represent model outputs prior to calibration and selection. Green (more ...)
Model evaluation
We compared the model-predicted screening outcomes across the spectrum of HPV infection and cervical cancer to selected studies not used in parameterization or calibration of the model. Figure Figure4A4AFigure 4 shows the 95% confidence intervals for age-specific high-risk HPV prevalence among women enrolled in the Portland Kaiser Permanente study compared with modeled outputs for women whose screening intensities were derived from national averages. Model output is consistent with the general shape of decline in high-risk HPV prevalence for older ages. For some parameterizations, the model produces lower estimates of age-specific prevalence than those from the Kaiser sample. Figure Figure4B4BFigure 4 shows the 95% confidence intervals for age-specific proportion of cytology results that were HSIL or worse among women enrolled in the Portland Kaiser Permanente study compared with modeled outputs for women whose screening intensities were derived from national averages. Modeled outputs fall within their respective confidence intervals for all age ranges.
Figure 4
Figure 4
Figure 4
External consistency of model output compared to independent data. (Panels A through D) Black vertical bars represent the 95% confidence intervals of each evaluation target. Dashed orange lines represent the results from matched model outputs in the presence (more ...)
Figure Figure4C4CFigure 4 and and4D4DFigure 4 show the 95% confidence intervals for the proportions of CIN1 and CIN2+ infected with either HPV-16 or HPV-18, or only with other high-risk HPV types, compared with modeled outputs for women whose screening intensities were derived from national averages. Model output is consistent with the general trend of an increasing proportion of neoplasia being infected with HPV-16 or HPV-18 as the severity of neoplasia increases. Although modeled ranges overlap the 95% confidence intervals of the ALTS study, they are wider and more variable for CIN1. For CIN2+, model output is more consistent with the study data.
Figure Figure5A5AFigure 5 shows the range of differences between observed age-specific detected cervical cancer incidence in the presence or absence of screening (from SEER 2003 and IARC 1959–1960, respectively) compared with the modeled outputs for women without screening and those women whose screening intensities were derived from national averages. Ranges from observed and modeled data overlap for all age categories. Even though the modeled ranges overlap for women above 60 years of age, the modeled reduction in age-specific detected cancer incidence tends to be lower than observed values for this age group. Figure Figure5B5BFigure 5 shows a comparison of modeled distribution of stage at detection among women with detected invasive cervical cancer to matched SEER data (1996–2000). Model output is consistent with the SEER cancer stage data.
Figure 5
Figure 5
Figure 5
External consistency of model output compared to independent data. (Panels A and B) Black vertical bars represent the 95% confidence intervals of each evaluation target. Dashed orange lines represent the results from matched model outputs in the presence (more ...)
Impact of uncertainty
Figure Figure66Figure 6 summarizes the distribution across 50 good-fitting parameter sets of cumulative cervical cancer incidence reductions with an HPV-16/18 vaccine, with current screening guidelines carried out at different frequencies, and with combined vaccination and screening. Reductions range from 60 to 88% for HPV vaccination. While the expected reduction in cancer incidence is 75%, parameter uncertainty implies a substantial range of possible benefits: more than 20% of the parameter sets yield reductions in incidence that differ from the mean reduction by more than 10 percentage points. Screening reduces cancer by 76% (range across all 50 parameter sets: 69–82), 69% (60–77), 62% (51–71), and 50% (39–61) for frequencies of every 1, 2, 3, and 5 years, respectively. Model results under frequent screening are less susceptible to parameter uncertainty than less frequent screening or vaccination alone. The range of cancer reduction from screening more frequently than every 3 years exhibits substantial overlap with vaccination. When screening and vaccination are combined cancer incidence reductions are 94% (90–97), 93% (89–97), 91% (86–96), and 89% (83–95) for frequencies of every 1, 2, 3, and 5 years, respectively. Uncertainty is further reduced under combined screening and vaccination programs, and less frequent screening combined with vaccination has expected benefits greater than vaccination alone or yearly screening.
Figure 6
Figure 6
Figure 6
Uncertainty in cancer reduction from alternative prevention strategies. The figure depicts histograms (gray bars) representing the distribution of cancer reductions (x-axes) expected from HPV vaccination, cytology screening at 1, 2, 3, or 5 year intervals, (more ...)
Across parameter sets, estimated cancer reductions associated with screening at different frequencies are significantly positively correlated (Table 3); in other words, those parameter sets yielding high benefits for a given screening frequency also typically indicate high benefits for other screening frequencies as well. This high correlation suggests that factors that influence the effectiveness of screening programs at a variety of screening frequencies (e.g., duration in CIN2,3 prior to progressing to invasive cancer or the proportion of HPV infections of different types leading to CIN) are captured within parameter sets. There is no significant correlation between cancer reductions due to vaccination alone and those due to screening alone at any frequency. While screening strategies achieve benefit by detecting and removing CINs, some of which may have progressed to cancer, vaccination acts to prevent type-specific HPV infection. The pattern of correlation observed is consistent with the observation that uncertainty about HPV infection and clearance is loosely connected to CIN progression and regression. More importantly, vaccination combined with screening provides positive synergy for cancer prevention as evidenced by earlier results that screening alone and vaccination alone both produce substantial cancer reduction, screening alone and vaccination alone are not correlated, and the positive, significant correlation in cancer reduction as screening frequency is increased in the presence of vaccination.
Table 3
Table 3
Pair-wise Correlations between Cancer Reductions due to Vaccination and Screening at Different Frequencies †
Discussion
We systematically calibrated a microsimulation model of HPV and cervical cancer in the United States to multiple epidemiologic studies using a likelihood-based approach. By characterizing uncertainty in disease natural history using a model that includes both vaccination and screening capabilities, we demonstrated the impact of the approach in terms of quantifying the uncertainty about one policy-relevant outcome, the reduction of cervical cancer incidence.
Concordance between modeled age- and HPV type-specific prevalence outcomes was reasonable, with consistent fits achieved for important calibration targets including high-risk HPV prevalence, HPV type distribution within neoplasia and cancer, and cervical cancer incidence. In terms of external consistency, model performance was deemed reasonable by comparison of additional modeled outcomes in the presence of screening to independent studies not used to parameterize the model.
Prior research on model calibration and validation and the quantification of uncertainty has spanned many disease areas and disciplines. Important aspects of this research include data synthesis useful for model parameterization, calibration, and evaluation [105,108-110]; methods to use evidence in model calibration and quantification of parameter uncertainty [111-113]; and methods to alleviate the computational burden associated with all parts of model calibration and validation [114-118].
A broad range of modeling techniques has been used to evaluate cervical cancer screening and vaccination, though researchers have only recently begun to integrate, apply, and extend work on model calibration and validation techniques to models of HPV and cervical cancer [22]. Numerous computer models based on Markov cohorts have evaluated alternative cervical screening policies in the absence of HPV vaccination [10-21]. Additionally a European microsimulation of cervical cancer has been developed [119,120]. Subsequent models considered both screening and vaccination [121-125].
Dynamic transmission models have been reported for Finland [126,127] and the United States [103,128-130]. Key features of dynamic transmission models, which will become more important as data become available on vaccine efficacy in males, include their ability to incorporate the natural history of HPV in men and women, reflect transmission dynamics over time, and endogenously capture herd immunity. Because such models require data on HPV transmission and sexual partnerships data in addition to data on disease natural history, they involve more uncertain parameters, and thus far, have not considered oncogenic HPV types other than HPV-16 and HPV-18.
Several recent studies have undertaken methodological efforts related to those in this study. In a model of HPV in Brazil, Kim et al. [22] used an iterative approach to calibrate a natural history model of cervical cancer to longitudinal data to elucidate the differential impact of selected uncertain assumptions and then employed likelihood-based calibration. Based on data from a Canadian study, Burchell et al. [131] explored heterosexual HPV transmission probabilities, using a stochastic computer simulation to search for transmission probabilities consistent with the study's 95% confidence intervals. The model identified parameter uncertainty for transmission parameters in comparison to one epidemiologic study. Van de Velde et al. [125] calibrated a model of HPV and cervical cancer, identifying multiple parameter sets that fit North American epidemiologic data, including Canadian cancer data. However, their evidence combination methods did not account for differences in study size, and their fitting procedure was not likelihood-based. Like Van de Velde and colleagues, our model's unknown and uncertain inputs are calibrated to observed data, and multiple parameterizations are identified. Like Burchell et al., we identify plausible parameter combinations, relying on a likelihood-based approach to fit model outputs to confidence intervals derived from multiple data sources. Because our model simulates individual women and is analyzed as a first-order Monte Carlo simulation, in addition to capturing the effects of vaccination, it can account for each woman's previous history and allow her history of screening, vaccination, health, and behavior to affect her future risk.
Our study has a number of limitations. While we searched 1,000,000 parameter sets, searching more extensively might yield marginal improvements in fit to the observed data. On the other hand, the data used for calibration come from heterogeneous sources whose evidence is not entirely consistent. Insistence on an exact match to available data may lead to over-fitting and thereby underestimate uncertainty in model outcomes. Another limitation is the availability of data for model design and parameterization. Areas of particular importance include sexual activity patterns and HPV transmission in adolescents, characteristics of natural immunity, and host genetic heterogeneity. Results from our study support the need for further studies of HPV natural history in order to narrow parameter uncertainty. Findings from future studies will likely necessitate updating our current model and parameter estimates through recalibration. While our model can be linked indirectly to a separate dynamic transmission model, it does not directly capture herd immunity effects [103]; we opt instead for a detailed monthly microsimulation that includes multiple HPV types and allows for individual differences in risks and screening patterns based on past history – features that are less readily incorporated into standard dynamic transmission models. Finally, we recognize that a focus on cervical cancer omits the impacts of preventing other rarer cancers that occur in both men and women [132]. This is an important area of future work as better data become available.
Our model makes a set of causal assumptions about the natural history of HPV and cervical cancer, embodied in the model's structure, which are consistent with current biologic understanding of cervical disease. Systematic model calibration results in multiple alternative model parameterizations consistent with epidemiologic data. With our calibrated model, we were able to generate predictions about the effects of screening patterns in the U.S. on HPV, CIN, and cancer that were reasonably consistent with multiple independent studies. The model is not, however, intended as a formal model of causal effect that proves specific relationships in the biology and epidemiology of HPV and cervical cancer. Rather, the model is intended to comment on current questions of policy relevance from a decision analytic standpoint, reflecting the uncertainty in predicted outcomes that exists even in models that are consistent with observed population data.
While we report reasonably favorable model performance results with respect to three large studies not used in parameterization or calibration, model fits to sometimes wide confidence intervals are imperfect. One important future direction would be to continue to refine and expand the set of evaluation targets. When newer data from ongoing population studies of HPV vaccines emerge, they may provide useful opportunities to conduct evaluation exercises with respect to possible changes in the HPV type distribution between unvaccinated and vaccinated cohorts [133]. Another future direction is the assessment of model structure uncertainty. Research in other disease areas has relied largely on review and comparison of cost-effectiveness results to assess the differential effects of model structure assumptions [134-136]. Recent studies have compared alternative model structures developed by different groups [137,138]. Few studies in health-related areas have simultaneously considered model structure and parameter uncertainty [139,140].
Conclusion
Our systematic approach to the parameterization, calibration, and evaluation of a complex microsimulation of HPV and cervical cancer identified many independent natural history parameter sets that fit equally well to multiple epidemiologic targets. As cervical cancer prevention options evolve, and as new evidence becomes available from ongoing studies, an empirically calibrated model is one of many tools that can provide policy-makers with important information on the expected benefits associated with different policies. By conducting comparative analyses of different strategies using a random sample of the good-fitting parameter sets, decision makers are also provided with a description of the uncertainty in policy outcomes that follows from uncertainty in model parameters.
Abbreviations
ALTS – ASCUS/LSIL Triage Study for Cervical Cancer
ASCUS – Atypical squamous cells of unknown significance
CIN – Cervical intraepithelial neoplasia
DNA – Deoxyribonucleic acid
GOF – goodness-of-fit
HPV – Human papillomavirus
HSIL – High-grade squamous intraepithelial lesion
IARC – International Agency for Research on Cancer
LSIL – Low-grade squamous intraepithelial lesion
NCI – National Cancer Institute (United States)
SEER – Surveillance Epidemiology and End Results
US – United States of America
Competing interests
The author(s) declare that they have no competing interests.
Authors' contributions
JGF, NKS, KMK, SJG, and JAS participated in the conception and design of the study. JGF, KMK, and SJG participated in the acquisition of the data. All authors participated in the analysis and interpretation of the data. JGF drafted the initial manuscript. NKS, JO, KMK, SJG, and JAS critically reviewed manuscript and contributed important intellectual content. All authors read and approved the final manuscript.
Supplementary Material
Additional file 1
An individual-based stochastic microsimulation of human papillomavirus and cervical cancer in the United States: Supplemental technical information. The appendix provided includes a supplementary description of the model structure, parameterization, calibration, and evaluation as well as information on the results of calibration and on screening and vaccination strategies used to illustrate the impact of parameter uncertainty, identified via calibration, on the uncertainty of policy-relevant outcomes. The appendix also provides details on other screening strategies implemented in the model useful in further policy analyses of cervical cancer prevention.
Click here for file(1.1M, doc)
Acknowledgements
The authors warmly acknowledge the contributions of the entire cervical cancer prevention team at the Program in Health Decision Science (Harvard School of Public Health) including Jane Kim, Henri Folse, Bethany Andres-Beck, Katie Kobus, Meredith O'Shea, Steven Sweet, Nicole Gastineau Campos, and Mireia Diaz-Sanchis.
This work was supported in part by the National Cancer Institute (R01 CA093435). Jeremy Goldhaber-Fiebert (JGF) is the recipient of the National Science Foundation's Graduate Research Fellowship; Natasha Stout (NS) received support from the Harvard Center for Risk Analysis during her early involvement in this analysis. None of the funders had any role in the conduct of the study; collection, management, analysis, or interpretation of the data; or preparation, review or approval of the manuscript.
References
  • Kitchener HC, Castle PE, Cox JT. Chapter 7: Achievements and limitations of cervical cytology screening. Vaccine. 2006;24:S63–S70. doi: 10.1016/j.vaccine.2006.05.113. [PubMed]
  • Saraiya M, Ahmed F, Krishnan S, Richards TB, Unger ER, Lawson HW. Cervical cancer incidence in a prevaccine era in the United States, 1998–2002. Obstet Gynecol. 2007;109:360–370. [PubMed]
  • Singh GK, Miller BA, Hankey BF, Edwards BK. Persistent area socioeconomic disparities in U.S. incidence of cervical cancer, mortality, stage, and survival, 1975–2000. Cancer. 2004;101:1051–1057. doi: 10.1002/cncr.20467. [PubMed]
  • Yabroff KR, Lawrence WF, King JC, Mangan P, Washington KS, Yi B, Kerner JF, Mandelblatt JS. Geographic disparities in cervical cancer mortality: what are the roles of risk factor prevalence, screening, and use of recommended treatment? J Rural Health. 2005;21:149–157. doi: 10.1111/j.1748-0361.2005.tb00075.x. [PubMed]
  • Koutsky LA, Harper DM. Chapter 13: Current findings from prophylactic HPV vaccine trials. Vaccine. 2006;24:S114–S121. doi: 10.1016/j.vaccine.2006.06.014. [PubMed]
  • Goldie SJ, Goldhaber-Fiebert JD, Garnett GP. Chapter 18: Public health policy for cervical cancer prevention: The role of decision science, economic evaluation, and mathematical modeling. Vaccine. 2006;24:S155–S163. doi: 10.1016/j.vaccine.2006.05.112. [PubMed]
  • Koliopoulos G, Arbyn M, Martin-Hirsch P, Kyrgiou M, Prendiville W, Paraskevaidis E. Diagnostic accuracy of human papillomavirus testing in primary cervical screening: a systematic review and meta-analysis of non-randomized studies. Gynecol Oncol. 2007;104:232–246. doi: 10.1016/j.ygyno.2006.08.053. [PubMed]
  • Cuzick J, Clavel C, Petry KU, Meijer CJ, Hoyer H, Ratnam S, Szarewski A, Birembaut P, Kulasingam S, Sasieni P, Iftner T. Overview of the European and North American studies on HPV testing in primary cervical cancer screening. Int J Cancer. 2006;119:1095–1101. doi: 10.1002/ijc.21955. [PubMed]
  • Prorok PC, Andriole GL, Bresalier RS, Buys SS, Chia D, Crawford ED, Fogel R, Gelmann EP, Gilbert F, Hasson MA, Hayes RB, Johnson CC, Mandel JS, Oberman A, O'Brien B, Oken MM, Rafla S, Reding D, Rutt W, Weissfeld JL, Yokochi L, Gohagan JK. Design of the Prostate, Lung, Colorectal and Ovarian (PLCO) Cancer Screening Trial. Control Clin Trials. 2000;21:273S–309S. doi: 10.1016/S0197-2456(00)00098-2. [PubMed]
  • Bidus MA, Maxwell GL, Kulasingam S, Rose GS, Elkas JC, Chernofsky M, Myers ER. Cost-effectiveness analysis of liquid-based cytology and human papillomavirus testing in cervical cancer screening. Obstet Gynecol. 2006;107:997–1005. [PubMed]
  • Goldie SJ, Weinstein MC, Kuntz KM, Freedberg KA. The costs, clinical benefits, and cost-effectiveness of screening for cervical cancer in HIV-infected women. Ann Intern Med. 1999;130:97–107. [PubMed]
  • Goldie SJ, Kim JJ, Wright TC. Cost-effectiveness of human papillomavirus DNA testing for cervical cancer screening in women aged 30 years or more. Obstet Gynecol. 2004;103:619–631. [PubMed]
  • Goldie SJ, Gaffikin L, Goldhaber-Fiebert JD, Gordillo-Tobar A, Levin C, Mahe C, Wright TC. Cost-effectiveness of cervical-cancer screening in five developing countries. N Engl J Med. 2005;353:2158–2168. doi: 10.1056/NEJMsa044278. [PubMed]
  • Kim JJ, Wright TC, Goldie SJ. Cost-effectiveness of alternative triage strategies for atypical squamous cells of undetermined significance. JAMA. 2002;287:2382–2390. doi: 10.1001/jama.287.18.2382. [PubMed]
  • Kim JJ, Leung GM, Woo PP, Goldie SJ. Cost-effectiveness of organized versus opportunistic cervical cytology screening in Hong Kong. J Public Health (Oxf). 2004;26:130–137. doi: 10.1093/pubmed/fdh138. [PubMed]
  • Kim JJ, Wright TC, Goldie SJ. Cost-effectiveness of human papillomavirus DNA testing in the United Kingdom, The Netherlands, France, and Italy. J Natl Cancer Inst. 2005;97:888–895. [PubMed]
  • Kulasingam SL, Myers ER, Lawson HW, McConnell KJ, Kerlikowske K, Melnikow J, Washington AE, Sawaya GF. Cost-effectiveness of extending cervical cancer screening intervals among women with prior normal pap tests. Obstet Gynecol. 2006;107:321–328. [PubMed]
  • Mandelblatt JS, Lawrence WF, Womack SM, Jacobson D, Yi B, Hwang YT, Gold K, Barter J, Shah K. Benefits and costs of using HPV testing to screen for cervical cancer. JAMA. 2002;287:2372–2381. doi: 10.1001/jama.287.18.2372. [PubMed]
  • Mandelblatt JS, Lawrence WF, Gaffikin L, Limpahayom KK, Lumbiganon P, Warakamin S, King J, Yi B, Ringers P, Blumenthal PD. Costs and benefits of different strategies to screen for cervical cancer in less-developed countries. J Natl Cancer Inst. 2002;94:1469–1483. [PubMed]
  • McCrory DC, Matchar DB, Bastian L, Datta S, Hasselblad V, Hickey J, Myers E, Nanda K. Evaluation of cervical cytology. Evid Rep Technol Assess (Summ). 1999:1–6. [PubMed]
  • Myers ER, McCrory DC, Nanda K, Bastian L, Matchar DB. Mathematical model for the natural history of human papillomavirus infection and cervical carcinogenesis. Am J Epidemiol. 2000;151:1158–1171. [PubMed]
  • Kim JJ, Kuntz KM, Stout NK, Mahmud SM, Villa LL, Franco EL, Goldie SJ. Multi-parameter calibration of a natural history model of cervical cancer. Am J Epidemiol. 2007.
  • Hildesheim A, Schiffman MH, Gravitt PE, Glass AG, Greer CE, Zhang T, Scott DR, Rush BB, Lawler P, Sherman ME. Persistence of type-specific human papillomavirus infection among cytologically normal women. J Infect Dis. 1994;169:235–240. [PubMed]
  • Ho GY, Bierman R, Beardsley L, Chang CJ, Burk RD. Natural history of cervicovaginal papillomavirus infection in young women. N Engl J Med. 1998;338:423–428. doi: 10.1056/NEJM199802123380703. [PubMed]
  • Liu T, Soong SJ, Alvarez RD, Butterworth CE., Jr A longitudinal analysis of human papillomavirus 16 infection, nutritional status, and cervical dysplasia progression. Cancer Epidemiol Biomarkers Prev. 1995;4:373–380. [PubMed]
  • Munoz N, Mendez F, Posso H, Molano M, van den Brule AJ, Ronderos M, Meijer C, Munoz A. Incidence, duration, and determinants of cervical human papillomavirus infection in a cohort of Colombian women with normal cytological results. J Infect Dis. 2004;190:2077–2087. doi: 10.1086/425907. [PubMed]
  • Sun XW, Kuhn L, Ellerbrock TV, Chiasson MA, Bush TJ, Wright TC., Jr Human papillomavirus infection in women infected with the human immunodeficiency virus. N Engl J Med. 1997;337:1343–1349. doi: 10.1056/NEJM199711063371903. [PubMed]
  • Ellerbrock TV, Chiasson MA, Bush TJ, Sun XW, Sawo D, Brudney K, Wright TC., Jr Incidence of cervical squamous intraepithelial lesions in HIV-infected women. JAMA. 2000;283:1031–1037. doi: 10.1001/jama.283.8.1031. [PubMed]
  • Ho GY, Burk RD, Klein S, Kadish AS, Chang CJ, Palan P, Basu J, Tachezy R, Lewis R, Romney S. Persistent genital human papillomavirus infection as a risk factor for persistent cervical dysplasia. J Natl Cancer Inst. 1995;87:1365–1371. doi: 10.1093/jnci/87.18.1365. [PubMed]
  • Ho GY, Kadish AS, Burk RD, Basu J, Palan PR, Mikhail M, Romney SL. HPV 16 and cigarette smoking as risk factors for high-grade cervical intra-epithelial neoplasia. Int J Cancer. 1998;78:281–285. doi: 10.1002/(SICI)1097-0215(19981029)78:3<281::AID-IJC3>3.0.CO;2-R. [PubMed]
  • Hopman EH, Rozendaal L, Voorhorst FJ, Walboomers JM, Kenemans P, Helmerhorst TJ. High risk human papillomavirus in women with normal cervical cytology prior to the development of abnormal cytology and colposcopy. BJOG. 2000;107:600–604. doi: 10.1111/j.1471-0528.2000.tb13299.x. [PubMed]
  • Koutsky LA, Holmes KK, Critchlow CW, Stevens CE, Paavonen J, Beckmann AM, DeRouen TA, Galloway DA, Vernon D, Kiviat NB. A cohort study of the risk of cervical intraepithelial neoplasia grade 2 or 3 in relation to papillomavirus infection. N Engl J Med. 1992;327:1272–1278. [PubMed]
  • Londesborough P, Ho L, Terry G, Cuzick J, Wheeler C, Singer A. Human papillomavirus genotype as a predictor of persistence and development of high-grade lesions in women with minor cervical abnormalities. Int J Cancer. 1996;69:364–368. doi: 10.1002/(SICI)1097-0215(19961021)69:5<364::AID-IJC2>3.0.CO;2-3. [PubMed]
  • Nobbenhuis MA, Walboomers JM, Helmerhorst TJ, Rozendaal L, Remmink AJ, Risse EK, van der Linden HC, Voorhorst FJ, Kenemans P, Meijer CJ. Relation of human papillomavirus status to cervical lesions and consequences for cervical-cancer screening: a prospective study. Lancet. 1999;354:20–25. doi: 10.1016/S0140-6736(98)12490-X. [PubMed]
  • Remmink AJ, Walboomers JM, Helmerhorst TJ, Voorhorst FJ, Rozendaal L, Risse EK, Meijer CJ, Kenemans P. The presence of persistent high-risk HPV genotypes in dysplastic cervical lesions is associated with progressive disease: natural history up to 36 months. Int J Cancer. 1995;61:306–311. doi: 10.1002/ijc.2910610305. [PubMed]
  • Rozendaal L, Walboomers JM, van der Linden JC, Voorhorst FJ, Kenemans P, Helmerhorst TJ, van BM, Meijer CJ. PCR-based high-risk HPV test in cervical cancer screening gives objective risk assessment of women with cytomorphologically normal cervical smears. Int J Cancer. 1996;68:766–769. doi: 10.1002/(SICI)1097-0215(19961211)68:6<766::AID-IJC13>3.0.CO;2-Z. [PubMed]
  • Syrjanen K, Kataja V, Yliskoski M, Chang F, Syrjanen S, Saarikoski S. Natural history of cervical human papillomavirus lesions does not substantiate the biologic relevance of the Bethesda System. Obstet Gynecol. 1992;79:675–682. [PubMed]
  • Melnikow J, Nuovo J, Willan AR, Chan BK, Howell LP. Natural history of cervical squamous intraepithelial lesions: a meta-analysis. Obstet Gynecol. 1998;92:727–735. doi: 10.1016/S0029-7844(98)00245-2. [PubMed]
  • Ostor AG. Natural history of cervical intraepithelial neoplasia: a critical review. Int J Gynecol Pathol. 1993;12:186–192. doi: 10.1097/00004347-199304000-00018. [PubMed]
  • Franco EL, Villa LL, Sobrinho JP, Prado JM, Rousseau MC, Desy M, Rohan TE. Epidemiology of acquisition and clearance of cervical human papillomavirus infection in women from a high-risk area for cervical cancer. J Infect Dis. 1999;180:1415–1423. doi: 10.1086/315086. [PubMed]
  • Schlecht NF, Platt RW, Duarte-Franco E, Costa MC, Sobrinho JP, Prado JC, Ferenczy A, Rohan TE, Villa LL, Franco EL. Human papillomavirus infection and time to progression and regression of cervical intraepithelial neoplasia. J Natl Cancer Inst. 2003;95:1336–1343. [PubMed]
  • Surveillance, Epidemiology, End Results (SEER) Cancer Statistics Review, 1975–2001. http://seer.cancer.gov/csr/1975_2001/
  • Cancer Incidence in Five Continents. New York: International Union against Cancer, Springer-Verlag; 1966.
  • US Lifetables for Females. http://www.cdc.gov/nchs/products/pubs/pubd/lftbls/lftbls.htm
  • CDC/DPH. Multi-Center HPV and Cytology Primary Data. 2005.
  • Bauer HM, Hildesheim A, Schiffman MH, Glass AG, Rush BB, Scott DR, Cadell DM, Kurman RJ, Manos MM. Determinants of genital human papillomavirus infection in low-risk women in Portland, Oregon. Sex Transm Dis. 1993;20:274–278. [PubMed]
  • Brown DR, Shew ML, Qadadri B, Neptune N, Vargas M, Tu W, Juliar BE, Breen TE, Fortenberry JD. A longitudinal study of genital human papillomavirus infection in a cohort of closely followed adolescent women. J Infect Dis. 2005;191:182–192. doi: 10.1086/426867. [PubMed]
  • Burk RD, Kelly P, Feldman J, Bromberg J, Vermund SH, DeHovitz JA, Landesman SH. Declining prevalence of cervicovaginal human papillomavirus infection with age is independent of other risk factors. Sex Transm Dis. 1996;23:333–341. [PubMed]
  • Chaturvedi AK, Dumestre J, Gaffga AM, Mire KM, Clark RA, Braly PS, Dunlap K, Beckel TE, Hammons AF, Kissinger PJ, Hagensee ME. Prevalence of human papillomavirus genotypes in women from three clinical settings. J Med Virol. 2005;75:105–113. doi: 10.1002/jmv.20244. [PubMed]
  • Giuliano AR, Papenfuss M, Abrahamsen M, Denman C, de Zapien JG, Henze JL, Ortega L, Brown de Galaz EM, Stephan J, Feng J, Baldwin S, Garcia F, Hatch K. Human papillomavirus infection at the United States-Mexico border: implications for cervical cancer prevention and control. Cancer Epidemiol Biomarkers Prev. 2001;10:1129–1136. [PubMed]
  • Hildesheim A, Gravitt P, Schiffman MH, Kurman RJ, Barnes W, Jones S, Tchabo JG, Brinton LA, Copeland C, Epp J. Determinants of genital human papillomavirus infection in low-income women in Washington, D.C. Sex Transm Dis. 1993;20:279–285. [PubMed]
  • Jacobson DL, Womack SD, Peralta L, Zenilman JM, Feroli K, Maehr J, Daniel RW, Shah KV. Concordance of human papillomavirus in the cervix and urine among inner city adolescents. Pediatr Infect Dis J. 2000;19:722–728. [PubMed]
  • Kotloff KL, Wasserman SS, Russ K, Shapiro S, Daniel R, Brown W, Frost A, Tabara SO, Shah K. Detection of genital human papillomavirus and associated cytological abnormalities among college women. Sex Transm Dis. 1998;25:243–250. doi: 10.1097/00007435-199805000-00005. [PubMed]
  • Ley C, Bauer HM, Reingold A, Schiffman MH, Chambers JC, Tashiro CJ, Manos MM. Determinants of genital human papillomavirus infection in young women. J Natl Cancer Inst. 1991;83:997–1003. doi: 10.1093/jnci/83.14.997. [PubMed]
  • Moscicki AB. Genital HPV infections in children and adolescents. Obstet Gynecol Clin North Am. 1996;23:675–697. [PubMed]
  • Moscicki AB, Ellenberg JH, Vermund SH, Holland CA, Darragh T, Crowley-Nowick PA, Levin L, Wilson CM. Prevalence of and risks for cervical human papillomavirus infection and squamous intraepithelial lesions in adolescent girls: impact of infection with human immunodeficiency virus. Arch Pediatr Adolesc Med. 2000;154:127–134. [PubMed]
  • Peyton CL, Gravitt PE, Hunt WC, Hundley RS, Zhao M, Apple RJ, Wheeler CM. Determinants of genital human papillomavirus detection in a US population. J Infect Dis. 2001;183:1554–1564. doi: 10.1086/320696. [PubMed]
  • Sellors JW, Mahony JB, Kaczorowski J, Lytwyn A, Bangura H, Chong S, Lorincz A, Dalby DM, Janjusevic V, Keller JL. Prevalence and predictors of human papillomavirus infection in women in Ontario, Canada. Survey of HPV in Ontario Women (SHOW) Group. CMAJ. 2000;163:503–508. [PubMed]
  • Sellors JW, Karwalajtys TL, Kaczorowski JA, Mahony JB, Lytwyn A, Chong S, Sparrow J, Lorincz A. Prevalence of infection with carcinogenic human papillomavirus among older women. CMAJ. 2002;167:871–873. [PubMed]
  • Smith EM, Ritchie JM, Levy BT, Zhang W, Wang D, Haugen TH, Turek LP. Prevalence and persistence of human papillomavirus in postmenopausal age women. Cancer Detect Prev. 2003;27:472–480. doi: 10.1016/S0361-090X(03)00104-1. [PubMed]
  • Tarkowski TA, Koumans EH, Sawyer M, Pierce A, Black CM, Papp JR, Markowitz L, Unger ER. Epidemiology of human papillomavirus infection and abnormal cytologic test results in an urban adolescent population. J Infect Dis. 2004;189:46–50. doi: 10.1086/380466. [PubMed]
  • Benard VB, Eheman CR, Lawson HW, Blackman DK, Anderson C, Helsel W, Thames SF, Lee NC. Cervical screening in the National Breast and Cervical Cancer Early Detection Program, 1995–2001. Obstet Gynecol. 2004;103:564–571. [PubMed]
  • Bibbo M, Keebler CM, Wied GL. Prevalence and incidence rates of cervical atypia. A computerized file analysis of 148,735 patients. J Reprod Med. 1971;6:184–188. [PubMed]
  • Halcon LL, Lifson AR, Shew M, Joseph M, Hannan PJ, Hayman CR. Pap test results among low-income youth: prevalence of dysplasia and practice implications. J Obstet Gynecol Neonatal Nurs. 2002;31:294–304. doi: 10.1111/j.1552-6909.2002.tb00051.x. [PubMed]
  • Insinga RP, Glass AG, Rush BB. Diagnoses and outcomes in cervical cancer screening: a population-based study. Am J Obstet Gynecol. 2004;191:105–113. doi: 10.1016/j.ajog.2004.01.043. [PubMed]
  • Lawson HW, Lee NC, Thames SF, Henson R, Miller DS. Cervical cancer screening among low-income women: results of a national screening program, 1991–1995. Obstet Gynecol. 1998;92:745–752. doi: 10.1016/S0029-7844(98)00257-9. [PubMed]
  • Mangan SA, Legano LA, Rosen CM, McHugh MT, Fierman AH, Dreyer BP, Palusci VJ, Winkler B. Increased prevalence of abnormal Papanicolaou smears in urban adolescents. Arch Pediatr Adolesc Med. 1997;151:481–484. [PubMed]
  • Sadeghi SB, Hsieh EW, Gunn SW. Prevalence of cervical intraepithelial neoplasia in sexually active teenagers and young adults. Results of data analysis of mass Papanicolaou screening of 796,337 women in the United States in 1981. Am J Obstet Gynecol. 1984;148:726–729. [PubMed]
  • Sadeghi SB, Sadeghi A, Robboy SJ. Prevalence of dysplasia and cancer of the cervix in a nationwide, planned parenthood population. Cancer. 1988;61:2359–2361. doi: 10.1002/1097-0142(19880601)61:11<2359::AID-CNCR2820611135>3.0.CO;2-7. [PubMed]
  • Snyder RN, Ortiz Y, Willie S, Cove JK. Dysplasia and carcinoma in situ of the uterine cervix: prevalence in very young women (under age 22). A one-year study in a health plan population. Am J Obstet Gynecol. 1976;124:751–756. [PubMed]
  • Stany MP, Bidus MA, Reed EJ, Kaplan KJ, McHale MT, Rose GS, Elkas JC. The prevalence of HR-HPV DNA in ASC-US Pap smears: A military population study. Gynecol Oncol. 2006;101:82–85. doi: 10.1016/j.ygyno.2005.09.050. [PubMed]
  • Adam E, Kaufman RH, Berkova Z, Icenogle J, Reeves WC. Is human papillomavirus testing an effective triage method for detection of high-grade (grade 2 or 3) cervical intraepithelial neoplasia? Am J Obstet Gynecol. 1998;178:1235–1244. doi: 10.1016/S0002-9378(98)70328-X. [PubMed]
  • Aoyama C, Peters J, Senadheera S, Liu P, Shimada H. Uterine cervical dysplasia and cancer: identification of c-myc status by quantitative polymerase chain reaction. Diagn Mol Pathol. 1998;7:324–330. doi: 10.1097/00019606-199812000-00006. [PubMed]
  • Bosch FX, Manos MM, Munoz N, Sherman M, Jansen AM, Peto J, Schiffman MH, Moreno V, Kurman R, Shah KV. Prevalence of human papillomavirus in cervical cancer: a worldwide perspective. International biological study on cervical cancer (IBSCC) Study Group. J Natl Cancer Inst. 1995;87:796–802. doi: 10.1093/jnci/87.11.796. [PubMed]
  • Brown DR, Legge D, Qadadri B. Distribution of human papillomavirus types in cervicovaginal washings from women evaluated in a sexually transmitted diseases clinic. Sex Transm Dis. 2002;29:763–768. doi: 10.1097/00007435-200212000-00005. [PubMed]
  • Burger RA, Monk BJ, Kurosaki T, nton-Culver H, Vasilev SA, Berman ML, Wilczynski SP. Human papillomavirus type 18: association with poor prognosis in early stage cervical cancer. J Natl Cancer Inst. 1996;88:1361–1368. doi: 10.1093/jnci/88.19.1361. [PubMed]
  • Burnett AF, Barnes WA, Johnson JC, Grendys E, Willett GD, Barter JF, Doniger J. Prognostic significance of polymerase chain reaction detected human papillomavirus of tumors and lymph nodes in surgically treated stage IB cervical cancer. Gynecol Oncol. 1992;47:343–347. doi: 10.1016/0090-8258(92)90137-8. [PubMed]
  • Cox JT, Schiffman M, Solomon D. Prospective follow-up suggests similar risk of subsequent cervical intraepithelial neoplasia grade 2 or 3 among women with cervical intraepithelial neoplasia grade 1 or negative colposcopy and directed biopsy. Am J Obstet Gynecol. 2003;188:1406–1412. doi: 10.1067/mob.2003.461. [PubMed]
  • Evans MF, Mount SL, Beatty BG, Cooper K. Biotinyl-tyramide-based in situ hybridization signal patterns distinguish human papillomavirus type and grade of cervical intraepithelial neoplasia. Mod Pathol. 2002;15:1339–1347. doi: 10.1038/modpathol.3880698. [PubMed]
  • Jarboe EA, Thompson LC, Heinz D, McGregor JA, Shroyer KR. Telomerase and human papillomavirus as diagnostic adjuncts for cervical dysplasia and carcinoma. Hum Pathol. 2004;35:396–402. doi: 10.1016/j.humpath.2003.08.028. [PubMed]
  • Liaw KL, Glass AG, Manos MM, Greer CE, Scott DR, Sherman M, Burk RD, Kurman RJ, Wacholder S, Rush BB, Cadell DM, Lawler P, Tabor D, Schiffman M. Detection of human papillomavirus DNA in cytologically normal women and subsequent cervical squamous intraepithelial lesions. J Natl Cancer Inst. 1999;91:954–960. doi: 10.1093/jnci/91.11.954. [PubMed]
  • Paquette RL, Lee YY, Wilczynski SP, Karmakar A, Kizaki M, Miller CW, Koeffler HP. Mutations of p53 and human papillomavirus infection in cervical carcinoma. Cancer. 1993;72:1272–1280. doi: 10.1002/1097-0142(19930815)72:4<1272::AID-CNCR2820720420>3.0.CO;2-Q. [PubMed]
  • Resnick RM, Cornelissen MT, Wright DK, Eichinger GH, Fox HS, ter SJ, Manos MM. Detection and typing of human papillomavirus in archival cervical cancer specimens by DNA amplification with consensus primers. J Natl Cancer Inst. 1990;82:1477–1484. doi: 10.1093/jnci/82.18.1477. [PubMed]
  • Richardson H, Kelsall G, Tellier P, Voyer H, Abrahamowicz M, Ferenczy A, Coutlee F, Franco EL. The natural history of type-specific human papillomavirus infections in female university students. Cancer Epidemiol Biomarkers Prev. 2003;12:485–490. [PubMed]
  • Schiff M, Miller J, Masuk M, van Asselt KL, Altobelli KK, Wheeler CM, Becker TM. Contraceptive and reproductive risk factors for cervical intraepithelial neoplasia in American Indian women. Int J Epidemiol. 2000;29:983–990. doi: 10.1093/ije/29.6.983. [PubMed]
  • Schwartz SM, Daling JR, Shera KA, Madeleine MM, McKnight B, Galloway DA, Porter PL, McDougall JK. Human papillomavirus and prognosis of invasive cervical cancer: a population-based study. J Clin Oncol. 2001;19:1906–1915. [PubMed]
  • Sebbelov AM, Davidson M, Kruger KS, Jensen H, Gregoire L, Hawkins I, Parkinson AJ, Norrild B. Comparison of human papillomavirus genotypes in archival cervical cancer specimens from Alaska natives, Greenland natives and Danish Caucasians. Microbes Infect. 2000;2:121–126. doi: 10.1016/S1286-4579(00)00276-8. [PubMed]
  • Sellors JW, Lorincz AT, Mahony JB, Mielzynska I, Lytwyn A, Roth P, Howard M, Chong S, Daya D, Chapman W, Chernesky M. Comparison of self-collected vaginal, vulvar and urine samples with physician-collected cervical samples for human papillomavirus testing to detect high-grade squamous intraepithelial lesions. CMAJ. 2000;163:513–518. [PubMed]
  • Tran-Thanh D, Provencher D, Koushik A, Duarte-Franco E, Kessous A, Drouin P, Wheeler CM, Dubuc-Lissoir J, Gauthier P, Allaire G, Vauclair R, Dipaolo JA, Gravitt P, Franco E, Coutlee F. Herpes simplex virus type II is not a cofactor to human papillomavirus in cancer of the uterine cervix. Am J Obstet Gynecol. 2003;188:129–134. doi: 10.1067/mob.2003.66. [PubMed]
  • Wistuba II, Montellano FD, Milchgrub S, Virmani AK, Behrens C, Chen H, Ahmadian M, Nowak JA, Muller C, Minna JD, Gazdar AF. Deletions of chromosome 3p are frequent and early events in the pathogenesis of uterine cervical carcinoma. Cancer Res. 1997;57:3154–3158. [PubMed]
  • Clifford GM, Smith JS, Aguado T, Franceschi S. Comparison of HPV type distribution in high-grade cervical lesions and cervical cancer: a meta-analysis. Br J Cancer. 2003;89:101–105. doi: 10.1038/sj.bjc.6601024. [PubMed]
  • Clifford GM, Smith JS, Plummer M, Munoz N, Franceschi S. Human papillomavirus types in invasive cervical cancer worldwide: a meta-analysis. Br J Cancer. 2003;88:63–73. doi: 10.1038/sj.bjc.6600688. [PubMed]
  • Clifford GM, Rana RK, Franceschi S, Smith JS, Gough G, Pimenta JM. Human papillomavirus genotype distribution in low-grade cervical lesions: comparison by geographic region and with cervical cancer. Cancer Epidemiol Biomarkers Prev. 2005;14:1157–1164. doi: 10.1158/1055-9965.EPI-04-0812. [PubMed]
  • Kulasingam SL, Hughes JP, Kiviat NB, Mao C, Weiss NS, Kuypers JM, Koutsky LA. Evaluation of human papillomavirus testing in primary screening for cervical abnormalities: comparison of sensitivity, specificity, and frequency of referral. JAMA. 2002;288:1749–1757. doi: 10.1001/jama.288.14.1749. [PubMed]
  • Khan MJ, Castle PE, Lorincz AT, Wacholder S, Sherman M, Scott DR, Rush BB, Glass AG, Schiffman M. The elevated 10-year risk of cervical precancer and cancer in women with human papillomavirus (HPV) type 16 or 18 and the possible utility of type-specific HPV testing in clinical practice. J Natl Cancer Inst. 2005;97:1072–1079. [PubMed]
  • Schiffman M, Adrianza ME. ASCUS-LSIL Triage Study. Design, methods and characteristics of trial participants. Acta Cytol. 2000;44:726–742. [PubMed]
  • Surveillance, Epidemiology, and End Results (SEER) Program SEER*Stat Database: Incidence – SEER 9 Regs Public-Use (Nov 2004 Sub (1973–2003) based on the November 2005 submission) . National Cancer Institute, DCCPS, Surveillance Research Program, Cancer Statistics Branch; 2006.
  • Hewitt M, Devesa SS, Breen N. Cervical cancer screening among U.S. women: analyses of the 2000 National Health Interview Survey. Prev Med. 2004;39:270–278. doi: 10.1016/j.ypmed.2004.03.035. [PubMed]
  • Parazzini F, Hildesheim A, Ferraroni M, La VC, Brinton LA. Relative and attributable risk for cervical cancer: a comparative study in the United States and Italy. Int J Epidemiol. 1990;19:539–545. doi: 10.1093/ije/19.3.539. [PubMed]
  • Schairer C, Brinton LA, Devesa SS, Ziegler RG, Fraumeni JF., Jr Racial differences in the risk of invasive squamous-cell cervical cancer. Cancer Causes Control. 1991;2:283–290. doi: 10.1007/BF00051667. [PubMed]
  • Shields TS, Brinton LA, Burk RD, Wang SS, Weinstein SJ, Ziegler RG, Studentsov YY, McAdams M, Schiffman M. A case-control study of risk factors for invasive cervical cancer among U.S. women exposed to oncogenic types of human papillomavirus. Cancer Epidemiol Biomarkers Prev. 2004;13:1574–1582. [PubMed]
  • Sirovich BE, Welch HG. The frequency of Pap smear screening in the United States. J Gen Intern Med. 2004;19:243–250. doi: 10.1111/j.1525-1497.2004.21107.x. [PubMed]
  • Kim JJ, Folse H, Murray M, Goldie SJ. Should Men Be Included in a Vaccination Program Against HPV Infection in a Resource-Constrained Setting? International Papillomavirus Conference and Clinical Workshop, Prague, Czech Republic;
  • Agresti A, Coull B. Approximate is better than "exact" for interval estimation of binomial proportions. The American Statistician. 1998;52:119–126. doi: 10.2307/2685469.
  • Systematic reviews in health care: meta-analysis in context. London: BMJ; 2001.
  • Fay MP, Pfeiffer R, Cronin KA, Le C, Feuer EJ. Age-conditional probabilities of developing cancer. Stat Med. 2003;22:1837–1848. doi: 10.1002/sim.1428. [PubMed]
  • Fay MP. Estimating age conditional probability of developing disease from surveillance data. Popul Health Metr. 2004;2:6. doi: 10.1186/1478-7954-2-6. [PubMed]
  • Ades AE, Sculpher M, Sutton A, Abrams K, Cooper N, Welton N, Lu G. Bayesian methods for evidence synthesis in cost-effectiveness analysis. Pharmacoeconomics. 2006;24:1–19. doi: 10.2165/00019053-200624010-00001. [PubMed]
  • Ades AE, Claxton K, Sculpher M. Evidence synthesis, parameter correlation and probabilistic sensitivity analysis. Health Econ. 2006;15:373–381. doi: 10.1002/hec.1068. [PubMed]
  • McMahon PM, Zaslavsky AM, Weinstein MC, Kuntz KM, Weeks JC, Gazelle GS. Estimation of mortality rates for disease simulation models using Bayesian evidence synthesis. Med Decis Making. 2006;26:497–511. doi: 10.1177/0272989X06291326. [PubMed]
  • Salomon JA, Weinstein MC, Hammitt JK, Goldie SJ. Empirically calibrated model of hepatitis C virus infection in the United States. Am J Epidemiol. 2002;156:761–773. doi: 10.1093/aje/kwf100. [PubMed]
  • Fryback DG, Stout NK, Rosenberg MA, Trentham-Dietz A, Kuruchittham V, Remington PL. The Wisconsin Breast Cancer Epidemiology Simulation Model. J Natl Cancer Inst Monogr. 2006:37–47. [PubMed]
  • Berry DA, Inoue L, Shen Y, Venier J, Cohen D, Bondy M, Theriault R, Munsell MF. Modeling the impact of treatment and screening on U.S. breast cancer mortality: a Bayesian approach. J Natl Cancer Inst Monogr. 2006:30–36. [PubMed]
  • Law AM, Kelton WD. Simulation Modeling and Analysis. Boston: McGraw-Hill; 2000.
  • Rodriguez-Fernandez M, Egea JA, Banga JR. Novel metaheuristic for parameter estimation in nonlinear dynamic biological systems. BMC Bioinformatics. 2006;7:483. doi: 10.1186/1471-2105-7-483. [PubMed]
  • Stevenson MD, Oakley J, Chilcott JB. Gaussian process modeling in conjunction with individual patient simulation modeling: a case study describing the calculation of cost-effectiveness ratios for the treatment of established osteoporosis. Med Decis Making. 2004;24:89–100. doi: 10.1177/0272989X03261561. [PubMed]
  • O'hagan A, Stevenson M, Madan J. Monte Carlo probabilistic sensitivity analysis for patient level simulation models: efficient estimation of mean and variance using ANOVA. Health Econ. 2007;16:1009–1023. doi: 10.1002/hec.1199. [PubMed]
  • Shechter SM, Schaefer AJ, Braithwaite RS, Roberts MS. Increasing the efficiency of Monte Carlo cohort simulations with variance reduction techniques. Med Decis Making. 2006;26:550–553. doi: 10.1177/0272989X06290489. [PubMed]
  • Habbema JD, van Oortmarssen GJ, Lubbe JT, van der Maas PJ. Model building on the basis of Dutch cervical cancer screening data. Maturitas. 1985;7:11–20. doi: 10.1016/0378-5122(85)90030-1. [PubMed]
  • van den Akker-van Marle M, van BM, van Oortmarssen GJ, Boer R, Habbema JD. Cost-effectiveness of cervical cancer screening: comparison of screening policies. J Natl Cancer Inst. 2002;94:193–204. [PubMed]
  • Goldie SJ, Grima D, Kohli M, Wright TC, Weinstein M, Franco E. A comprehensive natural history model of HPV infection and cervical cancer to estimate the clinical impact of a prophylactic HPV-16/18 vaccine. Int J Cancer. 2003;106:896–904. doi: 10.1002/ijc.11334. [PubMed]
  • Goldie SJ, Kohli M, Grima D, Weinstein MC, Wright TC, Bosch FX, Franco E. Projected clinical benefits and cost-effectiveness of a human papillomavirus 16/18 vaccine. J Natl Cancer Inst. 2004;96:604–615. [PubMed]
  • Kulasingam SL, Myers ER. Potential health and economic impact of adding a human papillomavirus vaccine to screening programs. JAMA. 2003;290:781–789. doi: 10.1001/jama.290.6.781. [PubMed]
  • Sanders GD, Taira AV. Cost-effectiveness of a potential vaccine for human papillomavirus. Emerg Infect Dis. 2003;9:37–48. [PubMed]
  • Van de Velde N, Brisson M, Boily MC. Modeling Human Papillomavirus Vaccine Effectiveness: Quantifying the Impact of Parameter Uncertainty. Am J Epidemiol. 2007 [PubMed]
  • Barnabas RV, Laukkanen P, Koskela P, Kontula O, Lehtinen M, Garnett GP. Epidemiology of HPV 16 and cervical cancer in Finland and the potential impact of vaccination: mathematical modelling analyses. PLoS Med. 2006;3:e138. doi: 10.1371/journal.pmed.0030138. [PubMed]
  • French KM, Barnabas RV, Lehtinen M, Kontula O, Pukkala E, Dillner J, Garnett GP. Strategies for the introduction of human papillomavirus vaccination: modelling the optimum age- and sex-specific pattern of vaccination in Finland. Br J Cancer. 2007;96:514–518. doi: 10.1038/sj.bjc.6603575. [PubMed]
  • Elbasha EH, Dasbach EJ, Insinga RP. Model for Assessing Human Papillomavirus Vaccination Strategies. Emerg Infect Dis. 2007;13:28–41. [PubMed]
  • Taira AV, Neukermans CP, Sanders GD. Evaluating human papillomavirus vaccination programs. Emerg Infect Dis. 2004;10:1915–1923. [PubMed]
  • Hughes JP, Garnett GP, Koutsky L. The theoretical population-level impact of a prophylactic human papilloma virus vaccine. Epidemiology. 2002;13:631–639. doi: 10.1097/00001648-200211000-00006. [PubMed]
  • Burchell AN, Richardson H, Mahmud SM, Trottier H, Tellier PP, Hanley J, Coutlee F, Franco EL. Modeling the sexual transmissibility of human papillomavirus infection using stochastic computer simulation and empirical data from a cohort study of young women in Montreal, Canada. Am J Epidemiol. 2006;163:534–543. doi: 10.1093/aje/kwj077. [PubMed]
  • Parkin DM, Bray F. Chapter 2: The burden of HPV-related cancers. Vaccine. 2006;24:S11–S25. doi: 10.1016/j.vaccine.2006.05.111. [PubMed]
  • Dunne EF, Unger ER, Sternberg M, McQuillan G, Swan DC, Patel SS, Markowitz LE. Prevalence of HPV Infection Among Females in the United States. JAMA. 2007;297:813–819. doi: 10.1001/jama.297.8.813. [PubMed]
  • Campbell H, Briggs A, Buxton M, Kim L, Thompson S. The credibility of health economic models for health policy decision-making: the case of population screening for abdominal aortic aneurysm. J Health Serv Res Policy. 2007;12:11–17. doi: 10.1258/135581907779497594. [PubMed]
  • Baggaley RF, Ferguson NM, Garnett GP. The epidemiological impact of antiretroviral use predicted by mathematical models: a review. Emerg Themes Epidemiol. 2005;2:9. doi: 10.1186/1742-7622-2-9. [PubMed]
  • Brown ML, Fintor L. Cost-effectiveness of breast cancer screening: preliminary results of a systematic review of the literature. Breast Cancer Res Treat. 1993;25:113–118. doi: 10.1007/BF00662136. [PubMed]
  • Berry DA, Cronin KA, Plevritis SK, Fryback DG, Clarke L, Zelen M, Mandelblatt JS, Yakovlev AY, Habbema JD, Feuer EJ. Effect of screening and adjuvant therapy on mortality from breast cancer. N Engl J Med. 2005;353:1784–1792. doi: 10.1056/NEJMoa050518. [PubMed]
  • Cronin KA, Feuer EJ, Clarke LD, Plevritis SK. Impact of adjuvant therapy and mammography on U.S. mortality from 1975 to 2000: comparison of mortality results from the cisnet breast cancer base case analysis. J Natl Cancer Inst Monogr. 2006:112–121. [PubMed]
  • Hojberg AL, Refsgaard JC. Model uncertainty – parameter uncertainty versus conceptual models. Water Sci Technol. 2005;52:177–186. [PubMed]
  • Brisson M, Edmunds WJ. Impact of model, methodological, and parameter uncertainty in the economic analysis of vaccination programs. Med Decis Making. 2006;26:434–446. doi: 10.1177/0272989X06290485. [PubMed]
Articles from Population Health Metrics are provided here courtesy of
BioMed Central

Links
See more articles cited in this paragraph
See more articles cited in this paragraph
See more articles cited in this paragraph
See more articles cited in this paragraph
See more articles cited in this paragraph
See more articles cited in this paragraph
See more articles cited in this paragraph
See more articles cited in this paragraph
See more articles cited in this paragraph
See more articles cited in this paragraph
See more articles cited in this paragraph
See more articles cited in this paragraph
See more articles cited in this paragraph
See more articles cited in this paragraph
See more articles cited in this paragraph