NCBI » Bookshelf » Health Services/Technology Assessment Text (HSTAT) » AHRQ Evidence Reports » Hereditary Nonpolyposis Colorectal Cancer: Diagnostic Strategies and Their Implications
 
hserta
AHRQ Evidence Reports
public health

Chapter  150:  Hereditary Nonpolyposis Colorectal Cancer: Diagnostic Strategies and Their Implications

A235754

Prepared for:

Agency for Healthcare Research and Quality

U.S. Department of Health and Human Services

540 Gaither Road

Rockville, MD 20850

www.ahrq.gov

Contract No. 290-02-0022

Prepared by:

Tufts-New England Medical Center Evidence Based Practice Center, Boston, Massachusetts

Investigators

Peter A. Bonis, M.D., Principal Investigator

Thomas A. Trikalinos, M.D., Investigator

Mei Chung, M.P.H., Investigator

Priscilla Chew, M.P.H., Investigator

Stanley Ip, M.D., Investigator

Deirdre A. DeVine, M.Litt., Project Manager

Joseph Lau, M.D., Project Director

AHRQ Publication No. 07-E008

May 2007

This document is in the public domain and may be used and reprinted without permission except those copyrighted materials noted for which further reproduction is prohibited without the specific permission of copyright holders.

Suggested Citation:

Bonis PA, Trikalinos TA, Chung M, Chew P, Ip S, DeVine D, Lau J. Hereditary Nonpolyposis Colorectal Cancer: Diagnostic Strategies and Their Implications. Evidence Report/Technology Assessment No. 150 (Prepared by Tufts-New England Medical Center Evidence-based Practice Center under Contract No. 290-02-0022). AHRQ Publication No. 07-E008. Rockville, MD: Agency for Healthcare Research and Quality. May 2007.

This report is based on research conducted by the Tufts-New England Medical Center Evidence-based Practice Center (EPC) under contract to the Agency for Healthcare Research and Quality (AHRQ), Rockville, MD (Contract No. 290-02-0022). The findings and conclusions in this document are those of the author(s), who are responsible for its contents, and do not necessarily represent the views of AHRQ. No statement in this report should be construed as an official position of AHRQ or of the U.S. Department of Health and Human Services.

The information in this report is intended to help clinicians, employers, policymakers, and others make informed decisions about the provision of health care services. This report is intended as a reference and not as a substitute for clinical judgment.

This report may be used, in whole or in part, as the basis for development of clinical practice guidelines and other quality enhancement tools, or as a basis for reimbursement and coverage policies. AHRQ or U.S. Department of Health and Human Services endorsement of such derivative products may not be stated or implied.

None of the investigators has any affiliations or financial involvement that conflicts with the material presented in this report.

Prepared for:

Agency for Healthcare Research and Quality

U.S. Department of Health and Human Services

540 Gaither Road

Rockville, MD 20850

www.ahrq.gov

Contract No. 290-02-0022

Prepared by:

Tufts-New England Medical Center Evidence Based Practice Center, Boston, Massachusetts

Investigators

Peter A. Bonis, M.D., Principal Investigator

Thomas A. Trikalinos, M.D., Investigator

Mei Chung, M.P.H., Investigator

Priscilla Chew, M.P.H., Investigator

Stanley Ip, M.D., Investigator

Deirdre A. DeVine, M.Litt., Project Manager

Joseph Lau, M.D., Project Director

AHRQ Publication No. 07-E008

May 2007

This document is in the public domain and may be used and reprinted without permission except those copyrighted materials noted for which further reproduction is prohibited without the specific permission of copyright holders.

Suggested Citation:

Bonis PA, Trikalinos TA, Chung M, Chew P, Ip S, DeVine D, Lau J. Hereditary Nonpolyposis Colorectal Cancer: Diagnostic Strategies and Their Implications. Evidence Report/Technology Assessment No. 150 (Prepared by Tufts-New England Medical Center Evidence-based Practice Center under Contract No. 290-02-0022). AHRQ Publication No. 07-E008. Rockville, MD: Agency for Healthcare Research and Quality. May 2007.

This report is based on research conducted by the Tufts-New England Medical Center Evidence-based Practice Center (EPC) under contract to the Agency for Healthcare Research and Quality (AHRQ), Rockville, MD (Contract No. 290-02-0022). The findings and conclusions in this document are those of the author(s), who are responsible for its contents, and do not necessarily represent the views of AHRQ. No statement in this report should be construed as an official position of AHRQ or of the U.S. Department of Health and Human Services.

The information in this report is intended to help clinicians, employers, policymakers, and others make informed decisions about the provision of health care services. This report is intended as a reference and not as a substitute for clinical judgment.

This report may be used, in whole or in part, as the basis for development of clinical practice guidelines and other quality enhancement tools, or as a basis for reimbursement and coverage policies. AHRQ or U.S. Department of Health and Human Services endorsement of such derivative products may not be stated or implied.

None of the investigators has any affiliations or financial involvement that conflicts with the material presented in this report.

Preface

The Agency for Healthcare Research and Quality (AHRQ), through its Evidence-Based Practice Centers (EPCs), sponsors the development of evidence reports and technology assessments to assist public- and private-sector organizations in their efforts to improve the quality of health care in the United States. The Centers for Disease Control and Prevention (CDC) requested and provided funding for this report. The reports and assessments provide organizations with comprehensive, science-based information on common, costly medical conditions and new health care technologies. The EPCs systematically review the relevant scientific literature on topics assigned to them by AHRQ and conduct additional analyses when appropriate prior to developing their reports and assessments.

To bring the broadest range of experts into the development of evidence reports and health technology assessments, AHRQ encourages the EPCs to form partnerships and enter into collaborations with other medical and research organizations. The EPCs work with these partner organizations to ensure that the evidence reports and technology assessments they produce will become building blocks for health care quality improvement projects throughout the Nation. The reports undergo peer review prior to their release.

AHRQ expects that the EPC evidence reports and technology assessments will inform individual health plans, providers, and purchasers as well as the health care system as a whole by providing important information to help improve health care quality.

We welcome comments on this evidence report. They may be sent by mail to the Task Order Officer named below at: Agency for Healthcare Research and Quality, 540 Gaither Road, Rockville, MD 20850, or by e-mail to .

Acknowledgments

We would like to acknowledge the Centers for Disease Control and Prevention for its funding of the evidence review project. We also acknowledge with appreciation the following members of the Technical Expert Panel for their advice and consultation to the Evidence-based Practice Center during preparation of this report:

Structured Abstract

Objectives: Hereditary Nonpolyposis Colorectal Cancer (HNPCC) has been defined clinically and genetically. The disorder has traditionally been recognized in kindreds with a clustering of related cancers in association with mutations in DNA mismatch repair genes. HNPCC is associated with a substantially increased risk for several forms of malignancy but particularly colorectal and endometrial cancer.

There were three main objectives of this report: (1) to assess the sensitivity, specificity, and reliability of laboratory and genetic tests commonly used in evaluating patients for HNPCC (analytic validity); (2) to summarize the accuracy of commonly used clinical and laboratory characteristics for predicting the presence of HNPCC in patients with colorectal cancer (clinical validity) and use these estimates to describe the efficiency of various strategies for identifying patients with a mismatch repair mutation; (3) to describe the benefits and harms related to screening and testing patients with colorectal cancer and their family members for HNPCC.

Data Sources: Published literature identified through an electronic search (through April 2006), review of relevant bibliographies, and suggestions from technical experts.

Review Methods: We evaluated studies critically and summarized the data qualitatively or by meta-analysis when studies used similar methodology and endpoints. We used decision trees to describe the efficiency of various strategies for identifying patients with HNPCC from a hypothetical population of patients with colorectal cancer.

Results: We included a total of 104 studies of which 40 addressed issues related to clinical validity, 3 to analytic validity, and 61 to benefits and harms.

We identified only three studies on analytic validity and thus there exists a major gap in the published literature with regard to the accuracy and reliability of specific tests used in the evaluation of HNPCC.

Among unselected patients with colorectal cancer who fulfilled the Amsterdam I criteria, 44% (95% CI: 35, 52%) carried pathogenic mismatch repair mutations (mainly in the MLH1 and MSH2 genes). The proportion was somewhat higher (51% [95% CI: 35, 66%]) among studies that performed sequencing on all available samples. The prevalence of MMR mutation carriers may be higher when genetic testing includes evaluation for large genomic deletions/rearrangements and when testing is also performed on MSH6 and PMS2. Approximately 71% (95% CI 63, 78%) of colorectal cancers from patients who fulfilled the Amsterdam I criteria demonstrated microsatellite instability while 40% (95% CI: 28, 53%) demonstrated loss of protein expression by immunohistochemistry.

Of nine clinical strategies considered for detecting the presence of mismatch repair mutations in patients with colorectal cancer, the combination of three clinical predictors (age less than 50 years old at diagnosis; or a history of colorectal or endometrial cancer in a first degree family member; or the presence of multiple, synchronous or metachronous colorectal or endometrial cancers in the proband) combined with either immunohistochemistry (IHC) or MSI testing of tumor tissue identified a similar number of patients with mismatch repair mutations as other more complex strategies.

There was little published information regarding potential harms associated with screening individuals with HNPCC-related cancers using clinical criteria (e.g., the Amsterdam criteria), MSI or IHC testing. Limited data suggested that testing probands for MMR mutations was not associated with severe psychological impact following formal counseling. Pre-test genetic counseling had good efficacy in improving knowledge about HNPCC and resulted in a high likelihood of proceeding with genetic testing, satisfaction in the decision to undergo genetic testing, and decreasing depression and distress levels among family members of HNPCC probands with cancer and among asymptomatic individuals from HNPCC families.

Identification of HNPCC mutations was associated with an increase in the likelihood that family members of probands with CRC would undergo cancer-screening procedures. HNPCC family members who underwent cancer-screening procedures had a lower risk of developing HNPCC-related cancers and lower mortality rates than those who did not take actions. However, all of the relevant studies suggesting these benefits had important limitations. Survival was increased among asymptomatic HNPCC family members who received colonoscopy screening, regardless of their mutation status. There was limited direct evidence related to harms of the cancer-screening procedures in family members of probands with HNPCC. However, complication rates associated with these procedures in other settings are probably similar.

Conclusions: This report characterizes the accuracy of clinical and laboratory predictors of MMR mutations that can be used to identify patients with an increased risk of having MMR mutations. However, the sensitivity, specificity, and reliability of the tests used to evaluate individuals for suspected HNPCC is not known confidently. Data regarding the net benefits and harms associated with predictive genetic testing in patients with HNPCC-related cancers and their families members is incomplete but suggest that such testing improves compliance with screening procedures. At-risk family members who undergo screening colonoscopy have a reduced risk of developing HNPCC-related cancers and lower mortality. However, all studies supporting these benefits had important limitations.

Executive Summary

Introduction

Individuals with a familial predisposition to cancer pose an increasing challenge for healthcare systems hoping to provide state-of-the-art care. Optimal strategies for recognizing them, performing (and interpreting) genetic testing, and preventing cancers in at-risk family members have not been well established when considering overall benefits, harms, and costs. The challenges involved will likely become increasingly complicated with advances in understanding of the molecular genetics underlying cancer risk. In this report, we attempt to clarify many of these issues for one form of hereditary cancer, Hereditary Nonpolyposis Colorectal Cancer (HNPCC). HNPCC is associated with a substantially increased risk for several forms of malignancy but particularly colorectal and endometrial cancer.

HNPCC has been defined clinically and genetically. As a genetic disease, it is inherited as an autosomal dominant disorder (with variable penetrance) caused by mutations in DNA mismatch repair (MMR) genes. As a clinical disorder, it can be defined as a clustering of related cancers across generations in a kindred. The disorder has also been referred to as the “Lynch syndrome” in recognition of Henry Lynch, who in 1966 described familial aggregation of colorectal cancer with gastric and endometrial cancer in two large kindreds (although it was first reported by the eminent pathologist Aldred Warthin in 1913).

These definitions are not entirely distinct since the disorder is typically recognized in patients or kindreds with clinical expression of the disease who have an associated genotype. However, the ability to perform predictive genetic testing in individuals with cancer and asymptomatic family members makes it imperative to fully understand its implications. There remain many uncertainties regarding how HNPCC should be identified in patients presenting with associated malignancies, and the full spectrum of implications related to screening and management options for the patient and their at-risk family members. Does, for example, the identification of MMR genotypes in family members of patients with HNPCC-related cancers improve their outcomes compared with management approaches that do not involve predictive genetic testing? What is the likelihood that a family member with a MMR mutation is destined to develop HNPCC-related cancers, and does screening for these cancers improve outcomes?

There were three main objectives of this report: (1) to assess the sensitivity, specificity and reliability of laboratory and genetic tests commonly used in evaluating patients for HNPCC (analytic validity); (2) to summarize the accuracy of commonly used clinical and laboratory characteristics for predicting the presence of HNPCC in patients with colorectal cancer (clinical validity) and to describe the efficiency of various strategies for identifying patients with a mismatch repair mutation; and (3) to describe the benefits and harms related to screening and testing patients with colorectal cancer (CRC) and their family members for HNPCC.

This report is based upon a systematic review of the literature. The Key Questions that it addresses were proposed through the Agency for Healthcare Research and Quality (AHRQ) on behalf of the Centers for Disease Control and Prevention (CDC) Evaluation of Genomic Applications in Practice and Prevention (EGAPP) Project. EGAPP is a three-year model project developed by CDC's Office of Genomics and Disease Prevention to address the increasingly urgent need for timely and objective information that will allow health care providers, consumers, policy makers and payers to distinguish tests that are safe and useful, and to guide their appropriate use in practice.

The Key Questions Addressed Include the Following:

Key Question 1: Does risk assessment and HNPCC mutation testing in patients with newly diagnosed CRC lead to improved outcomes for the patient or family members, or is it useful in medical, personal, or public health decision making? (Over-arching question).

Key Question 2a: Assuming a clinical definition of the Lynch Syndrome, what proportion of patients has a mismatch repair mutation?

2b: Assuming a clinical definition of the Lynch Syndrome, what proportion of patients has MSI?

2c: Assuming a clinical definition of the Lynch Syndrome, what proportion of patients has abnormal protein expression by immunohistochemistry?

2: How accurate are various predictors, assuming a genetic definition of the Lynch Syndrome?

Key Question 3: What are the harms associated with screening high-risk individuals for HNPCC?

Key Question 4: What is known about the analytic (sensitivity, specificity, reproducibility, reliability) and clinical validity of tests that identify HNPCC mutations?

Key Question 5: What are the harms associated with screening for high-risk individuals?

Key Question 6a: What are the management options for CRC patients who are HNPCC positive?

6b: Does the identification of HNPCC mutations lead to improved patient outcomes in terms of early detection, mortality/morbidity or management decisions (e.g., counseling, surveillance, treatment, other decision making) by patients and providers?

Key Question 7: What are the harms associated with subsequent management options after identification of HNPCC mutations in CRC patients?

Key Question 8a: What is the efficacy of pre-test genetic counseling for informing family members of potential risks and benefits of testing?

8b: What is the accuracy of HNPCC testing in family members in predicting the risk of CRC?

8c: Do other factors, such as race/ethnicity, age, gender, or co-morbidities affect the accuracy of the testing?

Key Question 9: What are the harms associated with informing/counseling family members or with subsequent testing for HNPCC mutations?

Key Question 10a: What are the management options for family members of CRC patients who have a positive HNPCC test?

10b1: Does the identification of HNPCC mutations lead to improved outcomes in terms of decision making by patients, family members and providers, or public health policy?

10b2: Does the identification of HNPCC mutations lead to improved outcomes in terms of early detection and mortality/morbidity of patients, family members?

Key Question 11: What are the harms associated with subsequent actions or interventions for family members?

These questions were based upon an analytic framework that begins with a patient with colorectal cancer and examines the full spectrum of implications of identifying HNPCC in the patient and their at-risk family members, and the potential benefits and harms of this process from the perspectives of the patient, provider, family member and the public health.

graphic element

Methods

We performed an electronic search of the literature followed by review of abstracts and then full-text review of potentially relevant studies. We also retrieved additional studies based on bibliographies of retrieved articles and suggestions from a technical expert panel. We evaluated all studies critically based upon pre-specified criteria.

We reviewed the full-text of 523 publications. One hundred fifteen papers fulfilled eligibility criteria but 11 were duplicate reports and were therefore excluded (or used to provide supplementary information). Thus, 104 unique studies were included for this review (40 were pertinent to Key Question 2 - clinical validity; 3 were pertinent to Key Question 4 - analytic validity; and 61 to the remaining Key Questions - benefits and harms), while 408 did not meet the inclusion criteria and were rejected.

We reviewed each study for its quality. We assigned an overall quality score (A, B or C) to provide a short hand appraisal of the overall validity of the study but also performed analysis of specific components of study quality that may have influenced the conclusions.

We combined data in studies that used similar methodology and definitions of endpoints in similarly selected CRC populations using meta-analysis to provide a point estimate and 95% confidence interval, mainly for questions pertaining to clinical validity.

We constructed decision trees models to calculate the reported outcomes of various strategies for identifying HNPCC among patients with colorectal cancer. The models were based upon parameters estimated from data presented in this report.

Results

Analytic Validity

Key Question 4: What is known about the analytic (sensitivity, specificity, reproducibility, reliability) and clinical validity of tests that identify HNPCC mutations?

The major laboratory tests used in the evaluation of patients suspected of having HNPCC include testing of tumor tissue using immunohistochemistry (IHC), microsatellite instability (MSI) testing, or germline (generally from peripheral blood mononuclear cells) testing for mismatch repair defects. Analytic validity may also apply to the accuracy of the family history.

Family members generally undergo only germline genetic testing (unless they have also developed a relevant cancer), ideally based upon the genotype of the proband. Detection of a pathogenic mutation (i.e., one known to be associated with HNPCC) in a proband permits testing of at-risk family members for the genotype. Family members with the same genotype have HNPCC while HNPCC can be excluded in those who do not. The situation is more complex when the probands do not have a detectable DNA alteration associated with HNPCC or when an alteration with unclear clinical significance is detected.

There was little published information on the analytic validity of laboratory testing in patients or family members suspected of having HNPCC. Thus, the analytic validity of the tests used to evaluate HNPCC is substantially uncertain. However, there was heterogeneity in the type of testing offered by commercial laboratories, and one study demonstrated variability in the accuracy of protein staining by IHC across facilities.

Additional information that could shed light upon analytic validity is available but would require evaluation of non-published data sources. For example, information has been collected through an external proficiency-testing program for MSI conducted by the College of American Pathologists and through internal testing performed by individual laboratories. Committees of experts could also review the strengths and limitations of specific testing techniques based upon clinical experience with these methods in HNPCC and in other genetically based disorders.

Clinical Validity

Key Questions 2a, 2b and 2c seek to evaluate the prevalence of MMR mutations, suggestive MSI and IHC, respectively, among patients fulfilling the Amsterdam I criteria or the Amsterdam II criteria. We considered several variables in making comparisons across studies such as how populations were selected, the methods used for genetic testing, whether and how mutations were described as being pathogenic, and whether testing for MMR genes other than MLH1 and MSH2 was performed.

Key Question 2a: Assuming a clinical definition of the Lynch Syndrome, what proportion of patients has a mismatch repair mutation?

Most eligible studies evaluated only MLH1 and MSH2 genes; only three studies assessed other MMR genes. Among CRC fulfilling Amsterdam I criteria, the random effects summary prevalence of MLH1 and MSH2 gene mutations was 44% (95% CI: 35, 52; n=19 studies, 464 patients), with evidence for substantial between-study heterogeneity (p<0.01; I2=52%). The six studies that performed sequencing among all Amsterdam I patients had a summary prevalence of 51% (95% CI: 35, 66%).

For patients fulfilling the Amsterdam II criteria, the corresponding prevalence values were 39% (95% CI: 30, 49%; 10 studies 279 Amsterdam II patients) and 40% (95% CI: 30, 52%) based upon two studies that performed sequencing on all 87 Amsterdam II patients.

The three studies examining additional genes (MSH6, PMS1 and PMS2) in Amsterdam I patients did not identify any additional MMR mutations. Two additional MSH6 mutations (in addition to five MLH1 and MSH2 mutations) were found among 20 Amsterdam II patients in a single study.

There were limited studies that performed more comprehensive genetic testing for pathogenic MMR genotypes associated with HNPCC or evaluated all the MMR genes that have been associated with HNPCC. For example, only one study performed sequencing in all samples and tested for large genomic mutations/rearrangements for three MMR genes (MLH1, MSH2, MSH6). The study included only 22 Amsterdam I patients; the prevalence of MMR mutation carriers was 64%.

Limited data suggested that approximately one-fourth to one-third of genotypes associated with HNPCC are related to deletions or rearrangements that would be missed through sequencing alone. As a result, the prevalence of mutations in Amsterdam I or II patients assessed from studies that performed sequencing alone are likely to be underestimates. Accounting for this effect, one may derive a prevalence of MMR mutations of approximately 63% to 67% in Amsterdam I patients. For Amsterdam II patients the corresponding prevalence values would be 50% to 53%.

Furthermore, limited data suggest that approximately 10% of MMR genotypes involve MMR genes other than MLH1 and MSH2. Thus, assuming an additional 10% increase in mutations by assessing more genes would result in an overall prevalence of up to 70% to 75% for Amsterdam I patients and 55 to 59% for Amsterdam II patients.

Because of the limited data, these calculations should be considered as being highly imprecise. Furthermore, other considerations, such as how patients are selected and how genotypes are classified as being pathogenic, may affect these estimates.

Key Question 2b: Assuming a clinical definition of the Lynch Syndrome, what proportion of patients has MSI?

Among patients fulfilling the Amsterdam I criteria, 71% (95% CI: 63, 78%; n=11 studies, 159 patients) of tumors were MSI-H. Among patients who fulfilled the Amsterdam II criteria, the corresponding summary prevalence was 68% (95% CI: 58, 76%; n=4 studies, 102 patients).

Key Question 2c: Assuming a clinical definition of the Lynch Syndrome, what proportion of patients has abnormal protein expression by immunohistochemistry?

Among patients fulfilling the Amsterdam I criteria the overall prevalence of tumors with loss of protein expression by IHC was 40% (95% CI: 28, 53%; n= 6 studies, 63 patients) with no evidence for between-study heterogeneity (p=0.75, I2=0%).

Only one eligible study provided relevant data for 20 patients fulfilling the Amsterdam II criteria. Eight out of 20 tumors had suggestive IHC for the MLH1, MSH2 or MSH6 genes (40% [95% CI: 9, 64%]).

MSI and IHC testing often depended upon practical and logistical considerations (e.g., patient availability and consent and availability of tumor tissue). Thus, not all patients had all tests and it was unclear whether additional bias may have been introduced in selecting patients for testing.

Key Question 2: How accurate are various predictors assuming a genetic definition of the Lynch Syndrome?

Five studies provided information on eight clinical predictors and on suggestive MSI testing for predicting the presence of MMR mutations among unselected incident CRC. All were limited by verification bias. The table below summarizes the sensitivity and specificity of the predictors most commonly reported (see Executive Summary Table 1).

Table 1

Executive Summary Table. Diagnostic ability of various predictors to detect MMR mutations among unselected incident CRC
PredictorUnselected CRC probands
NSensitivity [%](95% CI)Specificity [%](95% CI)
Amsterdam I criteria245 (29, 63)99 (74, 100)
Amsterdam II criteria228 (15, 47)99 (97, 100)
Modified Amsterdam criteria0NDND
Bethesda guidelines173 (39, 94)82 (80, 84)
Revised Bethesda guidelines191 (59, 100)77 (75, 79)
Age <50 years331 (18, 47)95 (94, 96)
1st degree family history of CRC or EC476 (50, 91)87 (86, 89)
Multiple CRC or EC tumors in the same patient338 (25, 54)97 (91, 99)
Age <50 years, family history of CRC or EC, or multiple tumors in same patient388 (60, 97)77 (74, 81)
Suggestive MSIa2100 (88, 100)90 (88, 92)
Suggestive IHC0NDND

CRC: colorectal cancer; EC: endometrial cancer; N: Number of studies; ND: no data.

a

Estimates are the same for combined MSI-H and MSI-L versus MSS and for MSI-H versus MSS

Decision Tree Modeling of Genetic Testing Strategies. We evaluated nine strategies for identifying patients with CRC with MMR mutations based upon combinations of clinical features, laboratory testing of tumor tissue (i.e., IHC and MSI testing). These can be conceptually organized into four general strategies:

  • Group 1: Perform genetic test on everyone

  • Group 2: Screen with a set of clinical criteria

  • Group 3: Screen tumor tissue with a laboratory test

  • Group 4: Screen using two serial tests: a set of clinical criteria first, and then a laboratory test of tumor tissue

Of these, Group 4 strategies selected relatively fewer patients for genetic testing (one out of twenty-five or fewer) and missed at most in approximately 27% of patients with HNPCC. Mismatch repair mutation testing would be performed in less than 6% of CRC patients using these strategies. In contrast, for strategies in groups 1 to 3, more than 13% and up to 100% of newly diagnosed CRC patients would be genetically tested, and approximately 5% to 16% of patients with HNPCC would be missed. Similar results were obtained for both the low (0.90%) and the higher (2.75%) estimate for the prevalence of mutation carriers among incident unselected CRC (see Executive Summary Table 2).

Table 2

Executive Summary Table. Expected number of MMR, MSI or IHC tests and expected MMR testing results with the nine strategies, assuming a population of 100,000 incident cases of CRC
StrategyReceived tests Number of MMR tests that were Unidentified MMR mutation carriers
MMRMSIIHCPositiveTrue positiveInconclusive
Low prevalence estimate for MMR mutation carriers (0.90%)
MMR-All100,000001,35185525245
BethR-All23,6120089277861122
3Clinical-All23,5850086675261148
MSI-All13,738100,00008778123788
IHC-All13,7020100,00084377837122
BethR-MSI3,74123,612075473912161
3Clinical-MSI3,71623,585073071511185
BethR-IHC1,828023,6126596546246
3Clinical-IHC3,684023,58570068511215
Higher prevalence estimate for MMR mutation carriers (2.75%)
MMR-All100,000003,0982,612257138
BethR-All24,870002,4892,37769373
3Clinical-All24,787002,4102,29969451
MSI-All15,255100,00002,5452,48146269
IHC-All15,1450100,0002,4402,37745373
BethR-MSI5,28524,87002,2732,25820492
3Clinical-MSI5,20624,78702,1982,18420566
BethR-IHC3,220024,8702,0021,99714753
3Clinical-IHC5,110024,7872,1062,09220658

In the hypothetical population, for the low prevalence estimate 900/100,000 patients are assumed to carry MMR mutations; for the high prevalence estimate 2750 people are assumed to carry MMR mutations. Strategies are presented with respect to the group (1 to 4) to which they belong. MMR-All: test all for mismatch repair mutations; BethR-All: test all using the revised Bethesda criteria; 3 Clinical-all: Perform MMR testing only among those fulfilling at least one of the three simple clinical criteria (age <50y at diagnosis, family history of CRC or endometrial cancer, or multiple tumors, synchronous or metachronous, in the same patient); MSI-All: Perform MSI testing on all patients, followed by MMR testing only among those with suggestive MSI test; IHC-all: Perform immunohistochemistry (IHC) testing on all patients followed by MMR testing only among those with suggestive IHC test; BethR-MSI: Perform MSI testing on patients fulfilling the revised Bethesda guidelines, perform MMR only among those with suggestive MSI test;3 Clinical-MSI: Perform MSI testing on patients fulfilling at least one of the three simple clinical criteria (age <50y at diagnosis, family history of CRC or endometrial cancer or multiple tumors, synchronous or metachronous, in the same patient); perform MMR only among those with suggestive MSI test; BethR-IHC: Perform IHC testing on patients fulfilling the revised Bethesda guidelines; perform MMR only among those with suggestive IHC test; 3 Clinical-IHC: Perform IHC testing on patients fulfilling at least one of the three simple clinical criteria (age <50y at diagnosis, family history of CRC or endometrial cancer or multiple tumors, synchronous or metachronous, in the same patient; perform MMR only among those with suggestive IHC test.

The overall (strategy-level) sensitivity and specificity are shown in Executive Summary Table 3. The overall specificity was high in all strategies. Group 4 strategies had the lowest overall sensitivity (ranging between 73% and 82%). Overall sensitivity and specificity estimates were similar for both the low (0.90%) and the higher (2.75%) prevalence estimates.

Table 3

Executive Summary Table. Overall sensitivity and specificity for each of the nine strategies
StrategySensitivity of strategy (%)Specificity of strategy (%)
MMR-All95.099.3
BethR-All86.599.8
3Clinical-All83.699.8
MSI-All90.399.9
IHC-All86.599.9
BethR-MSI82.1100.0
3Clinical-MSI79.4100.0
BethR-IHC72.6100.0
3Clinical-IHC76.1100.0

Strategies are presented with respect to the group (1 to 4) to which they belong. In the above estimates the sensitivity and the specificity of the whole strategy was calculated. Inconclusive MMR tests were assumed to be false negative (for the calculation of overall sensitivity for each strategy) or false positive (for the calculation of overall specificity for each strategy).

Thus, of the nine clinical strategies, the presence of at least one of three clinical predictors: (i) age less than 50 years old at diagnosis, or ii) a history of colorectal or endometrial cancer in a first degree family member, or iii) the presence of multiple, synchronous or metachronous colorectal or endometrial cancers in the proband, combined with testing of tumor tissue for either IHC or MSI, identified a similar number of patients with colorectal cancer who had mismatch repair mutations associated with HNPCC (and failed to identify a similar number) compared with other, more complex approaches. There were relatively more studies demonstrating test characteristics of MSI testing compared with IHC and thus greater precision in the estimates of sensitivity and specificity of MSI testing.

Benefits and Harms

Key Question 1: Does risk assessment and HNPCC mutation testing in patients with newly diagnosed CRC lead to improved outcomes for the patient or family members, or is it useful in medical, personal, or public health decision making? (Over-arching question)

No study directly addressed Key Question 1.

Key Question 3: What are the harms associated with screening high-risk individuals for HNPCC?

Studies were considered eligible for Key Question 3 if they reported harms of a risk assessment process (e.g., Amsterdam, Bethesda and/or MSI, IHC) used to identify CRC patients at increased risk for HNPCC.

No study described harms of the risk assessment process in CRC patients at increased risk for HNPCC.

Key Question 5: What are the harms associated with screening for high-risk individuals?

Studies were considered eligible for Key Question 5 if they reported the harms associated with testing CRC patients for MMR mutations. Common harms that are thought to be associated with genetic testing are labeling, discrimination in health coverage, and emotional distress.

Three quantitative, comparative studies of quality A and B, and one qualitative study of B quality reported harms associated with MMR mutation testing in CRC patients. One 1-year prospective study (Grade A) compared the psychological impact of MMR mutation testing between mutation carriers and non-carriers. Subjects in this study were CRC probands or relatives from HNPCC families with a prior diagnosis of any cancer (excluding non-melanoma skin cancer). Anxiety, depression, and quality of life measures did not change over time, and there were no differences in these measures between mutation carriers and non-carriers. Distress levels were significantly decreased 2 weeks and 6 months after revealing the genetic testing results but were not significantly different from the baseline at 1-year follow-up. There was no difference in the distress levels between mutation carriers and non-carriers.

Another 1-month prospective study (Grade B) found that three of the 27 probands (11%) had minor depression at 1 month after revealing the genetic testing results, but the prevalence of minor depression was not significantly different compared to the prevalence at baseline or between mutation carriers and non-carriers. Of the six probands who received a positive result, two (33%) felt severe guilt regarding their children.

One prospective study (Grade B) reported changes in the psychological outcomes of CRC patients from self-completed questionnaires pre- and 4–6 weeks post-genetic counseling. There was no genetic testing performed in this study. There was a trend toward greater anticipated ability to cope with a positive gene test after counseling, as reflected by a decrease in anxiety and cancer-specific distress.

The qualitative study of 111 newly diagnosed CRC patients reported a high acceptance and understanding about information on HNPCC. Nineteen percent of participants rated their current level of worry caused by the genetics information at or above the midpoint of 4 on a 1 (not at all) to 7 (all the time) scale.

Key Question 6a: What are the management options for CRC patients who are HNPCC positive?

6b: Does the identification of HNPCC mutations lead to improved patient outcomes in terms of early detection, mortality/morbidity or management decisions (e.g., counseling, surveillance, treatment, other decision making) by patients and providers?

There are three aspects to Key Question 6: 1) Are management options for patients with CRC with a MMR mutation different from those without a MMR mutation? 2) Does the knowledge of MMR mutation status change management decisions by patients and providers? 3) Does changing management options for MMR positive patients with CRC improve outcomes (e.g., prognosis and survival) compared to standard approaches for patients with CRC?

We encountered a variety of surgical and medical management options in patients with CRC who were MMR positive but there were no comparative studies.

Indirect evidence from one study suggested that identification of HNPCC mutations was associated with better prognosis of CRC. However, there were no data on whether management options for CRC differed based on MMR mutation status.

Indirect evidence from one study showed no difference in survival of patients with endometrial cancer, comparing those who were mutation positive to those who were mutation negative.

In five studies with indirect evidence, there was no evidence in favor or against differences in survival, when comparing CRC patients who fulfilled different clinical criteria for HNPCC or screened positive for HNPCC by suggestive laboratory testing with those who did not.

Key Question 7: What are the harms associated with subsequent management options after identification of HNPCC mutations in CRC patients?

No study described harms associated with subsequent management options after identification of HNPCC mutations in patients with CRC or other forms of HNPCC-related cancers.

One study (involving two centers) described the types of colorectal surgery performed on CRC patients who were part of an Amsterdam criteria-positive family, and compared rates of metachronous cancers that followed each type of index operation. The overall rate of second surgeries for metachronous cancer were 23% in patients who underwent right colectomy, 17% in patients who underwent left/sigmoid colectomy or proctosigmoidectomy, 0% in patients who underwent total/subtotal colectomy, and 44% in patients who underwent segmental colectomy. The two centers had significantly different second resection rates for metachronous cancer.

One study described the survival rate of 45 patients with gastric cancer from HNPCC families with MMR mutations. Many of these patients had already had treatments for other HNPCC-related cancers, including CRC. The 5-year survival was higher in patients in whom radical surgery was performed (48%) than in patients in whom radical palliative surgery or explorative laparotomy alone was performed (15%).

Key Question 8b: What is the accuracy of HNPCC testing in family members in predicting the risk of CRC?

8c: Do other factors, such as race/ethnicity, age, gender, or co-morbidities affect the accuracy of the testing?

Only two studies of B quality reported the risk of CRC in family members of probands with positive MMR mutations (the proposed framework). The lifetime risk of CRC was 68.7% for men and 52.2% for women with MMR mutations in one study, and it was 74% and 30% respectively in the other study. Men had higher lifetime risk of CRC than women in both studies.

In a study that reported the risk of CRC in family members of probands with HNPCC based on clinical criteria, the cumulative risk of CRC by age 75 years old was 57% and 41% in families that fulfilled the Amsterdam I and II criteria, respectively. The cumulative risk of CRC by age 75 years old was 42% and 23% for men and women, respectively, from families that fulfilled Bethesda criteria. In another study, family members of CRC probands who were younger than 50 years old at cancer diagnosis had a higher risk of CRC, compared to family members of CRC probands who were 50 years old and older. The risk of CRC was increased three-fold, comparing first-degree relatives of CRC probands who developed a second primary in the HNPCC spectrum with the single primary group in a third report.

In a study that reported the risk of CRC in kindreds with HNPCC based on genetic criteria, the cumulative risk of CRC by age 70 yr was 82% in MLH1/MSH2 mutation carriers. The cumulative incidence of CRC was 100% in men and 54% in women. There was overall a higher risk of CRC in men, but the sex difference was not consistent among HNPCC kindreds with different MMR mutations.

Key Question 9: What are the harms associated with informing/counseling family members or with subsequent testing for HNPCC mutations?

Key Question 8a: What is the efficacy of pre-test genetic counseling for informing family members of potential risks and benefits of testing?

Studies were considered eligible for Key Question 8a if they summarized the efficacy of pre-test genetic counseling immediately after counseling and before performing genetic testing. Studies addressing Key Question 9 were considered together with those addressing Key Question 8a because there was substantial overlap in the studies addressing these questions. The studies addressed the long-term efficacy of pre-test genetic counseling or harms associated with screening high-risk individuals (such as by using clinical criteria, MSI, or IHC), genetic testing, and informing/counseling family members or with subsequent testing for HNPCC mutations.

Four studies addressed the efficacy of pre-test genetic counseling immediately after counseling and before performing MMR genetic testing. Of these, three were of B quality and one was of C quality.

Eight comparative and four qualitative studies addressed the harms associated with genetic testing for HNPCC mutation or with informing/counseling family members or with subsequent testing for HNPCC mutations. Of these, one study was of A quality, six of B quality, and five of C quality.

Overall, pre-test genetic counseling had good efficacy in improving knowledge about HNPCC, and resulted in high likelihood of proceeding with genetic testing, satisfaction in the decision to undergo genetic testing, and decreasing depression and distress levels among family members of HNPCC probands or among asymptomatic individuals from HNPCC families. Family members of HNPCC who received positive MMR mutation test results had higher psychological distress levels and anxiety compared to those who received negative test results, but this difference generally disappeared with time. However, all of these psychological measures were within the normal ranges for the general populations. There were no differences in quality of life, comparing mutation carriers to non-carriers or the general population.

Key Question 10a: What are the management options for family members of CRC patients who have a positive HNPCC test?

b1: Does the identification of HNPCC mutations lead to improved outcomes in terms of decision making by patients, family members and providers, or public health policy?

b2: Does the identification of HNPCC mutations lead to improved outcomes in terms of early detection and mortality/morbidity of patients, family members?

We included studies evaluating all forms of cancer related to HNPCC since family members of CRC probands are potentially at risk for all such cancers.

Six studies examined the impact of mutation testing on the decision to undergo specific management recommendations among family members of CRC patients or asymptomatic individuals from HNPCC families. Of these, four were of B quality and two were of C quality. No study directly examined the impact of HNPCC mutation testing on public health policy or decision making by insurance providers.

Two studies (in three publications) of B and C quality indirectly addressed outcomes of early detection and mortality/morbidity in relation to the identification of MMR mutations in family members of CRC probands or asymptomatic individuals from HNPCC families. These studies were limited by potential selection bias, and/or unclear effects from treatments or subsequent interventions.

Identification of HNPCC mutations was associated with improved outcomes in terms of decision making to undergo screening for cancers in family members of HNPCC. HNPCC family members who took subsequent actions or interventions had a lower risk of developing HNPCC-related cancers and lower mortality rates, compared to those who did not take actions. Most data pertained to screening for CRC with colonoscopy while there was less information about screening for other forms of HNPCC-related cancer.

Key Question 11: What are the harms associated with subsequent actions or interventions for family members?

We included studies that reported any outcome relating to subsequent management options or interventions in HNPCC family members.

Nine studies reported outcomes related to subsequent actions or interventions among family members. Of these, six were of B quality and three were of C quality. Four of these nine studies reported harms or adverse events associated with subsequent actions or interventions for family members. In addition, one study of C quality examined the psychological impacts associated with colonoscopies. Some of these studies did not have a control group of subjects who declined to undergo surveillance and most results did not adjust for potential confounders such as age, personal history of cancer, and educational levels.

Less than 0.5 percent of family members experienced harms associated with screening or surveillance examination or surgical procedures in the studies we evaluated. However, complication rates associated with these interventions in the non-HNPCC setting are probably applicable. There was some negative psychological impact associated with colonoscopies.

Implications for Future Research

Our report identified several areas for future research; we considered the following to be particularly important priorities:

  • There is very little information regarding the analytic validity of tests used in the diagnosis of HNPCC. Studies specifically addressing sensitivity, specificity and reliability of all of the laboratory and genetic testing methods in HNPCC are needed. Such studies should focus on contemporary testing methods and compare them against well-defined reference standards in tissue samples representative of the spectrum of genotypes associated with HNPCC. Unpublished information regarding analytic validity is also available; it may be feasible to obtain information from commercial or private laboratories performing such testing. It may also be possible to obtain data from the College of American Pathologists regarding their MSI proficiency program once experience has accumulated. Experience with genetic testing methods in other conditions is likely to be relevant to HNPCC; a review of such information could be conducted by groups of experts on genetic testing techniques.

  • Additional studies are needed to clarify the validity of specific clinical and laboratory predictors of HNPCC in patients with CRC who are representative of the general population of patients with CRC.

  • Future studies should consider all forms of genetically based CRC cancer predisposition to fully understand the effectiveness of various diagnostic strategies. Such studies should consider all known genetic causes of cancer predisposition and the accuracy of clinical and laboratory testing in identifying these disorders in individuals who are representative of the general population.

  • Additional studies are needed to establish the availability of genetic testing centers that can provide adequate counseling and whether there are barriers to access them. Such studies may involve electronic, mail, or telephone surveys.

  • More studies are needed to understand what forms of surveillance should be offered to MMR mutation carriers for HNPCC-related cancers other than CRC. Well-designed controlled trials comparing various surveillance (or other management) strategies could be helpful.

  • More studies are needed to clarify the risk of cancer in family members of probands with an HNPCC-related cancer who are found to carry MMR mutations. Such studies would ideally be prospective, fully account for interventions (such as cancer screening procedures) in those at-risk, and have a well-defined control population of individuals at average risk for cancer.

  • Standards for reporting studies of genetically based diseases (including those addressing all aspects of the ACCE model) should be developed. A consensus development process with publication of a guideline(s) could be helpful.

Chapter 1. Introduction

Background

Individuals with a familial predisposition to cancer pose an increasing challenge for healthcare systems hoping to provide state-of-the-art care. Optimal strategies for recognizing them, performing (and interpreting) genetic testing, and preventing cancers in at-risk family members have not been well established when considering overall benefits, harms, and costs. The challenges involved will likely become increasingly complicated with advances in understanding of the molecular genetics underlying cancer risk. In this report, we attempt to clarify many of these issues for one form of hereditary cancer (hereditary nonpolyposis colorectal cancer).

This evidence review is based upon a systematic review of the literature. The Key Questions that it addresses were proposed by the Agency for Healthcare Research and Quality (AHRQ) on behalf of the Centers for Disease Control and Prevention (CDC) Evaluation of Genomic Applications in Practice and Prevention (EGAPP) Project. EGAPP is a three-year model project developed by CDC's Office of Genomics and Disease Prevention to address the increasingly urgent need for timely and objective information that will allow health care providers, consumers, policy makers, and payers to distinguish tests that are safe and useful, and to guide their appropriate use in practice.

Table 1

Lifetime cancer risk in HNPCC
CancerHNPCC %General Population %
Colorectal80–825–6
Endometrial50–602–3
Gastric131
Ovarian121–2
Small bowel1–40.01
Bladder41–3
Brain40.6
Kidney, renal pelvis31
Biliary tract20.5

From Chung, DC. Ann Intern Med 2003; 138:560; HNPCC: Refers to individuals with Lynch Syndrome.

Hereditary Nonpolyposis Colorectal Cancer (HNPCC) can be defined clinically or genetically as will be described below. As a genetic disease it is inherited as an autosomal dominant disorder (with variable penetrance) and is caused by mutations in DNA mismatch repair genes. HNPCC is associated with a substantially increased risk for several forms of malignancy but particularly colorectal and endometrial cancer13 (see Table 1).

The disorder has also been referred to as the “Lynch syndrome” in recognition of Henry Lynch, who in 1966 first described familial aggregation of colorectal cancer with gastric and endometrial cancer in two large kindreds (although it was first reported by the eminent pathologist Aldred Warthin in 1913).4 Lynch I syndrome (also referred to as HNPCC I) refers to kindreds in which colorectal cancer predominates, while Lynch II syndrome (HNPCC II) refers to kindreds who also have extracolonic tumors. The Muir-Torre syndrome (sebaceous gland tumors with or without keratoacanthomas associated with visceral malignancy) and Turcot syndrome (HNPCC-related tumors associated with glioblastoma multiforme) describe additional subsets of HNPCC with tumor types that appear to cluster in affected families. These distinctions have become less clear as more families have been studied, and as a result, these clinical classifications are being supplanted by genetic classification.57 The most common mismatch repair mutations associated with HNPCC are MLH1 and MSH2 (which together are believed to account for about 80 percent of cases) while MSH6 and PMS2 are less common.7

The precise cancer burden due to HNPCC has not been well defined. However, a germline mismatch repair mutation associated with HNPCC has been described in 1–5% of patients diagnosed with colorectal cancer in various reports.812 Thus, HNPCC accounted for approximately 1400 to 7300 cases of colorectal cancer in 2005 in the United States based upon the overall estimate of 145,290 new cases of colorectal cancer.13 Similarly, approximately 0.5–2% of patients with endometrial cancer has a history compatible with HNPCC.14, 15 More than 1 in 3100 people between the ages of 15 and 74 are estimated to carry a defective DNA mismatch repair gene associated with HNPCC and thus are at risk for developing an HNPCC-related cancer.16

The recognition of a heightened cancer risk in carriers of mismatch repair mutations provides hope for offering screening, intensive surveillance or other measures (such as colectomy or hysterectomy) aimed at reducing the risk that cancer will develop. Furthermore, identification of a specific gene defect allows for testing of family members potentially sparing them the worry, bother, and expense associated with lifelong cancer surveillance if they do not carry the mutation. Notably, HNPCC has been excluded in 97 living members of the original family described by Henry Lynch based upon genetic testing.17

However, many uncertainties remain on the sequence of events that should occur in selecting patients with cancer to undergo testing for HNPCC and the spectrum of implications that screening, surveillance, and other management strategies have on affected patients and their families. The following summarizes many of these issues, while outlining those that are the subject of this report.

The framework for this report begins with patients with colorectal cancer, and explores the issues of screening and testing patients with colorectal cancer, identifying, counseling and testing at-risk family members, and the benefits and harms of subsequent management options for the probands and family members. We evaluate these issues from the perspectives of the patient, caregiver, family member, and policy-maker. The analytic framework is described in further detail in Chapters 2 and 3.

Who Should be Screened?

Screening for HNPCC has been most widely advocated in patients with colorectal cancer while there is much less information about screening in patients with other forms of HNPCC-related cancers. This report focuses only on colorectal cancer. However, recognition of HNPCC may also be possible in patients presenting with other HNPCC-related cancers. In one study, for example, one-half of women with HNPCC (defined by the Amsterdam criteria) presented with endometrial cancer.18 It may also be feasible to identify an HNPCC kindred from individuals without a personal family history of an HNPCC-related cancer by obtaining a detailed family history.

Several studies have described estimates of the proportion of patients with colorectal cancer who have a mismatch repair mutation, fulfill clinical criteria for a familial cancer predisposition, or have clinical (e.g., tumor location or histology) or laboratory (e.g., abnormal staining for mismatch repair proteins [IHC] or microsatellite instability [MSI]) characteristics of their tumor tissue that suggest the diagnosis. In this report, we evaluate such studies in detail to produce estimates of these parameters and attempt to explain variability across studies to an extent possible. These parameters are important for defining cost-effective pathways for evaluating patients with colorectal cancer for HNPCC and caring for family members.19 However, this report does not include a formal cost-effectiveness analysis.

How Should HNPCC be Defined?

The definition of HNPCC continues to evolve. Some authorities consider HNPCC to represent a superset of individuals with a mismatch repair mutation of whom a subset is considered to have the familial cancer clustering described by Henry Lynch. Such an approach recognizes the uncertainty that remains regarding the penetrance of cancer in carriers of mismatch repair mutations; the risk of cancer in a family with Lynch Syndrome may be substantially different compared with the risk associated with a mismatch repair mutation alone without such a history.20

A different view is that Lynch Syndrome represents a description of familial cancer clustering, a subset of which is caused by mismatch repair mutations. Patients with familial clustering of HNPCC-related cancers but without a mutation may have a different form of hereditary cancer (e.g., cancers caused by mutations in the MYH gene)21 while others may have HNPCC caused by a mismatch repair mutation that was not sought, or from a false negative result of testing. These distinctions are important because they identify subgroups of patients with variable cancer risk, and they may influence how family members are screened and subsequent surveillance strategies. For example, at least one report suggested that families who fulfill the Amsterdam criteria for Lynch syndrome (described below), but do not have an identifiable mismatch repair mutation, might be at lower cancer risk compared with those in whom a mutation is identified.22

Table 2

2×2 table for test characteristics when considering the presence of a mismatch repair mutation as the reference standard
Patients with Colorectal CancerPathogenic Mismatch Repair Mutation
TestDetectedNot detected
Microsatellite instability
Abnormal immunohistochemistryPositiveAB
Amsterdam Criteria I
Amsterdam Criteria II
Bethesda Guidelines
Revised Bethesda GuidelinesNegativeCD
Other
An advantage of this view is that it establishes a reference standard for Lynch syndrome that is relatively more objective than one based upon a clinical definition. For example, it may be possible to establish the diagnosis of HNPCC in a proband with colorectal cancer who does not fulfill classical criteria for Lynch syndrome. In addition, a genetically based reference standard provides a framework for calculating sensitivity, specificity and predictive values of various predictors of mismatch repair mutation that might be useful in selecting patients for genetic studies (see Table 2).

As will be described further in the methods section, in this report we take both views on HNPCC depending upon which Key Question is being addressed. For questions related to the test characteristics of predictor tests (such as clinical criteria or laboratory tests of tumor tissue described below), HNPCC can be defined as the presence of a pathogenic mismatch repair mutation in a patient with an HNPCC-related mutation (see Table 2). In this model, test characteristics depend upon how comprehensively mutation testing (e.g., the number of mismatch repair mutations tested and methods of testing, and the accuracy of the specific laboratory methods used), and predictor tests on tumor tissue (e.g., the quality of IHC analysis and the specific methods used to determine MSI status) were carried out and whether a mutation was known to be pathogenic. We describe the type of testing performed in all studies included in this report and provide a general description of how they are used in Chapters 2 and 3.

Not all mismatch repair mutations that can be identified using modern genetic testing are known to be pathogenic, leaving some uncertainty as to whether a mismatch repair mutation found in a patient with an HNPCC-related cancer is responsible for the increased cancer risk. The strongest evidence that a mutation is pathogenic is when its presence correlates strongly with the clinical expression of the disease. A mutation may also be considered pathogenic when its predicted protein sequence is expected to lead to a dysfunctional protein. In this report, the methods by which the authors attempted to define pathogenic mutations (if at all) were recorded for all eligible studies.

However, in some cases, the observed genotype has an unclear relationship to the clinical expression of the disease. Thus, even under the best of circumstances, genetic testing may produce an ambiguous result, making it unclear how the patient and their family should be counseled.2

Test characteristics are also vulnerable to several other features of study design, particularly selection bias, spectrum effects and verification bias, potentially helping to explain the variable results that have been described in the literature. In this report, we attempt to define these issues clearly to permit valid comparisons among studies. For example, a study applying clinical criteria to an unselected, consecutive population of patients with colorectal cancer may produce substantially different estimates of the accuracy of the Amsterdam criteria compared with a study enrolling patients who were referred to a tertiary care medical center because of multiple occurrences of cancer in the family. The latter group would be expected to have a higher prevalence of HNPCC and correspondingly better predictive values for the Amsterdam criteria.

Table 3

2×2 table for test characteristics when considering Amsterdam criteria I as the reference standard
Patients with Colorectal CancerLynch syndrome (Amsterdam criteria I)
TestPresentAbsent
Microsatellite instabilityPositive A B
Abnormal immunohistochemistryNegativeCD
In considering a clinical diagnosis of Lynch syndrome, sensitivity can also be defined as the proportion of patients with Lynch syndrome (defined by the Amsterdam criteria) with a specific predictor (see Table 3). Specificity would be the proportion of unselected patients with colorectal cancer in whom these predictor variables are present.

However, this view permits only a limited understanding of the sensitivity or specificity of clinical criteria used to screen patients for HNPCC since many such criteria are included in the Amsterdam criteria. Nevertheless, the proportions determined using a clinical or genetic reference standard for HNPCC are complementary since they all describe relationships among predictor test, mutations, and the clinical syndrome of familial cancer clustering.

Identifying HNPCC in Patients With Colorectal Cancer

Most patients with colorectal cancer do not have a mismatch repair mutation making it impractical to consider universal genetic testing, especially when considering the cost (about $3,000 for comprehensive mutation testing).23 As a result, several strategies have been proposed to identify patients who should undergo additional testing. As a general rule, these have been based either upon clinical criteria, predictive laboratory testing of tumor tissue, or a combination of both. Statistical models incorporating these approaches have also been proposed.11 These approaches can be characterized quantitatively by determining their sensitivity, specificity and predictive values as described above.

In this report, we attempt to understand test characteristics of various approaches to identifying HNPCC in patients with colorectal cancer. We used these parameters to develop models (based upon decision-analysis) that explore different strategies for recognizing patients who carry the mutations.

Clinical Criteria That Suggest the Diagnosis

The recognition that certain types of cancers cluster in families with HNPCC and that cancer develops at relatively early ages compared with the general population provided the rationale for development of criteria that could be used to aid in the diagnosis. Two sets of criteria (the Amsterdam criteria and Bethesda guidelines) developed by a consensus of experts, have been most widely accepted and best studied, although many similar criteria have been proposed.24, 25 Both have been revised since their initial development.26, 27 These criteria have applied by healthcare providers and genetic counselors during interviews with the patient and/or their family and/or with assistance of written documents such as a survey.

Table 4

Original and revised Amsterdam criteria
Original (Amsterdam I)Revised (Amsterdam II)
  • At least 3 relatives with colorectal cancer, one of whom must be a first degree relative of the other two

  • Involvement of 2 or more generations

  • At least 1 case diagnosed before age 50

  • Familial adenomatous polyposis has been excluded

  • At least 3 relatives with HNPCC-associated cancer

  • One should be 1st degree relative of other two

  • At least 2 successive generations affected

  • At least 1 diagnosed before age 50

  • Familial adenomatous polyposis excluded

  • Tumors should be verified by pathologic examination

The Amsterdam criteria (see Table 4) were designed to establish the diagnosis of HNPCC based upon familial clustering of HNPCC-related tumors. As described above, some authorities consider the Amsterdam criteria as the formal description of Lynch syndrome.

Table 5

Original and revised Bethesda guidelines
OriginalRevised
  • Individuals with cancer in families that meet the Amsterdam criteria

  • Patients with two HNPCC-related cancers, including synchronous and metachronous colorectal cancer or associated extracolonic cancers (endometrial, ovarian, gastric, hepatobiliary, small bowel, or transitional cell carcinoma of the renal pelvis or ureter).

  • Patients with colorectal cancer and a first-degree relative with colorectal cancer and/or HNPCC-related extracolonic cancer and/or a colorectal adenoma with one of the cancers diagnosed before age 45 years, and the adenoma diagnosed before age 40 years.

  • Patients with right-sided colorectal cancer having an undifferentiated pattern (solid/cribriform) on histopathologic diagnosis before age 45 years.

  • Patients with signet-ring cell type colorectal cancer diagnosed before age 45.

  • Patients with adenomas diagnosed before age 40.

  • Colorectal cancer (CRC) diagnosed in a patient <50

  • Presence of synchronous, metachronous colorectal or other HNPCC-associated tumors regardless of age

  • CRC with the MSI-H-like histology diagnosed in a patient less than 60

  • CRC diagnosed in a patient with one or more 1st degree relatives with an HNPCC-related tumor, with one of the cancers being diagnosed under age 50

  • CRC in a patient with two or more 1st or 2nd degree relatives with HNPCC-related tumors, regardless of age

By contrast, the Bethesda guidelines (see Table 5) were designed to help predict which patients with colorectal cancer are likely to have a mismatch-repair mutation and should thus undergo further testing. However, both the Amsterdam criteria and Bethesda guidelines have been studied for predicting the presence of mismatch repair mutations. The Amsterdam criteria are much stricter than the Bethesda guidelines and thus have lower sensitivity but higher specificity. The Bethesda guidelines are also more applicable in small families.

Although the Bethesda guidelines and Amsterdam criteria continue to be used widely, several studies evaluating them (both the original and revised) have underscored the limitations of their accuracy in predicting the presence of mismatch repair mutations.11, 12, 20, 28, 29 A 2006 review of the literature reported that the sensitivity of the original Amsterdam criteria ranged from 54 to 91%.7 Such a wide range of estimates leaves substantial uncertainty as to the role of the Amsterdam criteria as a screening test for mismatch repair mutations. As described, above, there are many potential explanations for the variability across studies. In this report, we attempt to clarify important differences across studies that may help explain the variability.

In addition to the limitations regarding their predictive accuracy, there are practical problems with policies based on the implementation of these clinical criteria. Patients' report of the family history may not be accurate, particularly for cancers other than colorectal that are potentially related to HNPCC.30 Issues of uncertain paternity may also be relevant in some families while some families may be too small (or have insufficient contact among family members) to obtain a clinically meaningful family history. In addition, the criteria are not always remembered or practical to obtain; as a result many caregivers (including oncologists) fail to obtain a detailed family history, and among those who do, many do not act appropriately upon it.30, 31

Testing All Cancers Regardless of the Family History

Because of the limitations of relying on clinical criteria to guide testing, some authorities have proposed that tumors from patients with colorectal cancer be evaluated for markers of HNPCC regardless of the family history.8, 32 One of the largest studies evaluating this approach8 included 1066 patients with colorectal cancer whose tumors were tested for MSI. Patients with suggestive MSI results were tested for germ-line mutations in the mismatch repair genes (MSH2, MLH1, MSH6, and PMS2) by IHC, genomic sequencing, and deletion studies. A mutation causing HNPCC was detected in 23 patients (2.2 percent) of whom ten were older than 50 and five did not meet the Amsterdam criteria or Bethesda guidelines.

These data suggest that the Amsterdam or Bethesda criteria alone may miss as many as 22 percent of patients with HNPCC. However, only five additional individuals from the cohort of 1066 subjects (one-half of 1 percent) would have been identified by routine molecular analysis of all colon cancers fulfilling the Bethesda criteria, making such an approach impractically expensive for routine clinical use. Furthermore, the detailed laboratory analysis the authors performed on tumor tissue is not widely available. Despite these considerations, we include a strategy of testing all patients with colorectal cancer for mismatch repair mutations for comparison against alternative strategies.

Combinations of Family History and Laboratory Testing

Most expert guidelines on HNPCC suggest a combination of sequential laboratory testing in patients who fulfill the Amsterdam criteria or Bethesda guidelines to minimize costs and maximize test accuracy.1, 33 Approaches based on such a strategy have been considered to be cost-effective.19, 34 However, the exact methods and order of testing are unsettled. Proposed strategies include initial testing of tumors for MSI with or without IHC for loss or expression of mismatch repair proteins, with germline gene sequencing reserved for patients with suggestive results. Certain histologic features of HNPCC-related tumors may also raise clinical suspicion, but none is sufficiently specific to establish the diagnosis.35, 36 One report identified a specific oral manifestation (Fordyce granules) as highly predictive of mismatch repair mutations, but this observation has not yet been confirmed.37 Several other strategies for selecting patients for genetic testing have been described, but none has been widely adopted. Thus, this report focuses mainly on the predictive accuracy of testing tumor tissue for MSI and IHC.

Microsatellite instability occurs as a result of “slippage” of DNA polymerase during DNA replication of microsatellite DNA sequences (short dinucleotide or mononucleotide repeats).1 These are normally repaired by DNA repair mechanisms. In the presence of deficient mismatch repair functions (such as in HNPCC) these errors are not corrected, leading to a state that is referred to as microsatellite instability. The United States National Cancer Institute (NCI) defines the MSI-high (MSI-H) when two of five microsatellite markers from a standard panel display instability and the MSI-low phenotype when only one marker is unstable. Tumors without instability are labeled as microsatellite stable (MSS).

The NCI panel has been widely adopted in recent years, although some centers use additional or different markers. MSI-H tumors are generally more predictive of mismatch repair mutations than MSI-low tumors. However, approximately 10 to 20 percent of spontaneous colorectal cancer test positive for MSI-H, not all laboratories test for the full panel of microsatellite markers suggested by the National Cancer Institute, MSI-testing is not widely available, and archived tissue may not be readily available to perform such testing.

In some studies, MSI-H and MSI-L tumors are combined and compared to MSS, while in others each category has been considered separately. In this report, we record the specific methods used for determining MSI status and how tumors were categorized to permit valid comparisons among studies.

IHC techniques can identify the expression of mismatch repair proteins.38, 39 Testing for other mismatch repair proteins has not been performed routinely, although it may be important in some families. This approach is less costly than MSI testing and is technically much easier. Mutations associated with HNPCC generally lead to the absence of a detectable gene product, although some may lead to a dysfunctional protein that can still be detected (and hence cause a false negative result).

Some studies have suggested that almost all tumors in which MSH2 or MLH2 is absent by IHC demonstrate MSI-H, while approximately 8 percent of MSI-H tumors will demonstrate retained immunostaining.39 However, the extent to which IHC and MSI correlate with one another is not known precisely. Nevertheless, some authorities have proposed that IHC may be a suitable alternative to MSI testing while others consider the two to be complementary. In this report we attempt to clarify these issues by providing test characteristics of each approach used alone or in combination.

Analytic Validity

As noted above, there are several laboratory methods used for predictive testing for mismatch repair mutations and for genetic testing itself. The accuracy of these methods can be influenced by several factors such as the definition of the reference standard, how tissue was collected and processed, and the specific method by which it was analyzed. Laboratory errors (e.g., mislabeling of a specimen, contamination, incorrect interpretation of results) all weigh into overall accuracy. These considerations have been collectively referred to as analytic validity.

A related issue is the reliability of testing (both within a laboratory and between laboratories). In some clinical areas, reliability has been assessed by a method known as “proficiency testing” in which samples of known positive and negative biological materials are submitted blindly to a laboratory.40 Results can be used to determine sensitivity, specificity, and reliability. Proficiency testing for MSI became available in the United States in 2006.

In this report we attempt to define analytic validity and reliability of the predictive laboratory tests (i.e., IHC and MSI) and genetic testing methods. However, there are several limitations to attempting to assess these parameters using a literature-based approach:

  • The literature search was based upon HNPCC, not the specific laboratory techniques, thus limiting the pool of potentially relevant studies.

  • Many of the techniques described in the literature are experimental or old and thus do not reflect contemporary methods.

  • There is likely to be publication bias since information regarding reliability and accuracy of the laboratory methods have been evaluated by individual laboratories or by manufacturers of the testing methods.

  • Because it can be difficult to establish a clear reference-standard, many studies attempting to define analytic validity included the predictor tests in the reference standard, thereby making the results of test characteristics uninterpretable.

We attempted to clarify these points both by adhering to strict criteria for literature selection and in analyzing individual studies.

Benefits and Harms of Screening, Testing, and Subsequent Management Strategies

Genetic testing for a cancer predisposition has profound implications for the affected patients and their families. The genetic test results have the potential to prevent cancer in the affected patient and their families, and may influence how patients with cancer are managed, but they can also lead to harm from discrimination, the risks associated with surveillance strategies or other interventions (such as colectomy or hysterectomy), and the psychological impact of recognizing a cancer predisposition. These are issues that are common to all forms of genetically based diseases and represent areas of intense study. In this report we critically evaluate the literature exploring these issues in patients and their families with HNPCC from the perspective of the affected patients, their family and from the point of view of providers and policy-makers.

Enthusiasm for genetic testing is based upon the belief that knowledge of the genetic basis for a disease will allow for improved treatment and prevention. How these objectives can be best achieved in the care of patients and families with HNPCC has not been well established. Few high-quality studies have evaluated the effectiveness of screening strategies based upon the results of genetic testing for HNPCC. It is generally agreed that patients undergoing genetic testing should fully understand the implications of a positive and a negative result and the level of certainty of a positive or negative result as a predictor of disease.41 The knowledge-base used to counsel patients on these parameters is still evolving.

Correlation of genotypes with phenotypes in HNPCC is incompletely understood, as are the corresponding implications for screening for HNPCC-related tumors. At least two studies42, 43 and a cost-effectiveness analysis 19 suggested a reduction in colorectal cancer and mortality from colorectal cancer screening based upon results of genetic testing. However, the primary studies were not randomized and were vulnerable to selection bias. There is even less information regarding the effectives of screening for other forms of HNPCC-related cancers (particularly endometrial cancer).44, 45

The uncertain benefits must be balanced against the potential for harms, which include the risks associated with screening procedures, the potential for false-positive results leading to further, possibly unnecessary testing, and the psychological, social, and economic implications from stigmatization. An observational study that included 16 HNPCC and HNPCC-like families illustrated the difficulties that may be encountered when attempting to implement a program of genetic screening and counseling.46 Problems encountered included lack of compliance, ambiguous results of genetic tests, incomplete documentation of pathologic materials or medical history, poor cooperation among family members and/or their physicians, patient fear and anxiety and perception of insurance discrimination, and lack of knowledge among referring physicians. Thus, the realities of implementing a program for testing patients with colorectal cancer for HNPCC must be understood along with the full spectrum of implications of various strategies for establishing the diagnosis and testing family members

Chapter 2. Methods

Key Questions Addressed in This Report

The following Key Questions are addressed in this evidence report:

Key Question 1: Does risk assessment and HNPCC mutation testing in patients with newly diagnosed CRC lead to improved outcomes for the patient or family members, or is it useful in medical, personal, or public health decision making? (Over-arching question).

Key Question 2a: Assuming a clinical definition of the Lynch Syndrome, what proportion of patients has a mismatch repair mutation?

2b: Assuming a clinical definition of the Lynch Syndrome, what proportion of patients has MSI?

2c: Assuming a clinical definition of the Lynch Syndrome, what proportion of patients has abnormal protein expression by immunohistochemistry?

2: How accurate are various predictors assuming a genetic definition of the Lynch Syndrome?

Key Question 3: What are the harms associated with screening high-risk individuals for HNPCC?

Key Question 4: What is known about the analytic (sensitivity, specificity, reproducibility, reliability) and clinical validity of tests that identify HNPCC mutations?

Key Question 5: What are the harms associated with screening for high-risk individuals

Key Question 6a: What are the management options for CRC patients who are HNPCC positive?

6b: Does the identification of HNPCC mutations lead to improved patient outcomes in terms of early detection, mortality/morbidity or management decisions (e.g., counseling, surveillance, treatment, other decision making) by patients and providers?

Key Question 7: What are the harms associated with subsequent management options after identification of HNPCC mutations in CRC patients?

Key Question 8a: What is the efficacy of pre-test genetic counseling for informing family members of potential risks and benefits of testing?

8b: What is the accuracy of HNPCC testing in family members in predicting the risk of CRC?

8c: Do other factors, such as race/ethnicity, age, gender, or co-morbidities affect the accuracy of the testing?

Key Question 9: What are the harms associated with informing/counseling family members or with subsequent testing for HNPCC mutations?

Key Question 10a: What are the management options for family members of CRC patients who have a positive HNPCC test?

10b1: Does the identification of HNPCC mutations lead to improved outcomes in terms of decision-making by patients, family members and providers, or public health policy?

10b2: Does the identification of HNPCC mutations lead to improved outcomes in terms of early detection and mortality/morbidity of patients, family members?

Key Question 11: What are the harms associated with subsequent actions or interventions for family members?

These questions were formulated by EGAPP based upon an analytic model that begins with a patient with CRC and proceeds to genetic testing of family members. They broadly reflected the conceptual framework proposed by the ACCE Project from the Office of Genomics and Disease Prevention at the Centers for Disease Control and Prevention (CDC). The aim of the project is to develop a model system for assembling, analyzing, disseminating and updating existing data on the safety and effectiveness of DNA-based genetic tests and testing algorithms (See http://www.cdc.gov/genomics/gtesting/ACCE.htm for details). ACCE takes its name from its four components of evaluation—analytic validity, clinical validity, clinical utility and associated ethical, legal and social implications. It is intended to provide a model process for evaluating data on emerging genetic tests. The process includes collecting, evaluating, interpreting, and reporting data about DNA (and related) testing for disorders with a genetic component in a format that allows policy makers to have access to up-to-date and reliable information for decision making. The CDC Office of Genomics and Disease Prevention has previously published a mini review on HNPCC based upon the ACCE framework, which underscored the need for a more comprehensive review (see http://www.cdc.gov/genomics/gtesting/ACCE/fbr.htm).

The Key Questions were refined in several teleconferences with members of EGAPP and the Technical Expert Panel (TEP), and following review of draft reports.

Table 6

Summary of key questions
DomainKey questions addressed
Analytic validity4
Clinical validity2, 2a, 2b, 2c
Benefits and harms (including clinical utility and associated ethical, legal and social implications in the ACCE model)1, 3, 4, 5, 6a, 6b, 7, 8a, 8b, 8c, 9, 10a, 10b1, 10b2, 11

Table 7

Interpretation of overall quality grading of individual studies
GradeExplanation for quality scoring
AMost or all of the criteria are fulfilled and the conclusions of the study would be very unlikely to be affected by those that are not.
BSome of the criteria are fulfilled and the conclusions of the study would be unlikely to be affected by those that are not
CFew or no criteria were fulfilled and the conclusions of the study would be thought likely or very likely to be altered by multiple omissions in the required criteria for an acceptable study

Table 8

Quality criteria used to characterize studies of clinical validity
ItemCriteriaYesNoUn- clear
General quality criteria
1Were unselected patients with CRC included (i.e., were representative of patients seen in clinical practice not selected based upon a suggestive family history or other criteria that may cause selection bias)?
2Inclusion criteria clear?
3Did the whole sample or a random selection of the sample (i.e., total population of patients with CRC) receive verification using gene sequencing?
4Were the results of IHC or MSI or other predictors interpreted without knowledge of the results of sequencing (i.e., was there blinding)?
5Were the results of sequencing interpreted without knowledge of the results of the index test results (i.e., was there blinding)?
6Did authors describe how uninterpretable or intermediate results were analyzed (e.g., badly stained tissues etc)?
7Were withdrawals from the study explained?
8Did the authors report AND analyze results for deleterious MMR mutants?
Additional relevant quality items
9Was the description of how MSI or IHC or other predictors described in sufficient detail that others could replicate it (e.g., either a full description or relevant references)?
10Did authors describe what specimens were tested (e.g., blood, tumor tissue etc.)?
11Was MSI, IHC, sequencing or other testing performed at a similar time interval between specimen collection and processing for all subjects evaluated?
12Was there a clear description of which mismatch repair mutations were being tested for?
13Was there a clear description of percentage of eligible subjects for whom valid genotypic data were obtained across study groups (e.g., the proportion of patients who fulfilled and did not fulfill clinical criteria or those who did or did not have MSI who underwent sequencing.... i.e., avoid verification bias)?
14Were quality control methods described for the molecular and genetic tests?
15Did the authors attempt to address the reproducibility of results (reliability of tests)?
16Did the authors specify that samples from each group of subjects (e.g., those who fulfilled and did not fulfill clinical criteria or those who did or did not have MSI) included in each batch analyzed? (i.e., this helps minimize the effect of random errors.)

Table 9

Quality criteria used to characterize studies of analytic validity
Study qualityYesNoUnc
1Was the description of how MSI or IHC and other genetic techniques described in sufficient detail that others could replicate it (e.g., either a full description or relevant references)?
2Did authors describe what specimens were tested (e.g., blood, tumor tissue etc.)?
3Was MSI, IHC, other genetic testing performed at a similar time interval between specimen collection and processing for all subjects evaluated?
4Was there a clear description of which mismatch repair mutations were being tested for?
5Were quality control methods described for the molecular and genetic tests?
6Did the authors attempt to address the reproducibility of results (reliability of tests)?
7Did the authors specify that samples from each group of subjects (e.g., those who fulfilled and did not fulfill clinical criteria or those who did or did not have MSI) included in each batch analyzed? (i.e., this helps minimize the effect of random errors).
8Was microdissection (technique for removing only tumor tissue from gross specimen) performed?
9Did the study specify whether the biological tissues were from patients known to have HNPCC clinically?
10Did the study include a control group in which biological material was obtained from patients known not to have HNPCC clinically

Table 10

Quality criteria for studies on benefits and harms
Domain/questionPlace an “X” in oneOverall rating
Selection biasABC
(strong)(moderate)(weak)
Are individuals selected to participate likely to be representative of target population?Very likelySomewhat likelyNot likely
What % of selected individuals agreed to participate?80–10060–79<60NDNA
Allocation biasABC
(RCTs only, for quasi- experimental, case-control/before/after, no control group or other skip to “Confounders”)(strong)(moderate)(weak)
Is the method of random allocation stated?YesNo
If the method of random allocation is stated, is it appropriate?YesNo
Was the method of random allocation reported as concealed?YesNo
ConfoundersABC
(strong)(moderate)(weak)
Prior to the intervention, were there between group differences for important confounders reported in the paper?YesNoCan't tell
If there were differences between groups for important confounders, were they adequately managed in the analysis?YesNoNA
Were there important confounders NOT reported in the paper (describe above under quality score)?YesNo
BlindingABC
(strong)(moderate)(weak)
Was (were) the outcome assessor(s) blinded to the intervention or exposure status of the participants?YesNoNDNA
Data collection methodsABC
(strong)(moderate)(weak)
Were data collection tools shown or are they known to be valid?YesNo
Were data collection tools shown or are they known to be reliable?YesNo
Withdrawals and dropoutsABC
(strong)(moderate)(weak)
Indicate the % of participants completing the study. (If the % differs by groups, record the lowest).80–10060–79<60NDNA
AnalysisABC
(strong)(moderate)(weak)
Is there a sample size calculation or power calculation?YesPartiallyNo
Is there a statistically significant difference between groups?YesNoND
Are the statistical methods appropriate?YesNoND
Indicate the unit of allocationCommunityOrganization/groupProviderClientInstitution
Indicate the unit of analysisCommunityOrganization/groupProviderClientInstitution
If the unit of allocation and analysis differed, was the cluster analysis done?YesNoNA
Is the analysis performed by intervention allocation status (i.e., intention to treat) rather than the actual intervention received?YesNoCan't tell
Intervention integrityABC
(strong)(moderate)(weak)
What % of participants received the allocated intervention or exposure of interest?80–10060–79<60NDNA
Was the consistency of the intervention measured (i.e., intervention was provided to all participants in the same way)?YesNoNDNA
Is it likely that subjects received an unintended intervention (contamination or cointervention) that may influence the results?YesNoCan't tell
The Key Questions and subset questions were divided conceptually into three general domains: clinical validity; analytic validity; and benefits and harms of screening, genetic testing and various management strategies from the patient, family member, provider, and public health perspectives. (Table 6) These domains were based upon overlapping concepts implied by the Key Questions and reflect the core components of the ACCE model. Thus, Key Questions were grouped according to the domain, and studies that addressed one of the three domains were often relevant to more than one Key Question, but generally not to more than one domain.

We undertook the following steps in conducting this review:

  • Performed an electronic search of the literature followed by review of relevant abstracts and then full-text review of potentially relevant studies.

  • Retrieved additional studies from bibliographies of retrieved citations and suggestions of the TEP.

  • Included or excluded studies based upon prespecified criteria.

  • Identified duplicate reports of the same patients by comparing authors and study centers. Data were included only once, except when duplicate studies reported complementary information (e.g., data at one month and then one year).

  • Developed data extraction forms for each domain (i.e., three data extraction forms) and tested them until we achieved consensus on the meaning of the data elements in each extraction form.

  • Evaluated each study critically according to quality criteria described below.

  • Verified all data with at least two extractors.

  • Summarized data in tables that addressed specific Key Questions (or groups of Key Questions) that corresponded to the three domains described above. Because only a few studies addressed analytic validity, we described them in the text of the report rather than in tables.

  • Reviewed drafts of the summary tables with members of the TEP.

  • Pooled data where studies used similar methodology and definition of endpoints using meta-analysis to provide a point estimate and 95% confidence interval, mainly for questions pertaining to clinical validity. We performed multiple sensitivity analyses to explore possible explanations when studies demonstrated statistically significant heterogeneity.

  • Constructed models depicting various strategies for identifying HNPCC among patients with colorectal cancer using decision trees. The models were based upon parameters estimated from data presented in this report.

  • Prepared a draft report, which underwent peer review and addressed each comment in a revised final report.

Literature Search Strategy

We conducted a literature search of MEDLINE® using PubMed on January 10, 2006. We used MEDLINE® subject headings and text words to capture relevant English language publications of human studies. Additional sources of potentially relevant studies included technical experts and hand searching of bibliographic references of reviews. An automatic updated search results from PubMed was received on April 1, 2006 after which additional studies were included only if the investigators or TEP considered them to provide substantive new information that might influence the conclusions (see Appendix A *).

We reviewed all abstracts for their relevance to the Key Questions and retrieved the full-text article of potentially relevant citations. We reviewed bibliographies of studies included in the report (as well as previous review articles or meta-analyses, which were not included) to identify additional citations, all of which were retrieved for review. We identified duplicate reports of the same patients by comparing authors and study centers. Duplicate reports were excluded unless they provided complementary information (such as outcomes at different time points) in which case they were considered together.

Inclusion/Exclusion Criteria and Data Extraction

We applied prespecified inclusion and exclusion criteria in considering each study. The criteria corresponded to the three domains described above.

Studies Related to Analytic Validity

We required the following for studies of analytic validity:

  • The study evaluated biological material from patients with colorectal cancer considered to be at risk for HNPCC. This criterion was selected to choose studies evaluating laboratory techniques that were directly applicable to the spectrum of genotypes associated with HNPCC. We did not consider it feasible to conduct a systematic review on the individual laboratories tests used for other conditions.

  • Reported any of the following (these criteria were selected to choose studies evaluating the most common tests performed in HNPCC):

    • 1

      Proportion of tumors that were MSI-H with National Cancer Institute (NCI) panel of markers (i.e., BAT-25, BAT-26 D2S123, DS346 and D17S250) versus other markers

    • 2

      Sensitivity or specificity of MSI-H using NCI markers compared with a reference standard that the study claimed was better

    • 3

      Sensitivity or specificity of IHC compared with an immunohistochemical standard that study claimed was better

    • 4

      Sensitivity or specificity of a genetic technique compared with a reference standard (or combination of standards)

    • 5

      Reliability of MSI, IHC or genetic methods across laboratories or within a laboratory.

  • Data were extractable into 2×2 tables.

We excluded studies that included the index test in the reference standard. For example, some studies attempted to calculate sensitivity of a specific NCI MSI marker by comparing it with a reference standard that included the marker plus additional markers. Such an approach produces an invalid estimate of sensitivity since the calculation includes the index test (i.e., the specific NCI marker) in the numerator and the denominator.

Studies Related to Clinical Validity

We required all three of the following criteria to be met for studies of clinical validity with extractable data:

  • Enrolled patients with colorectal cancer

  • Compared an index test to genetic testing (at least one of the following: suggestive family history, MSI, or IHC)

  • Sought mutations using DNA sequencing (or other similar genetic approaches) for a minimum of MLH1 and MSH2.

HNPCC has been defined clinically and genetically as described in Chapter 1. We used both approaches depending upon which Key Questions were being addressed. In all cases, the definitions used are described explicitly in the tables and figures.

Key Questions 2a–2c focus on the prevalence of MMR mutations, suggestive MSI or ICH among patients with a clinical definition of HNPCC. We defined Lynch Syndrome I and Lynch Syndrome II using the Amsterdam I and II criteria, respectively. Studies that reported this proportion or provided sufficient data for it to be calculated were eligible.

We required that studies evaluated all available patients who fulfilled the Amsterdam criteria or a representative (random) sample thereof. We excluded studies that did not evaluate all patients because they selected a non-random patient sample (e.g., patients who fulfilled the Amsterdam criteria who were also younger than a certain age).

Key Question 2 pertains to the predictive accuracy of clinical or laboratory features for determining the presence of mismatch repair mutations. We assessed the performance of different clinical and laboratory predictors (preliminary tests) to identify carriers of MMR gene mutations. We considered all studies that provided relevant data. When the primary study reported proportions rather than actual counts, we reconstructed the 2×2 tables using the information conveyed by the proportions and their 95% confidence intervals.

We analyzed the following predictors:

Laboratory predictors:

  • 1

    MSI high versus MSI stable.

  • 2

    MSI high and low versus MSI stable.

  • 3

    Suggestive IHC versus non suggestive IHC.

Clinical predictors specified a priori:

  • 1

    Amsterdam I criteria fulfilled versus not fulfilled.

  • 2

    Amsterdam II criteria fulfilled versus not fulfilled.

  • 3

    Modified Amsterdam criteria fulfilled versus not fulfilled.

  • 4

    Bethesda guidelines fulfilled versus not fulfilled.

  • 5

    Revised Bethesda guidelines fulfilled versus not fulfilled.

  • 6

    Young age of onset (<50 years) versus later age of onset

  • 7

    Presence of CRC or HNPCC related cancer in first degree family versus sporadic CRC cases.

  • 8

    Presence of CRC or HNPCC related cancer in family (any definition) versus sporadic CRC cases (irrespectively of how they were selected).

Clinical predictors specified a posteriori:

  • 9

    Presence of multiple tumors in a CRC proband versus probands without multiple tumors.

  • 10

    Presence of young age of onset (<50 years) or suggestive family history of cancer or multiple tumors in a CRC proband (i.e., predictors #6 or #7 or #8) versus absence of all three characteristics.

We focused only on patients with CRC who received at least some form of genetic testing to minimize the effects of verification bias. Verification bias occurs when patients with a negative test result are not evaluated with the reference test.47 We generally did not accept screening with MSI or IHC as a substitute for genetic testing. A single exception pertained to studies assessing clinical predictors among newly diagnosed, unselected, non-referral CRC, because this was of particular clinical importance and there were few studies available for analysis. For such studies we accepted the authors' assumption that patients who were not tested for mutations based on MSI and IHC test results were indeed mutation negative.

Studies Related to Benefits and Harms

For studies related to benefits and harms, we accepted studies of virtually any design and using any definition of HNPCC that reported any outcomes or other findings pertinent to patients or families with HNPCC, or provided insights into these issues from a public health perspective. We did not confine our inclusion criteria to studies of patients with colorectal cancer even though this report focuses on patients with colorectal cancer. Benefits and harms of genetic testing, counseling and other management approaches are pertinent to the full spectrum of tumors associated with HNPCC. For example, a woman with colorectal cancer who is found to have HNPCC is at risk for other forms of HNPCC-related cancer (such as endometrial cancer). Thus, the benefits and harms related to genetic testing may not only be relevant to clinical issues related to colorectal cancer management (and prevention of metachronous cancers) but also management (and prevention) of other HNPCC-related cancer in the patient or her family members. We expanded the scope of all pertinent Key Questions to provide as comprehensive a view on these issues as possible.

Although we attempted to be as comprehensive as possible in including studies related to benefits and harms, we occasionally encountered studies that did not report any outcomes or other findings that appeared to be relevant to the Key Questions and thus excluded them. As noted above, the reasons that specific studies were excluded are summarized in the Appendix D *. List of Excluded Studies.

Evaluation of Study Quality

We evaluated the quality of each study based upon multiple quality features. Evaluation of study quality is a complex process since there is no established method that can comprehensively describe all features that are pertinent to the validity of a study. The included studies varied in the rigor with which they were designed, conducted, analyzed, and reported. Deficiencies in any of these areas can lead to biased reporting and interpretation of results.

Furthermore, the quality of a study and its applicability are not always related; a study that is considered to be of relatively low quality may be more applicable to a specific question (i.e., answers it directly) than a study of higher quality. In addition, assessment of quality is based upon information reported and not necessarily how the study was conducted since there may be omissions or editorial constraints in the published manuscript.

We hoped to critically assess the quality of each study and to present studies based upon their applicability to each Key Question. Thus, we attempted to feature studies that answered Key Questions most directly and reported a composite quality score (A, B or C, described below) to allow comparison among studies. We based the composite quality score upon an overall assessment of the degree to which individual elements describing study quality were fulfilled and the implications of those that were not. There was an element of judgment for the final scoring of each study but we attempted to be as consistent as possible.

The composite quality scores are helpful for giving a shorthand, qualitative appraisal of the overall study quality, but they do not necessarily reflect particular deficiencies or strengths that might be important for fully understanding the results of the study or interpreting the body of knowledge. Thus, strengths and weaknesses of individual studies might be important when considering their validity and relevance for specific Key Questions. We attempted to highlight study features that we considered to be most relevant while making comments as to specific deficiencies to allow readers to have a view on this that was transparent and succinct. The components of the individual quality scores for each study are available in Appendix C *. In addition, important features of each study are summarized in the tables included in the body of the text following each Key Question to allow for easy comparison among them.

We used the composite quality score formally for sensitivity analysis, mainly for studies of clinical validity to determine whether study quality correlated with test characteristics. For example, we determined whether sensitivity and specificity were better for high compared with low quality studies.

The quality criteria selected for this report (summarized below) were based upon discussions with the TEP and quality elements that have been proposed to be relevant for the specific types of studies that we included. All investigators discussed details of the meaning of each quality element to help assure that they were applied uniformly. Investigators discussed the quality of individual studies whenever there were questions related to the overall score that the study should receive until consensus was achieved.

The Tufts-NEMC EPC has used similar systems for several other evidence reports. However, it must be acknowledged that the reliability and validity of quality scoring systems used for systematic reviews, including the one used for this report, have not been extensively evaluated.48

We used the following approach for grading studies related to clinical validity. These criteria were adapted, in part from the Centers for Disease Control and Prevention and the QUADAS tool for assessing diagnostic test accuracy.49, 50

We used the following quality criteria for studies related to analytic validity. These criteria were adapted from those proposed by the Centers for Disease Control and Prevention.49

We used the following quality criteria for studies related to benefits and harms. These criteria were adapted from the Cochrane Collaboration Handbook for Systematic Reviews of Health Promotion and Public Health Interventions for Evaluation of Studies Related to Public health.51

Data Synthesis, Analysis, and Reporting

Questions Related to Analytic Validity

As will be discussed in Chapter 3, we encountered only a few studies of analytic validity, and thus these are described in the text rather than in tables. There were insufficient data for a pooled analysis.

Questions Related to Clinical Validity

Studies relevant to each Key Question were grouped together, organized according to their applicability to the specific Key Question and their overall quality score. In some cases, Key Questions that had substantive overlap in the type of findings reported were grouped together to provide a comprehensive yet succinct overview of the literature.

Questions related to clinical validity: For questions related to clinical validity, sensitivity and specificity were based upon the definitions summarized in Chapter 1. We presented studies by categorizing them for important features (such as use of similar definitions and selection criteria) so that similarities and differences would be as transparent as possible.

Prevalence of MMR Mutations, MSI or Suggestive IHC Among Patients Fulfilling Amsterdam I and II Criteria. For each study we estimated the proportion (and exact binomial 95% confidence interval) of Amsterdam I and II patients with MMR mutations, MSI or suggestive IHC. We estimated the corresponding summary prevalence values with random effects meta-analyses.52, 53 For the quantitative syntheses, proportions from each study were logit transformed to stabilize variances, and then back-transformed to their natural scale. Analyses using the more drastic Tuckey-Freeman arcsin transform yielded largely similar estimates, and thus are not reported.

Diagnostic Ability of Predictors (Preliminary Tests) To Identify MMR Mutation Carriers. As mentioned above, the preliminary tests that identify MMR mutation carriers are either sets of clinical criteria, or laboratory tests (namely MSI and IHC). Different considerations are applicable to the analysis of clinical and laboratory predictors across a selection of studies.

Considerations on study populations for clinical predictors (preliminary tests). In HNPCC the clinical preliminary tests are highly susceptible to spectrum effects across populations that have been selected with eligibility criteria of a clinical nature. Although the detailed analysis of this statement is cumbersome, it can be intuitively evaluated through an illustrative example. Assume that the preliminary test of interest is the clinical criterion of “age less than 50 years at diagnosis of CRC”. It is expected that the sensitivity and specificity of this criterion will be different among unselected people with CRC compared to CRC patients who were less than 55 years at diagnosis. The second population has already been “pre-selected” based on a clinical criterion (less than 55 years at CRC diagnosis) that is quite similar to the evaluated “preliminary test” (less than 50 years at CRC diagnosis). This pre-selection alters the composition of the population with respect to the clinical predictor in a systematic and non-random way, both among MMR mutation carriers and among non-carriers. The net effect is a change in the apparent sensitivity and specificity across populations with increasing prevalence of MMR mutation carriers (spectrum effects).

Because of the aforementioned consideration we decided a priori not to synthesize the sensitivity and specificity of clinical predictors across populations that had been defined using different clinical eligibility criteria. Identifying such homogeneous populations is challenging, especially given the incomplete descriptions of the studied populations in many of the assessed studies.

Thus we decided to focus on populations fulfilling sets of criteria that are most frequently used for HNPCC, are well known, and presumably assessed identically by different research teams. In order of increasing prevalence of MMR mutation carriers these homogeneous populations were: unselected, incident CRC, patients selected by the Bethesda guidelines and revised Bethesda guidelines, modified Amsterdam criteria, and Amsterdam II and I criteria. We also created separate estimates for the sensitivity and specificity for patients who were pre-selected based on suggestive MSI and/or IHC results.

Considerations on study populations for laboratory predictors (preliminary tests). The above consideration may not be as important for laboratory predictors (e.g., IHC) because there is no strong reason to assume that pre-selection with a clinical eligibility criterion (e.g., “age less than 55 at CRC diagnosis”, as above) in a study would be correlated with IHC results both in MMR carriers and in those who are not MMR mutation carriers. However, it is possible that some laboratory predictor tests (e.g., MSI analysis) may be vulnerable to spectrum effects.54 Thus, for laboratory predictors, we did not require the strict similarity of populations across studies as above, and considered all studies together.

Separate analyses of sensitivity and specificity. For each study we estimated the sensitivity and specificity (and exact binomial 95% confidence intervals thereof) for the clinical and laboratory predictors (preliminary tests) of interest. As described before, we derived summary sensitivity and specificity estimates with random effects syntheses using logit-transformations of proportions for the meta-analyses. As a general rule, this approach tends to underestimate the diagnostic performance, because it ignores the correlation between the sensitivity and the corresponding specificity from the same study. However, it provides a pooled estimate (and 95% confidence interval) of sensitivity and specificity that can be useful for providing overall appraisal of test performance.

Summary receiver operating characteristic curve analyses. For laboratory predictors only, we summarize test performance graphically using summary receiver operating characteristic curve (SROC) analyses. SROC curve analysis can be used to graphically describe the tradeoff between sensitivity and specificity across studies. The sensitivity and specificity of each study are represented in the graph, thereby depicting the operating characteristics of a group of studies.

The tradeoff between sensitivity and specificity generally reflects the threshold for calling a test positive or negative. Such a tradeoff can be understood easily when considering a single study that assessed various cutoff values of a diagnostic test. By contrast, the threshold implied in an SROC curve analysis is not always apparent. Different estimates of sensitivity and specificity across studies may be due to several considerations such as variations in how the tests were implemented (e.g., differences in the number of microsatellite markers used) or in interpretation of results. With regard to the latter, the same specimen (e.g., a tumor stained for IHC) may be interpreted differently when the interpreter believes the test is being used for screening versus confirmation of a high-risk patient. Thus, by grouping studies according to specific study features, SROC analysis can be used to help explain differences in test characteristics across studies that seemingly used the same diagnostic test. However, it does not necessarily define an explicit threshold effect.

The area under a receiver operating curve has been used to describe the overall diagnostic ability of a test; the greater the area, the better the test. However, calculating the area under a SROC curve requires extrapolation outside the range of the sensitivity and specificity values of the analyzed studies and thus may not produce a valid appraisal of the test's accuracy. As a result, we did not attempt to calculate the area under the SROC curve.

Subgroup and Sensitivity Analyses. We defined a priori factors that might explain heterogeneity of pooled estimates. These included:

Overall quality. We compared results from high and low quality studies (as defined by the A, B or C classification described above).

Study size. For the questions relating to the proportion of patients with the Lynch Syndrome with mutations or abnormal MSI or IHC results, we used a cutoff of 20 patients (≥20 versus <20) to distinguish larger and smaller studies. Although this was a largely arbitrary cutoff, a single misclassification in smaller studies would result in more than a 5% misclassification rate, which we considered clinically important. Similarly, we used a cutoff of at least 40 people in the 2 by 2 table for studies that were used to assess sensitivity and specificity.

Characteristics of how genetic testing was performed. Studies were categorized in groups according to the comprehensiveness of the genetic testing strategy they used. As least comprehensive, we classified studies that used only gene screening methods to detect MMR mutations, and did not perform sequencing on any sample; performed sequencing on samples with suggestive gene screening analyses; or performed sequencing on all available samples. As most comprehensive we considered studies that performed sequencing and analyses for large genomic deletions/rearrangements in all samples. The application of more advanced techniques such as conversion analysis or mono allelic mutation analysis (MAMA) was only sporadic or in the context of demonstrating their feasibility in only a few samples, and thus did not comprise a separate category. Examples of genetic screening strategies are single-stranded conformation polymorphism (SSCP), conformation sensitive gel electrophoresis (CSGE), denaturing gradient gel electrophoresis (DGGE), and denaturing high-pressure liquid chromatography (DHPLC). Examples of methods to detect large genomic deletions are: southern blotting and multiplex ligation-dependent probe amplification (MLPA). These methods are described in more detail on Chapter 3 in the section on Analytic Validity.

Whether and how the study defined pathogenic mutations. We determined if and how studies defined mutations as being pathogenic (i.e., known to be associated with HNPCC versus a variant of unknown significance). It is possible that the same mutations might have been defined as pathogenic in one study and non pathogenic in another.55 Furthermore, not all definitions are equally valid and the methods used to define pathogenicity may not have been conducted with equal rigor. For example evidence from functional studies (i.e., in which the function of the mutated gene was assessed) may provide strong support that the mutation is pathogenic, whereas absence of the mutation in a small sample of healthy controls is not as strong.

Characteristics of MSI testing. We assessed whether studies that used the panel of markers recommended by the NCI and whether they performed microdissection. Microdissection helps assure that the sample analyzed was from malignant tissue and did not contain DNA from surrounding, healthy colonic tissue. Microdissection is not pertinent to germline MMR mutation testing or IHC. Germline mutations are typically assessed in blood samples (non-malignant tissue). For IHC, a pathologist studies a tissue section to evaluate MMR protein expression in regions of malignancy (microdissection it typically not needed).

The sample selection process. We attempted to identify studies that had a biased sample selection process. Studies with transparent sample selection process clearly stated that they selected their samples among all available patients using a set of eligibility criteria. Studies with non-transparent sample selection process did not report that they applied the same criteria to all available patients. For example, they may have used a convenience sample of cases from various sources.

Despite our efforts, we caution that studies that applied seemingly transparent eligibility criteria may still have a highly biased selection process. For example, studies from a referral center may have recruited patients with a relatively higher prevalence of familial cancer compared with studies that recruited consecutive patients with colorectal cancer in the community.

Whether the study used consecutive, unselected patients with CRC. We identified studies that used consecutive CRC (including retrospective studies that assessed all unselected patients that were diagnosed during a specific time period) that were otherwise nonselective or representative of the general population. Populations evaluated in studies from specialized centers or studies that imposed clinical or other criteria to select their populations were not considered to be representative of the general population.

Decision Tree Model Methods. We performed analyses using decision trees to model the expected outcomes with different testing strategies from the payers'/third party perspective. The outcomes were the number of incident CRC with positive diagnosis for HNPCC, and the number of tests (MMR, MSI, or IHC) needed to detect them. We also assessed how many patients found to be mutation carriers with each strategy would be truly positive.

The decision trees pertain to a cross-section in time. We used a hypothetical population of 100,000 incident cases of CRC. This number is in the order of incident cases expected annually in the US (approximately 150,000, given an annual incidence of 50/100,000 and a population of 300 million) and is a number convenient for calculations.

We assessed nine different strategies, which were most commonly represented in the studies summarized in this review. The strategies used clinical criteria, MSI, IHC or a combination of clinical criteria with MSI or IHC to select patients for MMR mutation testing. The probabilities that were used in the decision trees were derived from the eligible studies. See Chapter 3 for a complete description of the modeled strategies and the probabilities that were used.

Questions Related to Benefits and Harms

For studies related to benefits and harms, we grouped studies according to their relevance to the Key Questions, presenting comparative trials and higher quality studies first followed by qualitative and other types of descriptive studies. Statistical comparisons made within each study are presented; we did not attempt to recalculate these comparisons; however, specific comments about study methods are included in footnotes.

The majority of studies related to benefits and harms were qualitative. Among the comparative trials, there were insufficient studies of similar design to allow for meta-analysis.

We present major findings that were considered to be clinically important or addressed (directly or indirectly) the Key Questions and subset questions. We described together studies that used similar endpoints (e.g., quality of life instruments or depression scales) and interventions (e.g., surveillance colonoscopy) whenever possible.

Evidence and Summary Tables

Evidence tables offer a detailed description of the studies that addressed each of the Key Questions. Each study appears once regardless of how many interventions or outcomes were reported. We did not attempt to construct evidence tables for all the extracted studies but all data extracted for each study are included in data extraction forms that are available in Appendix C *.

Summary tables succinctly report summary measures of the main study features and outcomes evaluated. They are designed to facilitate comparisons and synthesis across studies. Individual studies may appear more than once if the data they contain are relevant to more than one Key Question. The summary tables are featured in sections corresponding to each Key Question in Chapter 3.

Chapter 3. Results

Overview

An external file that holds a picture, illustration, etc., usually as some form of binary object. The name of referred object is er-hnpccf1.jpg.

   Figure 1. Analytic framework that served as the basis of the key questions proposed by the CDC Office of Genomics and Disease Prevention 2005

An external file that holds a picture, illustration, etc., usually as some form of binary object. The name of referred object is er-hnpccf2.jpg.

   Figure 2. Literature search results

* Analytic framework that served as the basis of the key questions

The MEDLINE® literature search produced 3,018 abstracts, which were screened for their relevance. The full text article was retrieved for all studies that appeared to be relevant to the Key Questions. With the addition of titles from technical experts and reviews of bibliographies, 523 publications were retrieved for review. One hundred fifteen papers fulfilled eligibility criteria but 11 were duplicate reports and were therefore excluded (or used to provide supplementary information as described in Chapter 2). Thus, 104 unique studies were included for this review (40 for clinical validity, 3 for analytic validity and 61 for benefits and harms) while 410 did not meet the inclusion criteria and were rejected (see Figure 2; see also Appendix D *).

In the following sections, we present results for Key Questions as described in Chapter 2. The Key Questions pertaining to each domain (i.e., clinical validity, analytic validity, and benefits and harms) are presented within each section.

Analytic Validity

Key Question 4: What is Known About the Analytic (Sensitivity, Specificity, Reproducibility, Reliability) and Clinical Validity of Tests That Identify HNPCC Mutations?

graphic element

Definition

The analytic validity of a laboratory test refers to its accuracy and reliability for identifying a finding of interest (such as a genotype). There are four general elements of analytic validity (see http://www.cdc.gov/genomics/gtesting/ACCE.htm for further details):

  • 1)

    Sensitivity (i.e., the ability to detect a finding when it is present)

  • 2)

    Specificity (i.e., the ability to exclude a finding when it is absent)

  • 3)

    Laboratory quality control (i.e., the procedures used in a testing laboratory to ensure that results fall within specified limits)

  • 4)

    Assay robustness (i.e., how resistant the assay is to changes in pre-analytic and analytic variables).

Laboratory Tests Used in HNPCC

The major laboratory tests used in the evaluation of patients suspected of having HNPCC include testing of tumor tissue using IHC, MSI testing, or germline (generally from peripheral blood mononuclear cells) testing for mismatch repair defects. Family members generally undergo only germline genetic testing (unless they have also developed a relevant cancer), ideally based upon the genotype of the proband. Detection of a pathogenic mutation (i.e., one known to be associated with HNPCC) in a proband permits testing of at-risk family members for the genotype. Family members with the same genotype have HNPCC while HNPCC can be excluded in those who do not. The situation is more complex when the proband does not have a detectable DNA alteration associated with HNPCC or when an alteration with unclear clinical significance is detected. In such cases, it may not be possible to exclude HNPCC in family members; as a result, they may be empirically offered enhanced cancer surveillance.

Table 11

Genetic testing strategies used by studies included in quantitative analyses
Study, yearBrief description of genetic strategyMMR genes other than MLH1, MSH2SequencingGene screeningDeletion analysis
Syngal, 2000 Wahlberg, 2002 Rossi, 2002 Wolf, 2005 Lee, 2005 Moslein, 1996 Debniak, 2000 Peel, 1999PCR → SequencingNoAll samplesXX
Farrington, 1998PCR → IVSP → SequencingNoAll samplesX
PCR → Sequencing
Barnetson, 2006PCR → Sequencing (MSH6, some MLH1 and MSH2 exons)MSH6All samplesX
PCR → DHPLC → Sequencing
Wang, 1999PCR → IVSP → SequencingMSH6Practically all samplesa
PCR → HD → SequencingPMS1
in vivo MLH1 expression analysisPMS2
PCR → Sequencing (of all other samples)
Durno, 2005[used PTA and Sequencing]NoSome samples?bX
Aaltonen, 1998MSI → PCR → DGGE (some samples) → Sequencing;NoSome samples
MSI → PCR → Sequencing (all other samples)
PCR for founder mutations in MLH1 (all samples)
Salovaara, 2000MSI → PCR → SequencingNoSome samplesX
PCR for founder mutations in MLH1 gene
Liu, 2004 Colombino, 2005 Yuan, 2004 De Abajo, 2005PCR → DHPLC → SequencingNoSome samplesX
Southey, 2005PCR → DHPLC → SequencingMSH6Some samplesX
MLPA (in only 10 tumors)cPMS2
Curia, 1999 de Leon, 1999 Dieumegard, 2000 Yuan, 1998PCR → SSCP → SequencingNoSome samplesX
Katballe, 2002 Christensen, 2002PCR → SSCP & HD →SequencingNoSome samplesX
Luce, 1995PCR → IVTT → SequencingNoSome samplesX
Zhu, 2005MLPA → SequencingNoSome samplesX
Park, 1999PCR → SSCPPMS1None
Southern blottingPMS2d
Callistri, 2000PCR → SSCPNoNoneX
Lamberti, 1999PCR → SSCPNoNoneX
RT-PCR, PTA
Samowitz 2001MSI → PCR → SequencingNoSome samplesX
MSI → PCR for founder mutations in MLH1
Raedle, 2001 Pistorius, 2000MSI → PCR → SequencingNoSome samplesXX
Terdiman, 2001MSI → PCR → DGGE → SequencingNoSome samplesX
Nakahara, 1997MSI → PCR→ SSCP → SequencingNoSome samplesX
Casey, 2005MSI, IHC → PCR → SequencingNoAll availableeX
MSI, IHC → Conversion analysis
MSI, IHC → Deletion analysis
Pinol, 2005MSI, IHC → PCR → SequencingNoSome samplesX
MSI, IHC → MLPA
Stormorken, 2001Not describedMSH6UnclearUnclearUnclear

DHPLC: denaturating high performance liquid chromatography; DGGE: Denaturating gradient gel electrophoresis; HD: heteroduplex formation; IHC: immunohistochemistry; IVSP: in vitro synthesized protein test; IVTT: in vitro transcription translation; MLPA: multiplex ligation-dependent probe amplification; MSI: Microsatellite instability testing; PCR: polymerase chain reaction; SSCP: Single-stranded conformation polymorphism.

Shown are the genetic strategies used in the various studies that were assessed in the quantitative analyses of this report. All studies assessed MLH1 and MSH2 at minimum.

a

In Wang 1999 essentially all patients were sequenced, but not completely; however, complete sequencing was performed for those testing negative with other methods.

b

Durno 1999 does not describe the used strategy in detail.

c

The 10 tumors were MSI positive, IHC negative and MMR negative with the usual strategy.

d

In Park 1999 PMS1 was assessed in 27 samples and PMS2 on 24 samples out of 123 samples for MLH1 and MSH2 (all were negative, unclear how the 27 and 24 were selected).

e

All available patients were tested with full sequencing. However, the sample was assembled mainly on the basis of suggestive MSI testing (85 out the 89 patients had suggestive MSI testing).

The laboratory tests used in HNPCC have been described in several reviews, including a comprehensive summary published in 2006 to which we refer readers seeking a detailed review.7 The specific tests and order of testing used in the studies included in this review are summarized in Table 11.

Immunohistochemistry. Pathogenic mutations in mismatch repair proteins usually lead to the absence of a detectable gene product providing the rationale for IHC techniques used to detect underexpression. Tumors from patients suspected of having HNPCC (based upon clinical or pathologic findings) can be stained for mismatch repair proteins. The surrounding normal colonic tissue can be used as a positive control.

As noted in the table below, testing is available commercially for MLH1, MSH2, MSH6 and PMS2, although the extent to which various laboratories stain for all of these proteins is unclear. Furthermore, such staining is relatively easy to perform and available in kits. As a result, local pathologists, who may select to stain for some or all of these proteins, can perform it.

Knowledge of how the mismatch repair proteins interact during DNA repair can help interpret the results of such testing and be useful for guiding germline genetic testing. For example, MSH2 forms a heterodimer with MHS6; MLH1 complexes with PMS2 and binds to the MSH2–MSH6 heterodimer. When MSH2 is not expressed in a tumor, MSH6 is also not expressed. Because MSH2 and MLH1 are the most common mismatch repair proteins implicated in HNPCC, a patient who has a tumor that does not stain for MSH2 (and whose normal surrounding colonic mucosal demonstrates preserved staining) is most likely to have a mutation in MSH2 (but could also possibly have a mutation in MHS6). Similarly, MSH6 may be the likely gene involved in a patient with a tumor that expresses MLH1 and not MSH6 (again with normal staining patterns in surrounding colonic mucosal). The situation is more complex with lack of expression of MLH1; promoter hypermethylation of MLH1 is common with sporadic colorectal cancer and may lead to its underexpression. Some laboratories offer methylation analysis to help determine whether lack of expression is due to promoter hypermethylation. Such an approach has been suggested in various reviews of HNPCC.

Immunohistochemistry has an advantage over other techniques (particularly MSI testing) since it is much easier to perform and is less expensive. However, the technique is vulnerable to the quality of tissue preparation, staining, and interpretation. This concern is not merely, hypothetical; our literature search revealed that sensitivity to detect loss of MSH2 expression ranged from 84 to 100 percent in a study of 18 participating centers performing such testing.56 Variability in specificity was even greater (see below).

Microsatellite Instability. Microsatellite instability (MSI) refers to a variety of patterns of microsatellite repeats observed when DNA is amplified from a tumor with defective mismatch repair compared with DNA amplified from surrounding normal colonic tissue. Repetitive mono- or dinucleotide DNA regions are particularly vulnerable to defective mismatch repair. For example, the mononucleotide sequence “AAAAAAAAAAAAAAAAAAAAAAAAAA” is located on chromosome 2P, near the MSH2 gene locus. This sequence is referred to as the “Big A Tract-26” (BAT26). As a result, a tumor suspected to result from mismatch repair defects can be tested for the presence of these repeats.

MSI testing involves amplification of a standardized panel of DNA markers; five markers were agreed upon by a consensus panel convened by the National Institutes of Health in 1997 (BAT25, BAT26, D2S123, D5S345, and D17S250) as described in Chapter 1. Three categories of MSI have been recognized based upon these panels: MSI-high (instability of two or more markers), MSI-low (instability of one marker), and MS-stable (no instability). More recently, some laboratories have begun using ten or more markers. In such cases MSI is defined as “stable” when fewer than 10% of markers are unstable, “low” when 10 to 30% of markers are unstable, and “high” when greater than 30% of markers are unstable (some laboratories use 40%). We recorded the markers used in each study included in this review (see section on clinical validity and accompanying tables).

There are several pitfalls of MSI testing. First, it is labor intensive, relatively costly (compared with IHC), and requires expert pathologic services. In addition, tissue to be amplified should ideally be microdissected to avoid amplifying DNA from normal colonic mucosa. We systematically recorded whether microdissection was performed for all studies related to clinical validity. As a practical consideration, tissue may not always be available since the diagnosis of HNPCC may not be suspected when the cancer was first diagnosed.

Genetic Testing. Multiple methods have been used for genetic testing in HNPCC. The methods used should ideally be able to detect the many potential genotypes associated with HNPCC (e.g., nonsense, missense, and frameshift mutations, genomic deletions, duplications, and rearrangements). We recorded the specific methods and order of testing used in all studies included in this report and, in the case of clinical validity, attempted to discern whether the specific testing methods were associated with the accuracy of HNPCC testing (see sections and corresponding tables on clinical validity).

A detailed review of these methods is beyond the scope of this report. However, the following summarizes major categories of testing that are used currently, and that were reported in the studies included in this report.

High Output Screening Techniques. High output screening techniques include single stranded conformation polymorphisms (SSCP), conformation sensitive gel electrophoresis (CSGE), denaturing gradient gel electrophoresis (DGGE) and denaturing high-pressure liquid chromatography (DHPLC). These methods all take advantage of the observation that alteration of DNA (due to a polymorphisms or mutation) confers chemical properties that allow it to be differentiated from normal DNA. These approaches can be performed relatively rapidly and allow more detailed studies (such as DNA sequencing) to be targeted to specific regions of DNA.

DNA Sequencing. DNA sequencing can be used following a high output screening technique or as a primary approach (particularly when IHC patterns allow for targeting of a specific mismatch repair gene). It is considered the method of choice for detecting most mismatch repair gene mutation. However, it does not reliably allow for detection of deletions or rearrangements, which are important in HNPCC. DNA sequencing has become automated in recent years, greatly reducing the required time, costs, and expertise.

Conversion analysis. Conversion analysis involves converting diploid cells to haploid cells so that only a single allele is analyzed at a time. The rationale is based upon the observation that a wild-type allele can mask the presence of a mutant allele when performing DNA sequencing (thereby obscuring the presence of a mutation). Conversion testing can increase the yield of genetic testing in HNPCC but is technically complicated, expensive, and, as a result, not widely available. We recorded whether conversion analysis was performed in all studies included in this report.

Methods To Detect Large Structural DNA Abnormalities. Large structural DNA abnormalities (such as large genomic deletions, rearrangements) are potentially important in HNPCC but are not detected by the high output screening techniques or DNA sequencing. There are several methods for detecting these defects. We recorded the specific methods used for all studies included in this report.

Southern blotting involves digestion of genomic DNA (which breaks it into pieces), separation of fragments using electrophoresis, transfer of the fragments to a membrane, and hybridization using probes to recognize deletions, duplications or rearrangements. Southern blotting has not yet been automated to the extent of DNA sequencing and is time-consuming.

Multiplex ligation-dependent probe amplification (MLPA) is a newer technique. It involves measurement of the relative copy number of DNA sequences. MLPA has evolved to become a standard approach for analyzing mismatch repair genes for deletions.

Family History. The family history (and related risk assessment tools such as the Amsterdam criteria) can also be considered as a type of laboratory testing, which can be applied to both the probands and their family members. The accuracy of the family history in predicting the presence of germline mismatch repair mutations is described in the sections on clinical validity. By contrast, the analytic validity of the family history can be considered the accuracy with which individuals are able to report their family history.

We did not identify any studies that assessed the analytic validity of the family history in patients or families with HNPCC. However, we confined our literature search specifically to HNPCC, while there are several studies that have assessed the validity of the family history for a variety of tumor types, including those associated with HNPCC such as colorectal or endometrial cancer.5760 A systematic review of these data found that (in individuals without a personal history of cancer) the positive and negative likelihood ratios of a family history for colon cancer in a 1st degree relative were 23.0 (95% CI 6.4–81.0) and 0.25 (95% CI 0.1–0.63), respectively.59 These values were 14.0 (95% CI 2.2–83.4) and 0.68 (95% CI 0.31–1.52), respectively for endometrial cancer. In another report, the degree of relationship to the probands, type of cancer, age at diagnosis of the probands, and source of ascertainment of probands were all statistically significant predictors of the accuracy of reporting.60 The extent to which these data can be generalized to patients and families with HNPCC is unclear.

Limitations of a Literature-Based Approach to Analytic Validity

Table 12

North American laboratories offering clinical testing for Hereditary Nonpolyposis Colon Cancer (Lynch Syndrome)*
Clinical laboratories LocationAnalysis of entire coding region: Sequence analysisSequence analysis of select exonsAnalysis of entire coding region; Mutation scanningTargeted mutation analysisLinkage analysisMicrosatellite instability testing (MSI)Deletion/duplication analysisMutation scanning of select exonsImmuno-histochemistrySequence analysis of RNA
ARUP Laboratories, Inc. Salt Lake City, UT---------------PCR: BAT25, BAT26, D2S123, D5S346, D17S250 in MSI low (instability<30%) samples, additional markers available: BAT40, MYCL1, TGS-beta-R2, D10S197, D18S58------------
Baylor College of Medicine Medical Genetics Laboratories Houston, TXPCR-based assay: MLH1, MSH2, MSH6 aMLH1 promoter methylation assay (in combination with MSI analysis): MLH1, MSH2, MSH6------------Multiplex PCR-based assay (in combination with MSI analysis): BAT25, BAT26, NR21, NR22, D2S123, D17S250, D5S346, D18S35, DIS2883PCR-based assay: MLH1, MSH2------
Boston University School of Medicine Center for Human Genetics Boston, MAMLH1, MSH2, MSH6MLH1, MSH2, MSH6------------MLPA---------
Children's Hospital of Eastern Ontario Molecular Genetics Diagnostic Laboratory Ottawa, Ontario, CanadaMLH1, MSH2---------------MLH1, MSH2---------
City of Hope Clinical Molecular Diagnostic Laboratory Duarte, CA---Fluorescent sequencer: MLH1, MSH2, MSH6---Amplification ≥5 markers by denaturing polyacrylamide gel electrophoresis: MSI ≥2 markers, low MSI = 1 marker------MLH1, MSH2, MSH6---
Creighton University Medical Center Creighton Medical Laboratories Omaha, NE---------------------------
Fox Chase Cancer Center Clinical Molecular Genetics Laboratory Philadelphia, PA------------------------
Huntington Medical Research Institutes Molecular Oncology & Cancer Genetics Laboratory Pasadena, CAMSH2, MLH1, MSH6MSH2, MLH1------MSH2, MLH1PCR: MSH2, MLH1------
London Health Sciences Centre Molecular Diagnostic Laboratory London, Ontario, CanadaMSH2, MLH1---------------MLH1 and MSH2 in combination with MSI analysis---
Mayo Clinic Molecular Genetics Laboratory Rochester, MNMLH1, MSH2, MSH6---------------MLPA: MLH1, MSH2---PCR: MLH1, MSH2, MSH6, PMS2---
Memorial University of Newfoundland Molecular Genetics Laboratory St. John's, Newfoundland, Canada---------MISH2, Del 50 CODONS------------------
Myriad Genetics Laboratory Salt Lake City, UTMLH1, MSH2, MSH6 (Southern Blot available for MLH1 and MSH2---------------------
North York General Hospital Molecular Genetics Laboratory North York, Ontario, Canada---------------------------
Ohio State University Molecular Pathology Laboratory Columbus, OH---------------BAT 25, BAT 26------------
Quest Diagnostics, Inc. Molecular Genetics Laboratory San Juan Capistrano, CAMLH1, MSH2, MSH6------------Multiplex polymerase chain reaction (PCR): BAT 25, BAT 26, D2S123, D5S346, D17S250---------
Saint Louis University Health Science Center DNA Diagnostic Laboratory Saint Louis, MO---------------------------
UCLA Medical Center Diagnostic Molecular Pathology Laboratory Los Angeles, CA---------------------------
University of Alberta Molecular Diagnostic Laboratory Edmonton, Alberta, Canada------MSH2, MLH1------------------
University of Pennsylvania School of Medicine The Genetic Diagnostic Laboratory Philadelphia, PAMSH2, MLH1 (If negative, Southern blot optional)------------------
*

May include Muir-Torre Syndrome, Turcot Syndrome.

√ = Genetests.org indicates offered by laboratory, but no additional information given.

Abbreviations: PCR, Polymerase Chain Reaction/Fragment Analysis.

a

due to space limitations promoter methylation assay was reported in this column.

We encountered only three studies that were eligible based upon our inclusion criteria, and these are summarized below. This was disappointing but expected, since a literature-based approach to understanding analytic validity has severe limitations as described in Chapter 1:
  • A)

    Many of the laboratory techniques (e.g., DNA sequencing) are used not only in testing for HNPCC but also in testing for a variety of genetic disorders. As a result, a comprehensive search of issues related to analytic validity should consider the entire literature evaluating such testing, an undertaking that is neither practical nor feasible. A search in MEDLINE® on DNA sequencing, for example, will yield more than 416,000 citations.

    As noted in the methods section, we confined our search to studies that used biological materials from patients or family members suspected of having HNPCC to make the results as applicable to the population of interest as possible. The accuracy of these methods used for other disorders may not be generalizable to HNPCC. The extent to which such sources of indirect evidence may be applicable to HNPCC was beyond the scope of this review.

  • B)

    The methods used in laboratory testing evolve rapidly. The specific methods used are commercialized by companies or individuals who developed them. As a result, the published literature may not (and often does not) reflect the actual testing performed in clinical laboratories. It is customary for commercial laboratories to assess at least some components of analytic validity for these contemporary tests, but laboratories are under no obligation to publish the results.

    A partial list of laboratories offering testing services for HNPCC is available through “Genetests” an organization funded through the National Institutes of Health (see http://www.genetests.org/servlet/access?id=8888891&key=AmmF6UdFjuxHB&fcn=y&fw=vDlR&filename=/). A summary of the tests listed on this Website is presented in Table 12 below. We attempted to contact one of the laboratories (chosen at random) to determine whether they would share information related to analytic validity. Our attempt had limited success. Such a review of “gray” literature may be helpful for understanding the analytic validity of these tests but would require appropriate resources, including incentives, for participating laboratories.

    Some commercial laboratories participate in proficiency testing, but the results are generally not published. Proficiency testing involves distributing samples of tissue that are known to be positive or negative for findings of interest. Laboratories participating in such programs can obtain a benchmark for how they are performing in detecting (or excluding) such findings (e.g., genotypes of interest). Proficiency testing also helps understand issues related to reliability.

    A major limitation of proficiency testing is that it does not consider the pre-analytic components of testing; for example, the accuracy of a test may be greatly affected by the methods used to acquire tissue. In addition, proficiency testing does not allow for a detailed understanding of the spectrum of abnormalities (e.g., various genotypes) that may be clinically relevant.

    Proficiency testing for MSI was introduced in 2006 and is being conducted by the College of American Pathologists. Further information is available at their Website (see http://www.cap.org/apps/cap.portal) but the initial results of their program have not been made public.

  • C)

    Studies evaluating analytic validity often suffer from serious methodologic limitations that potentially invalidate the results. Particularly problematic was the inappropriate use of reference standards or lack of clear definitions of references standards altogether. For example, a common pitfall was the inclusion of the test under evaluation as part of the reference standard.

    We chose inclusion and exclusion criteria carefully to select for high quality studies while excluding studies whose results are misleading or clinically irrelevant. There were remarkably few high-quality studies directly addressing analytic validity using biological materials from probands or family members proven or suspected to have HNPCC.

Eligible Studies. We identified only three studies that fulfilled eligibility criteria for analytic validity.

  • One study compared conversion analysis (in which alleleles are separated into hybrids prior to mutation screening) with DNA sequencing alone to detect heterogeneous germline mutations in MLH1, MSH2 and MSH6 in patients with colorectal cancer.61 The authors estimated that conversion analysis provided an increased yield of 56% (35/63 cases) compared with DNA sequencing alone. The study was rated a methodologic quality B because the investigators were not blinded to the method used.

  • Another study included 20 patients with CRC with known mutations in MLH1 or MSH2.56 A set of two unstained slides from each case were sent to participating medical centers with capability of performing immunoperoxidase assays for MLH1 and MSH2.

Of 18 participating centers 2 were excluded: one because slides were damaged in transit and the other because of insufficient staining. Sensitivity for detecting loss of MSH2 expression ranged from 84 to 100%; 10 centers identified all six. Five out of six false positive results were in the same case suggesting that staining or interpretation were not random. Fourteen out of 16 laboratories showed 100% specificity (one laboratory had 93% specificity due to staining failure on one slide and one lab demonstrated 45% specificity due to weak or absent staining in most cases.)

Re-review of returned MSH2 slides showed lack of internal positive control staining in at least 2 of the 6 MSH2-negative cases from 8 of 16 centers. The other 8 centers had 100% sensitivity and 93–100% specificity on re-review. The slides that lacked internal positive control staining were largely accounted for by two cases.

The study was rated a methodologic quality B because of its small sample size, and because it did not describe quality control methods or whether microdissection had been performed when preparing the specimens.

  • A third study evaluated the sensitivity and specificity of DHPLC analysis compared with DNA sequencing in 46 patients with colorectal cancer from families with HNPCC.62 DHPLC analysis identified 19 changes previously identified by DNA sequencing and 16 new alterations not previously described. DHPLC was considered to be highly sensitive, detecting a mutation in all patients with no false negative results. The study was rated methodologic quality C because of several deficiencies in reporting.

Summary. In summary, the analytic validity of the tests used to evaluate HNPCC is substantially uncertain. However, there is heterogeneity in the type of testing offered by commercial laboratories and the available data suggest that there may be variability across testing facilities. Additional information that could shed light upon analytic validity is available but would require evaluation of non-published data sources. Committees of experts could also review the strengths and limitations of specific testing techniques based upon clinical experience, with particular reference given to experience with these methods in other genetically-based disorders.

Table 12 presents information from North American laboratories offering genetic testing for HNPCC. Most of the data was retrieved through the website, GeneTests.org. When available, links to the clinical laboratory websites offering genetic testing service were accessed to gather additional detail on type of tests offered. The information presented is not comprehensive as reporting to GeneTests.org is voluntary.

Clinical Validity

Key Question 2 and Pertinent Subquestions

graphic element

HNPCC has been defined clinically and genetically as described in Chapter 1. The following sections present analyses using either the clinical or the genetic definition of the condition, depending on which Key Question was being addressed.

Key Questions 2a to 2c seek to evaluate the prevalence of MMR mutations and suggestive MSI and IHC among patients with the Lynch Syndrome. Thus, they assume a clinical definition of the condition.

Key Question 2 pertains to the ability of clinical and laboratory predictors to identify the presence of MMR mutations. Thus, it assumes a genetic definition of the condition.

We first present analyses based on a clinical definition of HNPCC. In these analyses we estimated the frequency of mismatch repair gene mutations and tumors with MSI and IHC among CRC patients fulfilling the Amsterdam I and II criteria.

We present subsequent analyses based on the genetic definition of the Lynch syndrome. These help define test characteristics of various strategies (such as the combination of a clinical history with laboratory testing of tumor tissue) for predicting the presence of mismatch repair mutations.

Finally, we used a decision tree model to calculate the expected number of patients with MMR mutations among unselected patients presenting with CRC using various predictive strategies. The parameters used in the calculations are based on our best estimates derived from this systematic review.

Key Question 2a: Assuming a Clinical Definition of the Lynch Syndrome, What Proportion of Patients has a Mismatch Repair Mutation?

Among CRC fulfilling Amsterdam I criteria, the random effects summary prevalence of MLH1 and MSH2 gene mutations was 44% (95% CI: 35, 52; n=19 studies, 464 CRC patients), with evidence for substantial between-study heterogeneity (p<0.01; I2=52%). The six studies that performed genetic testing among all Amsterdam I patients had a summary prevalence of 51% (95% CI: 35, 66%; 84 CRC patients).

For patients fulfilling the Amsterdam II criteria, the corresponding prevalence values were 39% (95% CI: 30, 49%; 10 studies, 279 CRC patients) and 40% (95% CI: 30, 52%) based upon 2 studies that performed sequencing on all 87 Amsterdam II patients.

Only three studies examined other MMR genes (MSH6, PMS1 and PMS2) in Amsterdam I patients, without identifying any additional mutations. Two additional MSH6 mutations were found among 20 Amsterdam II patients in a single study.

Frequency of MMR Gene Mutations Among Patients Fulfilling Amsterdam Criteria I

Table F-1

Prevalence of mismatch repair gene mutations among colorectal cancer probands who fulfill Amsterdam I criteria
Study, year (Ref ID);A. Comments on samplingNAm1/NtotalMLH1 and MSH2 mutations Quality
CountryB. Genetic testing strategyPositive/ AnalyzedProportion [%](95% CI)
Single-/multi-centerC. Definition of deleterious mutations
De Abajo 2005;A. Selection among referrals to a specialized center56/13232/5657 (42, 70)B
SpainB. PCR → DGGE → sequencing (MSH6 assessed in MLH1/MSH2 negative cases, included in the counts)
Single-centerA. Predicted non-conservative transcription alteration; literature; comparison with healthy controls
Syngal 2000 (1672) &C. Selection among referrals to a specialized center28/7011/2839 (22, 59)B
Wahlberg, 2002 (1158);D. PCR, sequencing
USE. Predicted non-conservative transcription alteration; literature
Single-center
Wang, 1999 (1939);A. Sampled among referrals to a genetic consultation center22/7014/2264 (41, 83)B
FranceB. ØRT-PCR → IVSP; ♦ PCR → HD; in vivo hML1 expression
Single-centerC. Predicted transcription alteration; literature
Curia, 1999 (1959);A. Sampled from pathology registries, unclear selection criteria15/301/157 (0, 32)B
ItalyB. ♦RT-PCR → SSCP → Sequencing of abnormal patterns
Single-centerC. Predicted non-conservative transcription alteration; literature; comparison with non-cancer controls
Luce, 1995 (2703);A. Selection among referrals to a specialized centera12/19a6/1250 (21, 79)B
USB. ♦PCR → IVTT → Sequencing of abnormal peptides
Single-centerC. Unclear
Katballe, 2002 (1310) &A. Selection from a population of 1514 incident CRC11/455/1145 (17, 77)B
Christensen, 2002 (1038);B. ♦PCR → SSCP & HD →Sequencing of abnormal patterns
DenmarkC. Predicted non-conservative transcription alteration; literature
Single-center
Dieumegard, 2000 (1791);A. Sample assembled with unclear selection process10/346/1060 (26, 88)B
FranceB. ♦PCR → SSCP → Sequencing of abnormal patterns
Multi-centerC. Predicted non-conservative transcription alteration; literature
Aaltonen, 1998 (2282);A. Selection of all incident unrelated CRC from 9 hospitals between 05/1994 and 04/19964/5094/4100 (40, 100)B
FinlandB. ♦PCR → DGGE (for some samples) → Sequencing; PCR → Sequencing (for all other samples); Ø and PCR for founder mutations (all samples)
Multi-centerC. Literature; and comparison with healthy controls
Rossi, 2002 (1146);A. Selected from consecutive CRC referrals4/251/425 (0, 81)B
BrazilB. PCR → Sequencing
Single-centerC. Unclear
Park, 1999 (2007);A. Study sample assembled from the ICG-HNPCC database154/27777/154b50 (42, 58)C
7 countriesB. ♦PCR → SSCP; and Ø southern blotting (no details)
Multi-center (8 centers)C. Unclearb
Lamberti, 1999 (2036);A. Study sample assembled with unclear selection process57/16015/5726 (16,40)C
ItalyB. ♦PCR → SSCP, and RT-PCR → PTA
Single-centerC. Literature
de Leon, 1999 (2012);A. Sample selected from CRC patient registries18/363/1817 (4, 41)C
ItalyB. ♦PCR → SSCP → Sequencing of abnormal patterns
Single-centerC. Unclear
Liu, 2004 (445);A. Study sample assembled with unclear selection process15/285/1533 (12,62)C
ChinaB. ♦PCR → DHPLC → Sequencing of abnormal patterns
Single centerC. Unclear
Moslein 1996 (2545);A. Sample assembled from various databases; only cases stated to have had CRC are analyzedc14/466/14c43 (18,71)C
US & GermanyB. PCR → Sequencing
Multi-centerC. Predicted non-conservative transcription alteration; literature
Callistri, 2000 (1797);A. Study sample assembled with unclear selection process13/457/1354 (25,81)C
ItalyB. ♦PCR → SSCP
Multi-centerC. Unclear
Colombino, 2005 (1058);A. Selection from consecutive CRC cases enrolled over 3 yearsa13/362a10/1377(46,95)C
ItalyB. ♦PCR → DHPLC→Sequencing of abnormal patterns
Single-CenterC. Compared mutations to 103 people without cancer
Stormorken, 2001 (721)A. First 56 families in the Norwegian Radium hospital registry12/563/1225 (5,57)C
NorwayB. Not described (was already done) (MSH6 was assessed also, included in the counts)
Single-centerC. Not described
Debniak, 2000 (1784);A. Sampled from consecutive CRC, selection process not transparent3/1681/333 (0,91)C
PolandB. PCR → Sequencing
Single-center(?)C. Unclear
Yuan, 2004 (303);A. Sampled with unclear selection process; all fulfill Chinese HNPCC criteriad3/141/333 (0,91)C
ChinaB. ♦PCR → DHPLC → Sequencing of abnormal products
Single-centerC. Predicted non-conservative transcription alteration; literature; comparison with non-cancer controls

Studies are ordered by quality and then by decreasing number of patients fulfilling Amsterdam I criteria. Demographic data (on age and gender distributions) were not available for probands fulfilling Amsterdam I criteria. Primary studies did not describe how many of the MMR mutations were MLH1 or MSH2 for the subset of CRC fulfilling Amsterdam I criteria.

CI: confidence interval; CRC: colorectal cancer; DHPLC: denaturating high performance liquid chromatography; HD: heteroduplex formation; IVSP: in vitro synthesized protein assay; IVTT: in vitro transcription-translation; NAm1: number fulfilling Amsterdam I criteria; Ntotal: total number of studied CRC; PCR: polymerase chain reaction; PTA: protein truncation assay; RT-PCR: reverse transcriptase PCR; SSCP: Single-stranded conformation polymorphism

Conversion analysis was not used in any study.

♦: Gene screening as been used

Ø: Analysis for large deletions has been used

a

Unclear if all probands come from unrelated families.

b

This study probed for hPSM1 or hPSM2 mutations in some but not all patients; none was found

c

Although the paper states that 20 patients fulfilled Amsterdam 1 criteria, only 14 were described to have had CRC in the pertinent data table. The other had other cancers.

d

The Chinese HNPCC criteria ≥2 relatives with histologically proven CRC (≥2 must be first degree relatives) and one of the following: multiple colorectal tumors, one CRC diagnosed at age younger than 50 years, or development of extracolonic HNPCC-related cancer in family members.

Description of studies. Nineteen studies (described in 21 papers 6383) provided data for the prevalence of MMR mutations among CRC probands who fulfilled the Amsterdam I criteria. The median number of patients with relevant data in each study was only 13 (interquartile range: 10, 22), and the actual number ranged between 3 and 154 patients. However, study sizes (all included patients) ranged between 19 and 509. Only five studies included at least 20 probands fulfilling the Amsterdam I criteria.67, 72, 76, 7981 Nine studies were rated grade B for their overall methodologic quality63, 6567, 70, 71, 74, 77, 7981 while the rest were rated grade C (Appendix F-1 *).

Six studies performed bidirectional sequencing on all patients who fulfilled the Amsterdam I criteria.69, 75, 77, 79, 81, 83 (Colombino 200583 performed full sequencing only among familial CRC cases, which included Amsterdam I patients). Ten studies performed full sequencing only on patients who were selected by gene screening methods such as DHPLC or SSCP.63, 6668, 70, 71, 73, 74, 76, 82 The remaining three studies did not describe the presence of any mutation with bidirectional sequencing in any patient64, 72 or did not provide any details on the genetic testing strategy they used.78 None of these 19 studies used conversion analysis to detect mutations.

Assessment of mutations in MMR genes other than MLH1 and MSH2. All reports assessed mutations in the MLH1 and MSH2 genes. Additional MMR genes were assessed in three studies.76, 78, 81 Park 199976 assessed the PMS1 and PMS2 genes in a minority of their Amsterdam I patients (24 and 27 patients respectively, less than 20% of their sample), without identifying any additional mutations(Appendix F-1 *). Wang 199981 also tested for MSH6, PMS1 and PMS2, but found no additional mutations among the subgroup of patients fulfilling the Amsterdam I criteria. Stormorken 200178 also tested for MSH6 mutations, but found none among Amsterdam I patients.

Table 13

Summary estimates of the prevalence of MMR mutations among CRC fulfilling Amsterdam I criteria
SummaryNumber of studies (CRC patients fulfilling AM1)% with mutations(95% CI)Heterogeneity P-value, (I2[%])Between-subgroup heterogeneity, P-value
Overall19 (464)44 (35, 52)<0.01 (52)NA
Overall quality scale
 B a9 (162) 49 (37, 61) 0.09 (41) 0.12
 C10 (302)39 (28, 51)0.01 (58)
Sequencing
 All samples 6 (84) 51 (36, 66) 0.17 (35) 0.02
 Some b10 (298) 44 (33, 55) 0.04 (50)
 None3 (82)33 (19, 51)0.16 (46)
Deletion analysis and sequencing in all samples
 Yes 1 (22) 64 (41, 83) NA 0.09
 No18 (442)42 (34, 51)0.03 (51)
Assessment of additional MMR genes (other than MLH1 and MSH2)
 Yes 3 (188) 49 (34, 65) 0.12 (54) 0.12
 No16 (276)42 (32, 52)0.01 (51)
Any definition for pathogenic mutations
 Yes 11 (233) 47 (34, 60) <0.01 (63) 0.90
 No8 (231)40 (30, 51)0.13 (33)
Total number of patients fulfilling Amsterdam I criteria
 ≥20 5 (317) 47 (35, 59) <0.01 (73) 0.28
 <2014 (147)41 (30, 53)0.06 (40)
Sampling among unselected, non-referral CRC
 Yes 3 (28) 66 (35, 88) 0.17 (44) 0.09
 No16 (436)41 (31, 50)0.01 (52)

AM1: Amsterdam I criteria; CI: confidence interval; CRC: colorectal cancer patients.

None of the studies was rated A in the overall quality scale.

Gene sequencing was performed only to those selected by gene screening methods.

An external file that holds a picture, illustration, etc., usually as some form of binary object. The name of referred object is er-hnpccf3.jpg.

   Figure 3. Prevalence of mismatch repair gene mutations among colorectal cancer patients fulfilling the Amsterdam I criteria

Analyses. Overall, the random effects summary estimate from the 19 studies was 44% (95% CI: 35, 52%), with evidence for substantial between-study heterogeneity (p<0.01; I2=52%) (Table 13, Figure 3). The six studies that performed full sequencing in all available samples identified mutations in 51% (95% CI: 35, 66%) of 84 patients fulfilling the Amsterdam I criteria (Table 13). The corresponding prevalence estimate was 44% when sequencing was performed after suggestive SSCP, DHPLC or other gene screening methods, and only 33% among studies that used screening methods without further confirmation by sequencing (Table 13). The prevalence of MMR mutations did not differ beyond chance with respect to overall study quality score, whether the study was small (i.e., analyzed fewer than 20 patients), or whether the authors described how they classified mutations as being pathogenic.

Finally, three studies (n=28 eligible patients) that sampled unselected, nonreferral patients with CRC found a higher prevalence of MMR mutations (66%) among patients who fulfilled the Amsterdam I criteria, compared to studies that sampled among referral or otherwise selected cases (prevalence 41%; Table 13). The precision of these estimates is uncertain because of the very small number of eligible patients.

Frequency of MMR Gene Mutations Among Patients Fulfilling Amsterdam II Criteria

Table F-2

Prevalence of MLH1 and MSH2 mutations among colorectal cancer probands who fulfill Amsterdam II criteria
Study, year (Ref ID);A. Comments on samplingNAm2/NtotalMLH1 and MSH2 mutations Quality
CountryB. Genetic testing strategyPositive/A nalyzedProportion [%] (95% CI)
Single-/multi-centerC. Definition of deleterious mutations
De Abajo 2005;A. Selection among referrals to a specialized center67/13236/6754 (41, 66)B
SpainB. PCR → DGGE → sequencing (MSH6 assessed in MLH1/MSH2 negative cases)
Single-centerC. Predicted non-conservative transcription alteration; literature; comparison with healthy controls
Katballe, 2002 (1310) &A. Selection from a population of 1514 incident CRC18/458/1844 (22, 69)B
Christensen, 2002 (1038);B. ♦PCR → SSCP & HD → Sequencing of abnormal patterns
DenmarkC. Predicted transcription alteration; literature
Single-center
Wolf, 2005 (23)A. Retrospective cohort of referral cancer patients fulfilling the modified Bethesda criteria35/8113/3537 (21, 55)B
AustriaB. PCR → Sequencing
Single-centerC. Predicted transcription alteration; literature; comparison with healthy controls
Syngal 2000 (1672) &A. Selection among referrals to specialized center34/7014/3441 (25, 59)B
Wahlberg, 2002 (1158);B. PCR → Sequencing
USC. Predicted transcription alteration; literature
Single-center
Zhu, 2005 (138)A. Study sample assembled with unclear selection process21/784/2119 (5, 42)B
ChinaB. Ø MLPA → Sequencing of detected aberrations
Single-centerC. Unclear
Lee, 2005 (105)A. Sample selected from referrals to a tertiary center5/463/560 (15, 95)B
SingaporeB. PCR → Sequencing
Single-centerC. Predicted transcription alteration; literature
Salovaara, 2000 (1740)A. Selection of all new unrelated CRC from 9 hospitals between 03/1996 and 06/19985/5354/580 (28, 99)B
FinlandB. PCR → Sequencing Ø PCR for founder mutations in MLH1 gene
Multi-centerC. Literature; comparison with non-cancer controls
Rossi, 2002 (1146)A. Selected from consecutive CRC referrals5/252/540 (5, 85)B
BrazilB. ♦PCR, → Sequencing
Single-centerC. Unclear
Lamberti, 1999 (2036);A. Study sample assembled with unclear selection process69/16017/6925 (15, 36)C
ItalyB. ♦PCR → SSCP; and RT-PCR, PTA
Single-centerC. Literature
Stormorken, 2001 (721)A. First 56 families in the Norwegian Radium hospital registry20/567/20a35 (15, 59)C
NorwayB. Not described (was already done) (MSH6 was assessed also)
Single-centerC. Not described

Studies are ordered by quality and then by decreasing number of patients fulfilling Amsterdam II criteria. Demographic data (on age and gender distributions) were not available for probands fulfilling Amsterdam II criteria. Primary studies did not describe how many of the MMR mutations were MLH1 or MSH2 for the subset of CRC fulfilling Amsterdam II criteria.

Conversion analysis was not used in any study.

♦: Gene screening as been used

Ø: Analysis for large deletions has been used

CI: confidence interval; CRC: colorectal cancer; HD: heteroduplex formation; MLPA: Multiple ligation-dependent probe amplification; NAm2: number fulfilling Amsterdam II criteria; Ntotal: total number of studied CRC; PCR: polymerase chain reaction; PTA: protein truncation assay; RT-PCR: reverse transcriptase PCR; SSCP: Single-stranded conformation polymorphism

a

2/7 mutations shown are MSH6

Description of studies. Ten studies assessed the prevalence of MMR mutations among 271 CRC probands who fulfilled the Amsterdam II criteria (Appendix F-2 *). They were described in 12 papers.65, 67, 71, 72, 7780, 8487

The total number of patients in the various study populations ranged from 45 to 535 patients with CRC. However, the median number of patients fulfilling Amsterdam II criteria was 19.5 (interquartile range: 5, 35). Only five studies assessed more than 20 probands from families fulfilling the Amsterdam II criteria.67, 72, 79, 80, 86, 87 Eight out of ten studies received grade B in the overall quality rating while two72, 78 received grade C.

Four studies performed bidirectional sequencing in all patients fulfilling Amsterdam II criteria.77, 79, 84, 86 Four studies performed full sequencing only to patients who were selected by gene screening methods.65, 67, 71, 85, 87 The remaining two studies did not describe the presence of any mutation with bidirectional sequencing in any patient72 or did not provide any details on the genetic testing strategy they used.78 None of these 10 studies used conversion analysis.

Assessment of mutations in MMR genes other than MLH1 and MSH2. All studies tested for MLH1 and MSH2 mutations. Only Stormorken 200178 also tested for MSH6 mutations. In this study five out of 20 Amsterdam II patients had deleterious MLH1 and MSH2 mutations (25% [95% CI: 9, 49%]) and another two had deleterious MSH6 mutations (10% [95% CI: 1, 32%]).

Table 14

Summary estimates of the prevalence of MMR mutations among CRC fulfilling Amsterdam II criteria
SummaryNumber of studies (patients fulfilling AM2)% with mutations (95% CI)Heterogeneity P-value, (I2 [%])Between-subgroup heterogeneity, P-value
Overall10 (279)39 (30, 49)0.03 (53)NA
Overall quality scale
 B a8 (190) 45 (38, 52) 0.16 (34) 0.01
 C2 (89)27 (19, 37)0.36 (0)
Sequencing
 All samples 2 (87) 40 (30, 52) 0.82 (0) 0.02
 Some b4 (111) 45 (26, 65) 0.03 (66)
 None2 (89)27 (19, 37)0.36 (0)
Deletion analysis and sequencing in all samples
 Yes 0 (0) NA NA NA
 No10 (279)39 (30, 49)0.03 (53)
Assessment of additional MMR genes (other than MLH1 and MSH2)
 Yes 1 (20) 35 (15, 59) NA 0.68
 No9 (259)40 (30, 51)0.02 (57)
Any definition for pathogenic mutations
 Yes 7 (233) 43 (31, 55) 0.02 (60) 0.14
 No3 (46)29 (18, 44)0.45 (0)
Total number of patients fulfilling Amsterdam criteria II
 ≥20 5 (226) 36 (24, 49) 0.01 (73) 0.41
 <205 (53)44 (31, 58)0.51 (0)
Sampling among unselected, non-referral CRC
 Yes 2 (23) 57 (23, 85) 0.19 (43) 0.28
 No8 (256)37 (28, 48)0.03 (56)

AM2: Amsterdam II criteria; CI: confidence interval; CRC: colorectal cancer patients.

a

None of the studies was rated A in the overall quality scale.

b

Gene sequencing was performed only to those selected by gene screening methods.

An external file that holds a picture, illustration, etc., usually as some form of binary object. The name of referred object is er-hnpccf4.jpg.

   Figure 4. Prevalence of mismatch repair gene mutations among colorectal cancer patients fulfilling the Amsterdam II criteria

Analyses. As expected, the overall prevalence of MMR gene mutations was lower compared with patients who fulfilled the stricter Amsterdam I criteria (39% [95% CI: 30, 49%]; Table 14, Figure 4). Between-study heterogeneity was statistically significant.

Studies that performed sequencing in all Amsterdam II patients estimated similar prevalence of MMR mutations compared to studies that performed sequencing only after suggestive gene screening with SSCP, DHPLC, or other methods (40% versus 45%, respectively; Table 14). Studies that were rated C for their overall quality estimated significantly lower prevalence rates (27%; Table 14) compared to studies that received B for their overall quality. In the latter, the summary estimate was 43% (95% CI: 34, 54%) with no evidence for heterogeneity.

Studies that mentioned how pathogenic mutations were characterized as such, contributed fewer than 20 patients, or sampled unselected, non-referral patients with CRC, tended to provide higher estimates for the prevalence for MMR mutations. However, all of these studies were small and thus it is possible that the observed variability could have been due to chance (Table 14).

Interpretation of the MMR Prevalence Eestimates. The summary prevalence was 44% among all studies on Amsterdam I patients, and 51% for studies that sequenced all patients. For Amsterdam II the corresponding numbers were 39% and 40%. These estimates pertain mainly to MLH1 and MSH2 mutations, because most studies tested only these two genes. The true prevalence of MMR mutations among Amsterdam I (or Amsterdam II) patients may be different (possibly higher rather than lower) than these estimates for several reasons:

  • Genes other than MLH1 and MSH2: Only a minority of studies tested for mutations in other MMR genes (especially MSH6, the gene most commonly implicated in patients without mutations in MLH1 or MSH288).

    • Stormorken 2001 and Wang 1999 did not find any deleterious MSH6 mutations among 34 Amsterdam I patients in total. The upper boundary of the exact binomial 95% CI for the frequency of MSH6 mutations in these two studies is approximately 10%.

    • Stormorken 2001 found two deleterious MSH6 mutations in addition to five MLH1 and MSH2 mutations out of 20 Amsterdam II patients. Thus, MSH6 mutations resulted in an increment of 10% (95% CI: 1, 32%).

    Presumably, if other studies had assessed MSH6 routinely, the total prevalence of MMR mutations would be higher. However, there were insufficient data to provide robust estimates.

  • Comprehensiveness of genetic testing - sequencing of all samples and testing for large deletions/rearrangements: Studies that performed sequencing in all samples estimated higher frequency of MMR mutations among Amsterdam I patients compared to other studies. This was not true among studies that focused on Amsterdam II patients. Thus, more comprehensive testing resulted in more identified MMR mutations (at least in Amsterdam I studies), as expected.

  • Role of founder mutations: The degree to which a search for mutations other than MLH1 and MSH2 will identify mutations in other MMR genes depends upon the population being studied. The spectrum of MMR mutations is variable and some are specific to certain populations. An example of the latter is the presence of founder mutations in the MLH1 genes that are common among patients of Finnish origin, but are not prevalent in patients of different descent. The Finnish study63 included only 4 patients fulfilling the Amsterdam criteria I, all of whom were found to have MMR mutations. An American founder mutation in the MSH2 gene has been described in one kindred, probably originating from German immigrants, but it is unlikely to have a large impact in the general population.90, 91 The Finnish founder mutations are probably not applicable to the US population. Nevertheless, the summary estimates are practically identical if the Finnish study63 is excluded.

  • Identifying deleterious mutations: As mentioned in the methods, only mutations that were characterized by the primary studies as deleterious or pathogenic were analyzed. Misclassifications may have occurred in both directions:

    • Some deleterious missense mutations may have been erroneously misclassified as non-pathogenic.

    • The opposite is also likely, especially when pathogenicity is inferred on the basis that the mutation was absent from cancer-free controls. This was done in five studies.63, 66, 67, 82, 83 However, most of the studies included only small numbers of cancer-free controls (only around 100 patients were used as controls in the five studies). Absence of a mutation in such a small population of cancer-free controls does not necessarily prove that the mutation is not pathogenic.

    There were insufficient data to provide precise estimates of how many missense mutations were found among the subgroup of Amsterdam I (or Amsterdam II) patients in the studies that performed comprehensive genetic testing.

  • Sampling of tested Amsterdam I and Amsterdam II cases: The strategy used for selecting patients with CRC can have a substantial impact on the prevalence estimates (see comments on additional studies that were suggested for consideration by the TEP, below). Only three studies on Amsterdam I patients studied unselected patients with CRC, but they identified a total of only 28 patients. By contrast, studies that identified cases that had been included in cancer databases (e.g., the ICG-HNPCC database that was used in the Park 1999 study) represent a highly selected population,88 or may pertain almost entirely to individuals with a high probability of having mutations (e.g., because of suggestive MSI testing prior to their registration in the database).61 Biases resulting from sampling are not only a theoretical concern (see below comments on additional studies that were suggested for consideration by the TEP).

Additional studies suggested for consideration by the TEP. Several additional studies were considered by the TEP during the peer review process as important and potentially relevant that had not been included in the draft report. Although none of these studies was eligible for these analyses according to the eligibility criteria, they provide insight and complementary data, directly supporting the analyses and their interpretation. Most importantly, the findings from these studies are in accordance with the notion that sampling of Amsterdam I or II patients from different sources may result in very different prevalence estimates, even when the genetic testing strategies are comprehensive.

  • Balmana 200692 reported the prevalence of MLH1 and MSH2 gene mutations among 1914 unrelated people who had been tested for MMR mutations in the Myriad Genetic Laboratories. Genetic analysis was performed using a combination of sequencing and southern blotting. The cohort included 534 unrelated people fulfilling the Amsterdam II criteria (although it was unclear if all of them had CRC). Amsterdam I patients were not reported separately. Only half of the Amsterdam II patients (274/534=51%) were tested for large deletions or rearrangements.

    In total, 180 Amsterdam II participants were found to be carriers of MLH1 or MSH2 mutations (34% [9%% CI: 30, 38%]). This estimate includes large deletions or rearrangements and pathogenic and non-pathogenic mutations. About one fourth (27% [95% CI: 20, 35%] of the mutations were due to large deletions/rearrangements in a subgroup of the 1016 participants who underwent such testing. Extrapolating the proportion of large deletions to all Amsterdam II patients would result in a total prevalence of approximately 38%, very close to the summary estimate provided above. This study was excluded from the analyses because it was unclear whether all Amsterdam II participants had CRC.

  • Wagner 200393 evaluated 49 individuals from the Henry Lynch Cohort fulfilling the Amsterdam criteria (presumably Amsterdam I criteria), at least 9 of whom were not CRC patients. They used DGGE to screen for MMR mutations in the MLH1, MSH2 and MSH6 genes, and performed sequencing on exons with altered migration patterns. They tested for large deletions, and performed mono-allelic mutation analysis (MAMA) in very few samples, mainly to demonstrate the feasibility of the technique.

    Overall, 25 out of 49 had deleterious MLH1 or MSH2 mutations, 1 had deleterious MSH6 mutations, and 14 had genomic rearrangements. Thus, the overall proportion was 82% (95% CI: 68, 91%). In addition, 5 missense mutations were found; were they to be considered pathogenic, the overall proportion would be 92% (95% CI: 80, 98%). The detection of large deletions/rearrangements resulted in 29% increase in the estimated prevalence of MMR mutations. The degree to which the Henry Lynch Cohort is representative of the whole Amsterdam I population is unclear.

  • Liu 199694 assessed the MLH1, MSH2 and PMS2 genes 48 families of Amsterdam I patients who had suggestive MSI (note that more than one person per family was tested for mutations -i.e, reporting was at the family not the individual level). They found a prevalence of “drastic” (deleterious) mutations of 54%. Counting all identified mutations, drastic or not, 71% (95% CI: 56, 83%) of the families carried a mutation. Fifteen families had large genomic deletions/rearrangements (31%), but many families had more than one type of mutations.

    It is unclear how many unrelated people had only large deletions or rearrangements in this study. There might be some overlap with the Wanger 200393 families for patients from North America. The authors note that their sample was not representative of the general Amsterdam I population.

Caveat on true overall prevalence of MMR mutation carriers. Limited data suggested that approximately one-fourth to one-third of genotypes associated with HNPCC are related to deletions or rearrangements that would be missed through sequencing alone. As a result, the prevalence of mutations in Amsterdam I (or II patients) assessed from studies that performed sequencing alone are likely to be underestimates.

Accounting for this effect, one may derive a prevalence of MMR mutations of approximately 63% to 67% in Amsterdam I patients. For Amsterdam II patients the corresponding prevalence values would be 50 to 53%.

Furthermore, limited data suggest that approximately 10% of MMR genotypes involve MMR genes other than MLH1 and MSH2. Thus, assuming an additional 10% increase in mutations by assessing more genes would result in an overall prevalence of up to 70% to 75% for Amsterdam I patients, and 55 to 59% for Amsterdam II patients.

Key Question 2b: Assuming a Clinical Definition of the Lynch Syndrome, What Proportion of Patients has MSI?

Among patients fulfilling the Amsterdam I criteria (data from 11 studies, n=159 patients fulfilling the criteria), 71% (95% CI: 63, 78%) of tumors were found to be MSI-H (p=0.51 for heterogeneity; I2=0%). Among patients who fulfilled the Amsterdam II criteria (data from four studies, n=102 patients fulfilling the criteria), the corresponding summary prevalence was 68% (95% CI: 58, 76%) without evidence for between-study heterogeneity (p=0.91, I2=0%).

An external file that holds a picture, illustration, etc., usually as some form of binary object. The name of referred object is er-hnpccf5.jpg.

   Figure 5. Prevalence of MSI in colorectal cancer tumors from patients fulfilling the Amsterdam I criteria

Patients Fulfilling Amsterdam I Criteria. Eleven studies with 159 patients fulfilling the Amsterdam I were criteria were included in the analysis (Figure 5). These were described in 13 papers.6366, 6872, 75, 79, 80, 95 Although the total number of patients with CRC included in the primary studies ranged from 11 to 509, the median number of CRC patients eligible for this analysis was 10 (interquartile range: 9, 18), and only one study assessed more than 20 CRC patients. (Lamberti 1999,72 n=57). Five studies 63, 65, 66, 70, 71, 79, 80 received a grade B in the overall quality rating while the others were rated a grade C.

Table F-3

Prevalence of microsatellite instability among colorectal cancer probands who fulfill Amsterdam I criteria
Study, year (Ref ID);A. Comments on samplingNAm1/ NtotalTumor microsatellite instability Micro-dissectionNCI 5 marker setQuality
CountryB. Definition of MSI-HMSI-H/AnalyzedMSI-H [%](95% CI)MSI-H&L/AnalyzedMSI-H&L [%](95% CI)
Single-/multi-center
Wahlberg, 2002 (1158) & Syngal 2000 (1672);A. Selection among referrals to specialized center28/7015/1979 (54, 94)18/1995 (74, 100)B
USB. ≥2 out of 5 dinucleotide repeats (NCI set)
Multi-center
Curia, 1999 (1959);A. Sampled from pathology registries, unclear selection criteria15/3012/1580 (52, 96)NDNDXB
ItalyB. Screened with 3 markers and if none was unstable up to a total of 7. MSI-H defined as ≥2 markers
Single-center
Katballe, 2002 (1310) & Christensen, 2002 (1038);A. Selected from a population of 1514 incident CRC11/457/1070 (34, 93)7/1070 (34, 93)XB
DenmarkB. ≥2 out of 5 dinucleotide repeats
Single-center
Dieumegard, 2000 (1791);A. Sample assembled with unclear selection process10/349/1090 (55, 100)9/1090 (55, 100)XXB
FranceB. ≥10% of up to 23 markers (But all were ≥30%)
Multi-center
Aaltonen, 1998 (2282);A. Selection of all new unrelated CRC from 9 hospitals between 05/1994 and 04/19964/5094/4100 (40, 100)4/4100 (40, 100)XXB
FinlandB. ≥30% of 16 markers for tumor analyzed with fluorescence methods or ≥2 out of 7 (≈30%) markers analyzed with radioactive technique
Multi-center
Lamberti, 1999 (2036);A. Study sample assembled with unclear selection process57/16035/4971 (57, 83)37/4976 (61, 87)XXC
ItalyB. ≥40% out of up to 10 mono- di- and tetranucleotide repeats
Single-center
de Leon, 1999 (2012);A. Sample selected from CRC patient registries18/3611/1861 (36, 83)NDNDXC
ItalyB. ≥2 out of ≥5 markers
Single-center
Callistri, 2000 (1797);A. Study sample assembled with unclear selection process13/4511/1385 (55, 98)11/1385 (55, 98)C
ItalyB. ≥2 out of 13 microsatellite markers
Multi-center
Peel, 1999 (1660);A. Referral HNPCC cases, other than the 1134 CRC probands assessed for other purposes11/114/944 (14, 79)4/944 (14, 79)XC
USB. Unclear; at least 5 markers were used
Multi-center
Moslein, 1996 (2545);A. Sample assembled from various databases; we present only cases stated to have CRCa14/46a5/956 (21, 86)NDNDXXC
US & GermanyB. ≥30% of 9 to 34 markers analyzed (unclear which exactly)
Multi-center
Debniak, 2000 (1784);A. Sampled from consecutive CRC, selection not transparent3/1682/367 (9, 99)NDNDXXC
PolandB. ≥2 out of 5 dinucleotide repeats (panel I), or ≥3 out of 10 dinucleotide repeats (panel II, used if only 1 positive in panel I)
Single-center(?)

Studies are ordered by overall quality and then by decreasing number of patients fulfilling the Amsterdam I criteria. Demographic data (on age and gender distributions) were not available for probands fulfilling Amsterdam I criteria.

CI: confidence interval; CRC: colorectal cancer; MSI-H/H&L: microsatellite instability high/combined high and low; ND: Not described; NAm1: number fulfilling Amsterdam I criteria;

Ntotal: total number of studied CRC; NCI: National cancer institute

X: Was not used/not stated

√: Was used

a

Although the paper states that 20 patients fulfilled Amsterdam I criteria, only 14 were described to have a CRC in the pertinent data table. The other had other cancers. Only the 14 with CRC are analyzed.

We considered specific study features as described in Chapter 2 (i.e., whether the study reported use of microdissection and used the microsatellite marker set recommended by the National Cancer Institute). Only six studies reported that they used microdissection (which helps assure that the tissue sample that was tested for MSI consisted mainly of malignant cells).6466, 68, 71, 79, 80, 95 Only two studies (reported in three papers64, 79, 80) used the marker set recommended by the National Cancer Institute (Appendix F-3 *).

Table 15

Summary estimates of the prevalence of MSI-H in colorectal cancer tumors from patients fulfilling Amsterdam I criteria
SummaryNumber of studies (CRC patients fulfilling AM1)% with MSI-H (95% CI)Heterogeneity P-value, (I2 [%])Between-subgroup heterogeneity, P-value
Overall11 (159)71 (63, 78)0.51 (0)NA
Overall quality scale
 B a5 (58) 79 (67, 88) 0.81 (0) 0.10
 C6 (101)66 (56, 75)0.44 (0)
Microdissection
 Yes 6 (84) 70 (58, 80) 0.32 (15) 0.89
 No5 (75)71 (59, 81)0.50 (0)
Use of the NCI-recommended marker sets
 Yes 2 (32) 81 (64, 91) 0.69 (0) 0.17
 No9 (127)68 (59, 76)0. 52 (0)
Total number of patients fulfilling Amsterdam criteria I
 ≥20 1 (49) 71 (57, 83) NA 0.89
 <2010 (110)70 (60, 79)0.42 (2)
Sampling among unselected, non-referral CRC
 Yes 2 (14) 70 (62, 78) 0.39 (5) 0.81
 No9 (145)74 (44, 91)0.39 (0)

AM1: Amsterdam I criteria; CI: confidence interval; CRC: colorectal cancer patients.

a

None of the studies was rated A in the overall quality scale.

Overall, 71% (95% CI: 63, 78%) of tumors were MSI-H (p=0.51 for heterogeneity; I2=0%). The estimate was consistent among the various subgroups that we assessed (Table 15). The prevalence rates were generally higher among studies that used the marker sets recommended by the National Cancer Institute (Table 15).

The prevalence of combined MSI-H and MSI-low was similar to that of MSI-H (Appendix F-3 *).

Table F-4

Prevalence of microsatellite instability among colorectal cancer probands who fulfill Amsterdam II criteria
Study, year (Ref ID);A. Comments on samplingNAm2/ NtotalTumor microsatellite instability Micro-dissectionNCI 5 marker setQuality
CountryB. Definition of microsatellite instabilityMSI-H/ AnalyzedMSI-H [%] (95% CI)MSI-H&L/ AnalyzedMSI-H&L [%](95% CI)
Single-/multi-center
Wolf, 2005 (23)A. Retrospective cohort of referral cancer patients fulfilling the modified Bethesda criteria35/8116/2467 (45, 84)NDNDXB
AustriaB ≥30% out of up to 10 markers
Single-center
Katballe, 2002 (1310) & Christensen, 2002 (1038);A. Selected from a population of 1514 incident CRC17/4510/1663 (35, 85)11/1669 (41, 89)XB
DenmarkB. ≥2 out of 5 dinucleotide repeats
Single-center
Salovaara, 2000 (1740)A. Selection of all new unrelated CRC patients from 9 hospitals between 03/1996 and 06/19985/5354/580 (28, 99)NANAXXB
FinlandB. Single marker (BAT26) analyzed in all samples
Multi-center
Lamberti, 1999 (2036);A. Study sample assembled with unclear selection process69/16039/5768 (55, 80)41/5772 (58, 83)XXC
ItalyB. ≥40% out of up to 10 mono- di- and tetranucleotide repeats
Single-center

Studies are ordered by quality and then by diminishing number of patients fulfilling the Amsterdam II criteria. Demographic data (on age and gender distributions) were not available for probands fulfilling Amsterdam II criteria.

CI: confidence interval; CRC: colorectal cancer; MSI-H/H&L: microsatellite instability high/combined high and low; NA: Not applicable; ND: Not described; NAm2: number fulfilling Amsterdam II criteria; Ntotal: total number of studied CRC; NCI: National cancer institute

X: Was not used/not stated

√: Was used

An external file that holds a picture, illustration, etc., usually as some form of binary object. The name of referred object is er-hnpccf6.jpg.

   Figure 6. Prevalence of MSI-H in colorectal cancer tumors from patients fulfilling the Amsterdam II criteria

Patients Fulfilling Amsterdam II Criteria. Only four studies including 102 patients fulfilling the Amsterdam II criteria were identified (Appendix F-4 *). These were described in five papers.65, 71, 72, 85, 86 The largest study (Lamberti 199972) analyzed 59 available eligible tumors, and the smallest study (Salovaara 200085) had only 4 eligible tumors. The total number of patients with CRC included in these studies ranged from 45 to 535. All studies except for the one by Lamberti 199972 received grade B for overall quality. None of the studies used the National Cancer Institute recommended marker sets, and only two 79, 80, 86 used microdissection (Appendix F-4). Overall, the summary prevalence was 68% (95% CI: 58, 76%) without any evidence for between-study heterogeneity (p=0.91, I2=0%) (Figure 6).

A pooled estimated for the three fair quality (B overall quality) studies was 66% (95% CI: 51, 79%) with no evidence for heterogeneity. Estimates from the two studies with more than 20 patients that fulfilled the Amsterdam II were similar to the overall estimate. The results were also similar for studies that used the markers sets recommended by the National Cancer Institute.

Finally, results were consistent when the MSI-L and MSI-H tumors were combined in two studies (described in three papers 65, 71, 72, Appendix F-4 *). The overall prevalence was 71% (95%CI: 60, 81%) with no statistically significant heterogeneity.

Interpretation of the MSI Prevalence Estimates. Some of the biases that may affect the calculated prevalence for MMR mutations are also applicable in this section, specifically biases that pertain to the selection/sampling of Amsterdam I and Amsterdam II patients who were studied. In addition, even among the selected Amsterdam I or Amsterdam II patients in each study, MSI testing often depended upon practical and logistical considerations (e.g., patient availability and consent and availability of tumor tissue). Thus, not all patients had all tests and it was unclear whether additional bias may have been introduced in selecting patients for testing.

Key Question 2c: Assuming a Clinical Definition of the Lynch Syndrome, What Proportion of Patients has Abnormal Protein Expression by Immunohistochemistry?

Among patients fulfilling the Amsterdam I criteria, the overall prevalence of tumors with loss of protein expression was 40% (95% CI: 28, 53%; n= 6 studies, 63 patients) with no evidence for between-study heterogeneity (p=0.75, I2=0%).

Only one eligible study provided relevant data for 20 patients fulfilling the Amsterdam II criteria. Eight out of 20 tumors had suggestive IHC for the MLH1, MSH2 or MSH6 genes (40% [95% CI: 9, 64%]).

Patients Fulfilling Amsterdam I Criteria. Only six studies that included a total of 63 eligible patients (median 12 tumors in each study) provided relevant data; no study contributed more than 15 tumors in this analysis. The total number of patients included in the pertinent studies ranged from 30 to 168. These were described in eight publications.65, 66, 6971, 7880.

Table F-5

Prevalence of negative immunostaining for MLH1 or MSH2 among colorectal cancer probands who fulfill Amsterdam I criteria
Study, year (Ref ID);A. Comments on samplingNAm1/NtotalMLH1 and MSH2 immunostaining Quality
CountryB. Antibodies used for immunostainingNegative/AnalyzedProportion [%] (95% CI)
Single-/multi-center
Curia, 1999 (1959)A. Sampled from pathology registries, but selection process is not transparent15/307/1547 (21, 73)B
ItalyB. Anti-MSH2: FE11 (Oncogene Research Products); anti-MLH1: clone 14 (Oncogene Research Products)
Single-center
Wahlberg, 2002 (1158) & Syngal 2000 (1672);aA. Selection among referrals to specialized center28/705/1436 (13, 65)B
USB. Anti-MSH2: FE11 (Oncogene Research Products); anti- MLH1: G168–728 (PharMingen)
Single-center
Katballe, 2002 (1310) & Christensen, 2002 (1038);bA. Selection from a population of 1514 incident CRC11/424/1136 (11, 69)B
DenmarkB. Anti-MSH2: Ab-1, Ab-2 (Oncogene Research Products); anti-MLH1: G168-15 (PharMingen)
Single-center
Dieumegard, 2000 (1791)A. Sample assembled without a transparent selection process10/344/850 (16, 84)B
FranceB. Anti-MSH2: FE11 (Oncogene Research Products); anti- MLH1: Ab-1 (Oncogene Research Products)
Multi-center
Stormorken, 2001 (721)A. First 56 families in the Norwegian Radium hospital registry12/563/1225 (5, 57)C
NorwayB. Anti-MSH2: FE11 (Calbiochem); anti-MLH1: G168-15 (Pharmingen); anti-MSH6: Clone 44 (transduction laboratories)c
Single-center
Debniak, 2000 (1784);A. Sampled from consecutive CRC, but selection process is not transparent3/1682/367 (9, 99)C
PolandB. Not stated
Single-center(?)

Studies are ordered by overall quality and then by decreasing number of patients fulfilling Amsterdam I criteria. Demographic data (on age and gender distributions) were not available for probands fulfilling Amsterdam I criteria. None of these studies assessed any other mismatch repair genes apart from MLH1 and MSH2.

CI: confidence interval; CRC: colorectal cancer; NAm1: number fulfilling Amsterdam I criteria; Ntotal: total number of studied CRC

a

Data from the Wahlberg et al. 2002 paper; comments on sampling from the Syngal et al. 2000 paper.

b

Data from the Christensen et al. 2002 paper; comments on sampling from the Katballe et al. 2002 paper.

c

2 MSH6 MMR mutations were also picked up by the anti-MSH2 IHC exam.

Five out of six studies were characterized as grade B quality while two69, 78 were rated grade C. Only Stormorken 200178 assessed the expression of the MSH6 genes (in addition to MLH1 and MSH2) (Appendix F-5 *). However, none of the samples was positive for only MSH6.

An external file that holds a picture, illustration, etc., usually as some form of binary object. The name of referred object is er-hnpccf7.jpg.

   Figure 7. Prevalence of suggestive IHC in colorectal cancer tumors from patients fulfilling the Amsterdam I criteria

Studies are ordered by decreasing number of patients.

The overall prevalence of tumors with loss of protein expression was 43% (95% CI: 30, 57%) with no evidence for between-study heterogeneity (p=0.85, I2=0%) (Figure 7). The summary estimate was similar (42% [95% CI: 29, 56%] without any heterogeneity) after excluding the report by Debniak 2000,69 which was the only one graded C for overall quality.

Patients Fulfilling Amsterdam II Criteria. Only Stormorken 200178 assessed the prevalence of suggestive IHC among 20 patients fulfilling Amsterdam criteria II. This study was rated C for its overall methodologic quality. The expression of three MMR genes was sought, namely MLH1, MSH2 and MSH6. Eight out of 20 Amsterdam II patients had suggestive IHC (40% [95% CI: 19, 64%]).

Tumors that have suggestive IHC for MSH2 may also have suggestive IHC for MSH6, because in the absence of functional MSH2 protein the MSH2/MSH6 heterodimer is not formed correctly. Two out of 20 Amsterdam II patients had deleterious mutations in the MSH6 gene in Stormorken 2001.78 None had suggestive IHC only for the MSH6 antibody.

Interpretation of the IHC Prevalence Estimates. In contrast to MSI testing that detects replication errors, and is generally not MMR-gene specific, IHC uses antibodies that target specific MMR genes. Only one of the eligible studies used antibodies against MSH6.78 The MSH6 gene is the third most common gene with pathogenic mutations in HNPCC patients (approximately 6% of the mutations in the ICG-HNPCC database are in MSH688). Thus, the prevalence of suggestive IHC would probably be higher if anti-MSH6 or additional antibodies were used.

Some of the biases that may affect the calculated prevalence for MMR mutations are also applicable in this section, specifically biases that pertain to the selection/sampling of Amsterdam I and Amsterdam II patients who were studied. In addition, even among the selected Amsterdam I or Amsterdam II patients in each study, IHC testing often depended upon practical and logistical considerations (e.g., patient availability and consent and availability of tumor tissue). Thus, not all patients had all tests and it was unclear whether additional bias may have been introduced in selecting patients for testing.

Key Question 2: How Accurate Are Various Predictors Assuming a Genetic Definition of the Lynch Syndrome?

We examined a variety of clinical and laboratory predictors as described in Chapters 1 and 2. A central question of this report relates to the accuracy of various predictors in unselected patients with CRC. Because testing for MMR mutations is expensive, most studies performed testing only in patients who had been pre-selected based on clinical or laboratory features. Thus, it is critically important to describe the specific CRC population when attempting to make comparisons among studies.

An external file that holds a picture, illustration, etc., usually as some form of binary object. The name of referred object is er-hnpccf8.jpg.

   Figure 8. Relationship between the CRC populations defined by different clinical predictors

The various clinical predictors defined populations at different risk for HNPCC. Figure 8 illustrates the relationship among patient populations defined by Amsterdam I criteria, Amsterdam criteria II, Bethesda guidelines, and unselected CRC patients.

Table 16

Overview of available evidence on the sensitivity and specificity of various predictors for MMR mutation rates
PredictorAll studiesSpecific CRC populations defined by increasingly selective criteria
Unselected CRC probandsRevised Bethesda guidelinesBethesda guidelinesModified Amsterdam criteriaAmsterdam II criteriaAmsterdam I criteria
Amsterdam I criteriaF-6F-7NDF-8NDF-9
(n=19)(n=2)(n=2)(n=5)
Amsterdam II criteriaF-10F-11F-12F-13ND
(n=12)(n=2)(n=1)(n=3)
Modified Amsterdam criteriaF-14NDNDND
(n=2)
Bethesda guidelinesF-15F-16ND
(n=5)(n=1)
Revised Bethesda guidelinesF-17F-17
(n=1)(n=1)
Young age of onsetF-18F-19NDNDNDNDND
(n=5)(n=4)
Family historyF-20F-21NDNDND
(n=9)(n=4)
Multiple tumors in the same patientF-22F-22NDNDNDNDND
(n=3)(n=3)
Age <50 years, family history, or multiple tumors in same patientF-23F-23NDNDNDNDND
(n=3)(n=3)
Suggestive MSI (MSI-H; MSI-H and MSI-L)F-24F-25F-26NDNDNDF-27
(n=16)(n=2)(n=1)(n=3)
Suggestive IHCF-28NDNDNDNDNDF-29
(n=9)(n=2)

Table rows represent different predictors; the table columns describe the populations addressed in the summary tables. Each cell in the table refers to a corresponding Summary Table of the appendix. For example, the second cell of the second row shows that there were 19 studies that described the ability of Amsterdam I criteria to predict MMR status. The studies are described in Appendix F-6. The third cell of the second row shows that of these 19 studies, only two performed MMR testing in unselected patients; these studies are described in Appendix F-7, and so on.

ND: No data

Table 16 presents the different populations that underwent MMR testing in all studies included in this analysis. Moving to the right, columns represent increasingly selected patient populations (by analogy, moving to the top of the pyramid in Figure 8). Table 16 provides a roadmap for the analyses presented in the following sections.

Table 17

Sensitivity and specificity of various predictors for detecting MMR gene mutations
PredictorUnselected CRC probands Revised Bethesda guidelines Bethesda guidelines Amsterdam II criteria Amsterdam I criteria
NSens [%](95% CI)Spec [%](95% CI)NSens [%](95% CI)Spec [%](95% CI)NSens [%](95% CI)Spec [%](95% CI)NSens [%](95% CI)Spec [%](95% CI)NSens [%](95% CI)Spec [%](95% CI)
Amsterdam I criteria245 (29, 63)99 (74, 100)ND257 (46, 68)48 (35, 62)580 (70, 88)24 (12, 43)
Amsterdam II criteria228 (15, 47)99 (97, 100)168 (43, 87)65 (51, 76)384 (74, 91)62 (53, 69)
Modified Amsterdam criteriaNDNDND
Bethesda guidelines173 (39, 94)82 (80, 84)ND
Revised Bethesda guidelines191 (59, 100)77 (75, 79)
Age <50 years331 (18, 47)95 (94, 96)NDNDNDND
1st degree family history of CRC or EC476 (50, 91)87 (86, 89)NDND
Multiple CRC or EC tumors in the same patient338 (25, 54)97 (91, 99)NDNDNDND
Age <50 years, family history of CRC or EC, or multiple tumors in same patient388 (60, 97)77 (74, 81)NDNDNDND
Suggestive MSIa2100 (88, 100)90 (88, 92)1100 (75, 100)79 (63, 90)NDND3100 (62, 100)69 (20, 95)
Suggestive IHCNDNDNDND250 (20,80)72 (15, 97)

CRC: colorectal cancer; EC: endometrial cancer; N: Number of studies; Sens: (summary) sensitivity; Spec: (summary) specificity.

a

Estimates are the same for combined MSI-H and MSI-L versus MSS and for MSI-H versus MSS.

Table 17 summarizes the overall sensitivity and specificity of the various predictors among several CRC populations. These are described in detail in the sections below.

We first present an overview of the clinical predictors among unselected CRC patients. We then present each one of the clinical predictors separately.

Overview of Clinical Predictors Among Unselected Patients With CRC

Table F-11

Ability of Amsterdam II criteria to identify MLH1 and MSH2 mutation carriers among unselected colorectal cancer probands
Study, year (Ref ID);A. Study sample characteristicsA. Genetic testingNAm2/NtotalMutation No mutation Diagnostic performance (95% confidence interval) Quality
CountryB. Verification biasB. MLH1/MSH2Am2 (+)Am2 (-)Am2 (+)Am2 (-)Sensitivity [%]Specificity [%]
Single-/multi-centerC. Mean age (y); Males (%)C. Definition of deleterious mutations
Genetic testing irrespectively of MSI or IHC test results
Salovaara, 2000 (1740)A. Selection of all new unrelated CRC from 9 hospitals between 03/1996 and 06/1998A. PCR → Sequencing Ø PCR for founder mutations in MLH1 gene5/535414151622 (6, 48)100 (99, 100)B
FinlandB. Yes: patients without MSI were screened only for MLH1 founder mutationsB. 17/1
Multi-centerC. 67, NDC. Literature; comparison with non-cancer controls
Genetic testing only in patients selected after MSI and/or ICH
Pinol, 2005 (52)A. Selection of newly diagnosed CRC from 25 centers.A. CRC selected by MSI/IHC: PCR → Sequencing Ø also MLPA22/1222Assuming no mutations in the absence of MSI-H tumors or tumors with negative immunostaining:B
SpainB. Yes: patients without MSI or with negative immunostaining were not sequencedB. 4/74718119736 (11, 69)99 (98, 99)
Multi-centerC. 70, 60C. Predicted transcript alteration; literature and databases

As mentioned in the methods, especially for unselected CRC populations we accepted that patients with MSI negative tumors would be negative for mutations.

Am2: Amsterdam II criteria; CRC: colorectal cancer; MLPA: Multiple ligation-dependent probe amplification; MSI(-H): microsatellite instability (high); ND: Not described;

NAm2:Number fulfilling Amsterdam II criteria; Ntotal: total number of studied CRC; PCR: polymerase chain reaction

Conversion analysis or gene screening were not used in these two studies.

Ø: Analysis for large deletions has been used

Table F-16

Ability of Bethesda guidelines to identify MLH1 and MSH2 mutation carriers among unselected patients with colorectal cancer
Study, year (Ref ID);A. Comments on sampling characteristicsA. Genetic testingNBeth/ NtotalMutation No mutation Diagnostic performance (95% confidence interval) Quality
CountryB. Verification biasB. MLH1/MSH2Beth (+)Beth (-)Beth (+)Beth (-)Sensitivity [%]Specificity [%]
Single-/multi-centerC. Mean age (y); Males (%)C. Definition of deleterious mutations
Pinol, 2005 (52)A. Selection of newly diagnosed CRC from 25 centers.A. CRC selected by MSI/IHC: PCR → Sequencing Ø also MLPA224/1222Assuming no mutations in the absence of MSI-H tumors or tumors with negative immunostaining:B
SpainB. Yes: patients without MSI or with negative immunostaining were not sequencedB. 4/78321699573 (39, 94)82 (80, 84)
Multi-centerC. 70, 60C. Predicted transcript alteration; literature and databases

Beth: Bethesda guidelines; CRC: colorectal cancer; IHC: immunohistochemistry; MLPA: Multiple ligation-dependent probe amplification; MSI: microsatellite instability; ND: Not described; Ntotal: total number of studied CRC; PCR: Polymerase chain reaction

Ø: Deletion analysis (detection of large genomic deletions) was used

Pinol et al. did not use gene screening methods or conversion analysis. They assessed only the MLH1 and MSH2 genes.

Table F-17

Ability of revised Bethesda guidelines to identify MLH1 and MSH2 mutation carriers among unselected patients with colorectal cancer
Study, year (Ref ID);A. Comments on sampling characteristicsA. Genetic testingNBeth/NtotalMutation No mutation Diagnostic performance (95% confidence interval) Quality
CountryB. Verification biasB. MLH1/MSH2Beth Rev (+)Beth Rev (-)Beth Rev (+)Beth Rev (-)Sensitivity [%]Specificity [%]
Single /multi-centerC. Mean age (y); Males (%)C. Definition of deleterious mutations
Pinol, 2005 (52)A. Selection of newly diagnosed CRC from 25 centers.A. CRC selected by MSI/IHC: PCR → Sequencing Ø also MLPA287/1222Assuming no mutations in the absence of MSI-H tumors or tumors with negative immunostaining:B
SpainB. Yes: patients without MSI or with negative immunostaining were not sequencedB. 4/710127793491 (59, 100)77 (75, 79)
Multi-centerC. 70, 60C. Predicted transcript alteration; literature and databases

Beth Rev: Revised Bethesda guidelines; CRC: colorectal cancer; IHC: immunohistochemistry; MLPA: Multiple ligation-dependent probe amplification; MSI: microsatellite instability; ND: Not described; Ntotal: total number of studied CRC; PCR: Polymerase chain reaction

Ø: Deletion analysis (detection of large genomic deletions) was used

Pinol et al. did not use gene screening methods or conversion analysis. They assessed only the MLH1 and MSH2 genes.

Table F-19

Ability of Ability of young age at diagnosis (early disease onset) to identify MLH1 and MSH2 mutation carriers among unselected colorectal cancer probands
Study, year (Ref ID);A. Definition of early onsetA. Genetic testingNtotalMutation No mutation Diagnostic performance (95% confidence interval) Quality
CountryB. Study sample characteristicsB. MLH1/MSH2Early onsetNo early onsetEarly onsetNo early onsetSensitivity [%]Specificity [%]
Single-/multi- centerC. Verification biasC. Definition of deleterious mutations
D. Mean age (y); Males (%)
Genetic testing irrespectively of tumor microsatellite instability status
Salovaara, 2000 (1740)A. <50 yA. PCR → Sequencing Ø PCR for founder mutations in MLH1 gene5355134047728 (10, 53)92 (90, 94)B
FinlandB. Selection of all new unrelated CRC from 9 hospitals between 03/1996 and 06/1998B. 17/1
Multi-centerC. Yes: patients without MSI were screened only for MLH1 founder mutationsC. Literature; comparison with non-cancer controls
D. 67, ND
Aaltonen, 1998 (2282)A. <50 yA. Ø All CRC: PCR for founder mutations 1 & 2 in MLH1 ♦CRC with MSI: (some) PCR → DGGE → Sequencing (Remaining) PCR → Sequencing509461248767 (22, 96)98 (96, 99)B
FinlandB. Selection of all new unrelated CRC from 9 hospitals between 05/1994 and 04/1996B. 9/1
Multi-centerC. Yes: patients without MSI were screened only for MLH1 founder mutationsC. Literature; comparison with healthy controls
D. ND, ND
Genetic testing only in patients selected after MSI and/or ICH
Pinol, 2005 (52)A. <50 yA. CRC selected by MSI/IHC: PCR → Sequencing Ø also MLPA1222Assuming no mutations in the absence of MSI-H tumors or tumors with negative immunostaining:B
SpainB. Selection of newly diagnosed CRC from 25 centersB. 4/73855115627 (6, 61)95 (94, 97)
Multi-centerC. Yes: patients without MSI or with negative immunostaining were not sequencedC. Predicted transcript alteration; literature and databases
D. 70, 60
Samowitz 2001, (34);A. <55yA. CRC selected by MSI:bPCR → Sequencing Ø Also PCR for founder mutations in the MLH1 gene1066Assuming no mutations in the absence of MSI-H tumors:B
USB. Selection among incident CRCB. 5/3c4315486357 (18, 90)85 (83, 87)
MulticenterC. Yes: patients without suggestive MSI results were not sequencedC. Predicted transcript alteration; literature
D. ND, ND

Studies are ordered by quality and then by decreasing number of patients available for the calculation of sensitivity and specificity (2 by 2 tables). None of the studies used conversion analysis to detect mismatch repair gene mutations.

Am1/2: Amsterdam I criteria/II; CRC: colorectal cancer; DGGE: Denaturing gradient gel electrophoresis; DHPLC: denaturating high performance liquid chromatography; MLPA: Multiple ligation-dependent probe amplification; MSI: microsatellite instability; ND: Not described; Ntotal: total number of studied CRC; PCR: polymerase chain reaction

♦: Gene screening method

Ø: Detection of large genomic deletions

Table F-21

Ability of familial history of malignancy to identify MLH1 and MSH2 mutation carriers among unselected colorectal cancer probands
Study, year (Ref ID);A. Definition of familial history of cancerA. Genetic testingNtotalMutation No mutation Diagnostic performance (95% confidence interval) Quality
CountryB. Definition of sporadic cancerB. MLH1/MSH2FamilialCancer HxSporadic CancerFamilial Cancer HxSporadic CancerSensitivity [%]Specificity [%]
Single-/multi-centerC. Comments on sample characteristicsC. Definition of deleterious mutations
D. Verification bias
E. Mean age (y); Males (%)
Genetic testing irrespectively of tumor microsatellite instability status
Salovaara, 2000 (1740);A. 1st degree relative with CRC or endometrial cancerA. PCR → Sequencing Ø PCR for founder mutations in MLH1 gene5351536245583 (59, 96)88 (85, 91)B
FinlandB. All other CRCB. 17/1
Multi-centerC. Selection of all new unrelated CRC from 9 hospitals between 03/1996 and 06/1998C. Literature; comparison with non-cancer controls
D. Yes: patients without MSI were screened only for MLH1 founder mutations
E. 67, ND
Aaltonen, 1998 (2282);A. 1st degree relative with CRC or endometrial cancerA. Ø All CRC: PCR for founder mutations 1 & 2 in MLH1 ♦CRC with MSI: (some) PCR → DGGE → Sequencing (Remaining) PCR → Sequencing509917142890 (55, 100)86 (82, 89)B
FinlandB. All other CRCB. 9/1
Multi-centerC. Selection of all new unrelated CRC from 9 hospitals between 05/1994 and 04/1996C. Literature; comparison with healthy controls
D. Yes: patients without MSI were screened only for MLH1 founder mutations
E. ND, ND
Genetic testing only in patients selected after MSI and/or ICH
Pinol, 2005 (52);A. 1st degree relative with CRC of endometrial cancerA. CRC selected by MSI/IHC: PCR → Sequencing Ø also MLPA1222Assuming no mutations in the absence of MSI-H tumors or tumors with negative immunostaining:B
SpainB. All other CRCB. 4/765151106055 (23, 83)88 (86, 89)
Multi-centerC. Selection of newly diagnosed CRC from 25 centers.C. Predicted transcript alteration; literature and databases
D. Yes: patients without MSI or with negative immunostaining were not sequenced
E. 70, 60
Samowitz 2001, (34);A. Family history of CRCA. CRC selected by MSI:aPCR → Sequencing Ø Also PCR for founder mutations in the MLH1 gene1066Assuming no mutations in the absence of MSI-H tumors:B
USB. All other patientsB. 5/3b4314787057 (18,90)86 (83,88)
MulticenterC. Selection among incident CRCC. Predicted transcript alteration; literature
D. Yes: patients without suggestive MSI results were not sequenced
E. ND, ND

Studies are ordered by quality and then by decreasing number of patients available for the calculation of sensitivity and specificity (2 by 2 tables). None of the studies used conversion analysis to detect mismatch repair gene mutations.

Am1: Amsterdam I criteria; CRC: colorectal cancer; DGGE: Denaturing gradient gel electrophoresis; Hx: History; IHC: immunohistochemistry; MSI: microsatellite instability; ND: Not described; Ntotal: total number of studied CRC; PCR: polymerase chain reaction

♦: Gene screening method

Ø: Detection of large genomic deletions

a

130 out of 171 of people with tumors with MSI instability could be genetically tested.

b

One patient had mutations both in the MLH1 and in the MSH2 gene

Table F-22

Ability of presence of multiple tumors to identify MLH1 and MSH2 mutation carriers among unselected colorectal cancer probands
Study, year (Ref ID);A. Definition of multiple tumorsA. Genetic testingNtotalMutation No mutation Diagnostic performance (95% confidence interval) Quality
CountryB.Comments on sample characteristicsB. MLH1/MSH2Multiple tumorsNo multiple tumorsMultiple tumorsNo multiple tumorsSensitivity [%]Specificity [%]
Single-/multi-centerC. Verification biasC. Definition of deleterious mutations
D. Mean age (y); Males (%)
Genetic testing irrespectively of tumor microsatellite instability status
Salovaara, 2000 (1740);A. Synchronous or metachronous endometrial cancer or CRCA. PCR → Sequencing Ø PCR for founder mutations in MLH1 gene535711551264 (31, 89)99 (98, 100)B
FinlandB. Selection of all new unrelated CRC from 9 hospitals between 03/1996 and 06/1998B. 17/1
Multi-centerC. Yes: patients without MSI were screened only for MLH1 founder mutationsC. Literature; comparison with non-cancer controls
D. 67, ND
Aaltonen, 1998 (2282);A. Synchronous or metachronous endometrial cancer or CRCA. Ø All CRC: PCR for founder mutations 1 & 2 in MLH1 ♦ CRC with MSI: (some) PCR → DGGE → Sequencing (Remaining) PCR → Sequencing509461248740 (12,74)98 (96,99)B
FinlandB. Selection of all new unrelated CRC from 9 hospitals between 05/1994 and 04/1996B. 9/1
Multi-centerC. Yes: patients without MSI were screened only for MLH1 founder mutationsC. Literature; comparison with healthy controls
D. ND, ND
Genetic testing only in patients selected after MSI and/or ICH
Pinol, 2005 (52);A. Synchronous or metachronous endometrial cancer or CRCA. CRC selected by MSI/IHC: PCR → Sequencing Ø also MLPA1222Assuming no mutations in the absence of MSI-H tumors or tumors with negative immunostaining:B
SpainB. Selection of newly diagnosed CRC from 25 centersB. 4/74790112136 (11, 69)93 (91, 94)
Multi-centerC. Yes: patients without MSI or with negative immunostaining were not sequencedC. Predicted transcript alteration; literature and databases
D. 70, 60

Studies are ordered by quality and then by decreasing number of patients available for the calculation of sensitivity and specificity (2 by 2 tables). None of the studies used conversion analysis to detect mismatch repair gene mutations.

CRC: colorectal cancer; DGGE: Denaturing gradient gel electrophoresis; Hx: History; IHC: immunohistochemistry; MSI: microsatellite instability; ND: Not described; Ntotal: total number of studied CRC; PCR: polymerase chain reaction

♦:Gene screening method

Ø:Detection of large genomic deletions

Table F-23

Ability of presence of combined family history of colorectal cancer, young age at onset or presence of multiple tumors to identify MLH1 and MSH2 mutation carriers among unselected colorectal cancer probands
Study, year (Ref ID);A. Definition of combined criteriaA. Genetic testingNtotalMutation No mutation Diagnostic performance (95% confidence interval) Quality
CountryB. Comments on sample characteristicsB. MLH1/MSH2Combined criteriaOtherCombined criteriaOtherSensitivity [%]Specificity [%]
Single-/multi-centerC. Verification biasC. Definition of deleterious mutations
D. Mean age (y); Males (%)
Genetic testing irrespectively of tumor microsatellite instability status
Salovaara, 2000 (1740);A. Age <50 or CRC or endometrial cancer in 1st degree family or personal history of CRC or endometrial cancerA. PCR → Sequencing Ø PCR for founder mutations in MLH1 gene53517110041794 (73, 100)81 (77, 84)B
FinlandB. Selection of all new unrelated CRC from 9 hospitals between 03/1996 and 06/1998B. 17/1
Multi-centerC. Yes: patients without MSI were screened only for MLH1 founder mutationsC. Literature; comparison with non-cancer controls
D. 67, ND
Aaltonen, 1998 (2282);A. Age <50 or CRC or endometrial cancer in 1st degree family or personal history of CRC or endometrial cancerA. Ø All CRC: PCR for founder mutations 1 & 2 in MLH1 ♦ CRC with MSI: (some) PCR → DGGE → Sequencing (Remaining) PCR → Sequencing509100112387100 (69, 100)78 (74, 81)B
FinlandB. Selection of all new unrelated CRC from 9 hospitals between 05/1994 and 04/1996B. 9/1
Multi-centerC. Yes: patients without MSI were screened only for MLH1 founder mutationsC. Literature; comparison with healthy controls
D. ND, ND
Genetic testing only in patients selected after MSI and/or ICH
Pinol, 2005 (52);A. Age <50 or CRC or endometrial cancer in 1st degree family or personal history of CRC or endometrial cancerA. CRC selected by MSI/IHC: PCR → Sequencing Ø also MLPA1222Assuming no mutations in the absence of MSI-H tumors or tumors with negative immunostaining:B
SpainB. Selection of newly diagnosed CRC from 25 centers.B. 4/78330690573 (39, 94)75 (72, 77)
Multi-centerC. Yes: patients without MSI or with negative immunostaining were not sequencedC. Predicted transcript alteration; literature and databases
D. 70, 60

Studies are ordered by quality and then by decreasing number of patients available for the calculation of sensitivity and specificity (2 by 2 tables). None of the studies used conversion analysis to detect mismatch repair gene mutations.

CRC: colorectal cancer; DGGE: Denaturing gradient gel electrophoresis; Hx: History; IHC: immunohistochemistry; MSI: microsatellite instability; ND: Not described; Ntotal: total number of studied CRC; PCR: polymerase chain reaction

♦:Gene screening method

Ø:Detection of large genomic deletions

Table F-25

Ability of microsatellite instability to identify MLH1 and MSH2 mutation carriers among unselected colorectal cancer probands
Study, year (Ref ID);A. Comments on sample characteristicsNtotalMutation No mutation Diagnostic performance (95% confidence interval) Micro-dissectionNCI 5 marker setQuality
CountryB. Verification biasMSI-HMSSMSI-HMSSSensitivity [%]Specificity [%]
Single-/multi-centerC. Mean age (y); Males (%)
D. Definition of MSI
Salovaara, 2000 (1740)A. Selection of all new unrelated CRC from 9 hospitals between 0.3/1996 and 06/199853518048469100 (81, 100)91 (88, 93)XXB
FinlandB. Yes: patients without MSI were screened only for MLH1 founder mutations
Multi-centerC. 67, ND
D. MSI based on BAT26 only
Aaltonen, 1998 (2282)A. Selection of all new unrelated CRC from 9 hospitals between 05/1994 and 04/199650910053446100 (69, 100)89 (86, 92)XXB
FinlandB. Yes: patients without MSI were screened only for MLH1 founder mutations
Multi-centerC. ND, ND
D. ≥30% of 16 markers for tumor analyzed with fluorescence methods or ≥ 2 out of 7 (≈30%) markers analyzed with radioactive technique (MSI-H)

Note that studies that assessed genetic mutations only in patients with MSI cannot be used to construct 2 by 2 tables for the ability of MSI testing to detect MMR mutations. Thus such studies are not included in this table.

CRC: colorectal cancer; MSI(-H): microsatellite instability (-high); MSS: microsatellite-stable (no instability); ND: Not described; Ntotal: total number of studied CRC

In total, five studies provided information on eight clinical predictors among unselected CRC probands (Salovaara 2000,85 Aaltonen 1998,63 Colombino 2005,83, Samowitz 2001,10 and Pinol 200512) (Appendices F-7, F-11, F-16, F-17, F-19, F-21, F-22, F-23, F-25 *). All studies received a grade B in the overall quality rating. All were limited by verification bias. In the two studies from Finland63, 85 founder mutations that are unique in the Finnish population were also assessed. These specific founder mutations have not been found in the US population.

The five studies differed in their testing strategies. Aaltonen 199863 and Salovaara 200085 performed comprehensive genetic testing only among patients whose tumors exhibited MSI. The remaining patients were tested only for common founder mutations in the Finnish population (large deletions in the MLH1 gene). Samowitz 200110 and Pinol 200512 performed genetic testing only among patients with tumors that had suggestive MSI (or suggestive IHC testing for Pinol 200512). Finally, Colombino 200583 performed comprehensive genetic testing only among patients with cancer history in 1st or 2nd degree family, and tested the remaining cases only for the mutations that were identified in the former.

As noted in the methods, we assumed that all patients who were not selected for genetic testing based on the MSI/IHC results were mutation negative.

An external file that holds a picture, illustration, etc., usually as some form of binary object. The name of referred object is er-hnpccf9.jpg.

   Figure 9. Sensitivity and specificity of clinical criteria for detecting mismatch repair mutations among unselected patients with CRC

Figure 9 illustrates the sensitivity and specificity of the clinical criteria among unselected CRC patients.

As shown in Figure 9 and Table 17, the revised Bethesda guidelines had the best sensitivity (91%, [95% CI: 59, 100%]). However, clinical predictors that are relatively easier to assess such as the family history of colorectal or endometrial cancer, or the fulfillment of at least one of three simple clinical criteria (proband age less than 50 years at diagnosis, history of CRC or endometrial cancer in 1st degree family, or multiple synchronous or metachronous CRC or endometrial cancer in the proband) appeared to have better test performance than the Amsterdam I and II criteria, or even the Bethesda guidelines. Specific summary estimates are presented in Table 17 and are also mentioned in the following sections.

Amsterdam I Criteria

Nineteen studies (described in 21 publications29, 61, 6368, 7177, 7983, 96) provided information needed to calculate sensitivity and specificity for this analysis (Appendix F-6 *). Fifteen assessed the clinical predictors among all patients, and three (Casey 2005,61 Raedle 2001,29 and Nakahara 1997,96 Appendix F-6 *) among patients with suggestive MSI.

Ten studies were rated grade B for their overall methodologic quality29, 61, 63, 6567, 71, 74, 77, 7981 and nine received grade C.

Genetic Testing Irrespective of MSI or IHC Status. Sixteen studies performed some form of genetic testing in all people, irrespective of suggestive MSI or IHC (Appendix F-6 *). Only four of these studies performed sequencing on all available samples,75, 77, 79, 81 and only Wang 199981 also tested for large deletions/rearrangements. Most studies tested only for mutations in MLH1 and MSH2. Wang 199981 also assessed the MSH6 gene, the PMS2 and PMS1 genes (no deleterious mutations were identified in non-MLH1 and non-MSH2 genes). Park 199976 sought mutations in additional MMR genes (PMS1 and PMS2) and in only a minority of patients (without finding any additional mutations). Eight out of the sixteen 2×2 tables had at least 40 patients in total.

There was variability in the CRC populations that were examined (Appendix F-6 *). The sample selection process was considered to be transparent (based on clearly stated selection criteria applied to all available patients) in only eight studies.63, 65, 67, 71, 74, 77, 7981, 83 Of these, three sampled from unselected, non-referral CRC populations.63, 65, 71, 83 The remaining five sampled from referral or otherwise selected CRC patients67, 74, 77, 7981 (Appendix F-6 *).

An external file that holds a picture, illustration, etc., usually as some form of binary object. The name of referred object is er-hnpccf10.jpg.

   Figure 10. Sensitivity and specificity of the Amsterdam I criteria for detecting mismatch repair mutations in patients with CRC

Figure 10 graphically depicts the sensitivity and specificity of the 16 studies that performed some form of genetic testing in all people irrespective of suggestive MSI/IHC. A study suggesting that the Amsterdam I criteria had perfect test characteristics (i.e., sensitivity and specificity of 100%) would appear in the upper left corner. The graph shows that the Amsterdam I criteria are not highly sensitive for detecting MMR gene mutations. In two studies that enrolled unselected patients with CRC, the summary estimate of sensitivity was only 45% (95% CI: 29, 63%), and the summary specificity was 99% (95% CI: 74, 100%).63, 83 However, both studies were limited by verification bias, as described below.

An external file that holds a picture, illustration, etc., usually as some form of binary object. The name of referred object is er-hnpccf11.jpg.

   FIgure 11. Sensitivity and specificity of the Amsterdam I criteria for detecting mismatch repair mutations: study subgroups according to various factors

Overall, the distribution of sensitivity and specificity of the various studies did not follow a discernable pattern. The differences may be related to variation in genetic strategies (gene screening and deletion analysis), the definition of pathogenic mutations, sample selection processes (clearly described versus not), overall study methodologic quality (B versus C), or within-study heterogeneity of “baseline risk” for HNPCC (study sample included patients at very different risks for HNPCC). However, as the graphs in Figure 11 show, none of these factors alone appears to account for the variability. The variability is most likely attributable to the very different CRC populations assessed in these studies.

Table F-8

Ability of Amsterdam I criteria to identify MLH1 and MSH2 mutation carriers among colorectal cancer probands fulfilling the Bethesda guidelines
Study, year (Ref ID);A. Study sample characteristicsA. Genetic testingNAm1/NtotalMutation No mutation Diagnostic performance (95% confidence interval) Quality
CountryB. Verification biasB. MLH1/MSH2Am1 (+)Am1 (-)Am1 (+)Am1 (-)Sensitivity [%]Specificity [%]
Single-/multi-centerC. Mean age (y); Males (%)C. Definition of deleterious mutations
De Abajo 2005;A. Selection among referrals to a specialized centerA. PCR → DGGE → sequencing (MSH6 assessed in MLH1/MSH2 negative cases)56/1323311233775 (60, 87)62 (48, 74)B
SpainB. NoB. 24/17 (and 3 MSH6)
Single-centerC. ND; NDC. Predicted non-conservative transcription alteration; literature; comparison with healthy controls
Syngal, 2000 (1672) & Wahlberg, 2002 (1158);A. Selection among referrals to specialized centerA. PCR→sequencing56/70116172265 (38, 86)56 (40, 72)B
USB. NoB. 18 (MLH1 and MSH2)
Single-centerC. ND; NDC. Predicted transcription alteration; literature

The tabulated study did not assess genes other than MLH1 and MSH2. Genetic testing did not include gene screening, analysis for large genomic deletions or conversion analysis.

Am1: Amsterdam I criteria; ND: Not described; NAm1:Number fulfilling Amsterdam I criteria; Ntotal: total number of studied CRC; PCR: polymerase chain reaction

Table F-9

Ability of Amsterdam I criteria to identify MLH1 and MSH2 mutation carriers among colorectal cancer probands fulfilling Amsterdam II criteria
Study, year (Ref ID);A. Study sample characteristicsA. Genetic testingNAm1/NtotalMutation No mutation Diagnostic performance (95% confidence interval) Quality
CountryB. Verification biasB. MLH1/MSH2Am1 (+)Am1 (-)Am1 (+)Am1 (-)Sensitivity [%]Specificity [%]
Single-/multi-centerC. Mean age (y); Males (%)C. Definition of deleterious mutations
De Abajo 2005;A. Selection among referrals to a specialized centerA. PCR → DGGE → sequencing (MSH6 assessed in MLH1/MSH2 negative cases)56/13233623585 (69, 94)18 (6, 37)B
SpainB. NoB. 24/17 (and 3 MSH6)
Single-centerC. ND; NDC. Predicted non-conservative transcription alteration; literature; comparison with healthy controls
Syngal, 2000 (1672) & Wahlberg, 2002 (1158);A. Selection among referrals to specialized centerA. PCR→sequencing34/7011317379 (49, 95)15 (3, 38)B
USB. NoB. 18 (MLH1 and MSH2)
Single-centerC. ND; NDC. Predicted transcription alteration; literature
Katballe, 2002 (1310) & Christensen, 2002 (1038);A. Familial CRC selected from a population of 1514 newly diagnosed CRC: patients fulfilling Am2 (in extended families and relaxing the age criterion to <55y) and familial CRC with early age of onsetA. ♦ PCR→SSCP & HD→ Sequencing of abnormal patterns23/45536963 (25, 92)60 (32, 84)B
DenmarkB. NoB. 4/6
Single-centerC. ND; NDC. Predicted transcription alteration; literature
Rossi, 2002 (1146)A. Selected from consecutive CRC referrals: Am2 or familial CRC(including HNPCC-relatedcancer in family), or sporadic CRC aged <50y or with multipletumorsA. PCR→ sequencing5/25113050 (1, 99)0 (0, 71)B
BrazilB. NoB. 4/6
Single-centerC. ND; NDC. Unclear
Lamberti, 1999 (2036);A. Study sample assembled with unclear selection process; includes Am1, Am2, other familial CRC and CRC <50y at diagnosis or multiple tumorsaA. ♦ PCR → SSCP, and RT-PCR → PTA69/ 160a152421088 (64, 99)19 (10, 33)C
ItalyB. NoB. 11/6
Single-centerC. 44 for Am1, 37 for Am2; NDC. Literature

Studies are ordered by quality and then by decreasing number of patients available for the calculation of sensitivity and specificity (2 by 2 tables). None of the studies used deletion analysis to detect large genomic deletions or conversion analysis to detect mismatch repair gene mutations. Most studies did not provide data on demographics (age and gender distribution) for the subgroup of patients fulfilling the Amsterdam II criteria.

Am1/2: Amsterdam I criteria/II; CRC: colorectal cancer; HD: heteroduplex formation; ND: Not described; NAm1:Number fulfilling Amsterdam I criteria; Ntotal: total number of studied CRC; PCR: polymerase chain reaction; PTA: protein truncation assay; RT-PCR: reverse transcriptase PCR; SSCP: Single-stranded conformation polymorphism

♦: Gene screening method

a

69/160 included cases fulfilled Amsterdam II criteria and these are analyzed here. The remaining cases were 45 CRC aged <50 y at diagnosis and relatives with HNPCC related cancers and 46 CRC aged <50 y at diagnosis or CRC with multiple tumors (no age cutoff). However, these received genetic testing inconsistently and are not included in this analysis

Amsterdam I Criteria Among Different Populations. As discussed in the Methods section, clinical predictors are expected to have substantially different sensitivity and specificity to detect mismatch repair gene mutations in CRC populations selected using different clinical criteria. We assessed the sensitivity and specificity of Amsterdam I criteria among CRC subpopulations that were defined consistently across studies (Appendices F-7, F-8 and F-9 *).

An external file that holds a picture, illustration, etc., usually as some form of binary object. The name of referred object is er-hnpccf12.jpg.

   Figure 12. Sensitivity and specificity of the Amsterdam I criteria for detecting mismatch repair gene mutations among populations with an increasing likelihood of having HNPCC

Figure 12 depicts the change in the sensitivity and specificity of the Amsterdam I criteria among CRC populations that had an increasing likelihood of having HNPCC: unselected CRC, CRC fulfilling the Bethesda criteria, and CRC fulfilling Amsterdam II criteria. As the likelihood for HNPCC increases, the studies shift toward the upper right (i.e., better sensitivity and worse specificity). Thus, there is evidence for spectrum effects in the diagnostic ability of the Amsterdam I set of criteria.

Amsterdam I Criteria Among Unselected Patients With CRC. Two studies (Aaltonen 1998,63 and Colombino 200583) assessed the performance of the Amsterdam I criteria among unselected CRC patients (Appendix F-7 *). The first63 assessed all new incident CRC cases from nine Finnish hospitals, while the second83 was retrospective and assessed all CRC patients who were registered in a tertiary hospital during the 3 years before the study (the authors commented that their hospital registered practically all CRC cases diagnosed in Sardinia).

Both studies were limited by verification bias. Aaltonen 199863 performed comprehensive genetic testing only among 63 patients who had tumors with MSI, and tested the remaining 446 for a common founder mutation in the MLH1 gene. Colombino 200583 performed detailed genetic testing only among patients with family history and assessed patients with apparently sporadic CRC only for mutations found in the familial cases. Thus, both studies clearly overestimated the sensitivity and the specificity of Amsterdam I criteria to detect mutations. Their summary sensitivity was 45% (95% CI: 29, 63%) and their summary specificity was 99% (95% CI: 74, 100%). The wide confidence intervals of the sensitivity values reflect that few patients fulfilled Amsterdam I criteria (n=4 in Aaltonen 1998,63 and n=21 in Colombino 200583).

Genetic Testing Only Among People Who Have MSI Positive (or IHC Negative) Tumors. In the three studies that were pertinent to this category29, 61, 96 the sensitivities ranged between 55% and 78% and the specificities between 40% and 100% (Appendix F-6 *).

Amsterdam II Criteria

Table F-10

Ability of Amsterdam II criteria to identify MLH1 and MSH2 mutation carriers among selected colorectal cancer probands
Study, year (Ref ID);A. Study sample characteristicsA. Genetic testingNAm2/NtotalMutation No mutation Diagnostic performance (95% confidence interval) Quality
CountryB. Verification biasB. MLH1/MSH2Am2 (+)Am2 (-)Am2 (+)Am2 (-)Sensitivity [%]Specificity [%]
Single-/multi-centerC. Mean age (y); Males (%)C. Definition of deleterious mutations
Genetic testing irrespectively of MSI or IHC test results
Salovaara, 2000 (1740)A. Selection of all new unrelated CRC from 9 hospitals between 03/1996 and 06/1998A. PCR → Sequencing Ø PCR for founder mutations in MLH1 gene5/535414151622 (6, 48)100 (99, 100)B
FinlandB. Yes: patients without MSI were screened only for MLH1 founder mutationsB. 17/1
Multi-centerC. 67, NDC. Literature; comparison with non-cancer controls
De Abajo 2005;A. Selection among referrals to a specialized centerA. PCR → DGGE → sequencing (MSH6 assessed in MLH1/MSH2 negative cases)67/132395286089 (75, 96)68 (57, 78)B
SpainB. NoB. 24/17 (and 3 MSH6)
Single-centerC. ND; NDC. Predicted non-conservative transcription alteration; literature; comparison with healthy controls
Wolf, 2005 (123)A. Retrospective cohort of cancer patients fulfilling the modified Bethesda criteriaA. PCR → Sequencing35/81136224068 (43, 87)65 (51, 76)B
AustriaB. NoB. 12/7
Single-centerC. ND, 48C. Predicted transcription alteration; literature; comparison with healthy controls
Zhu, 2005 (138)A. Study sample assembled with unclear selection process: Familial CRC and sporadic CRCA. Ø MLPA → Sequencing of detected aberrations21/7845175244 (14, 79)75 (64, 85)B
ChinaB. NoB. 4/5
Single-centerC. ND, NDC. Unclear
Syngal, 2000 (1672) & Wahlberg, 2002 (1158);A. Selection among referrals to specialized centerA. PCR → Sequencing34/70144203278 (52, 74)64, (49, 77)B
USB. NoB. 18 (MLH1 and MSH2)
Single-centerC. ND; NDC. Predicted transcription alteration; literature
Katballe, 2002 (1310) & Christensen, 2002 (1038);A. Familial CRC selected from a population of 1514 newly diagnosed CRC: patients fulfilling Amsterdam II criteria (in extended families and relaxing the age criterion to <55y) and familial CRC with early age of onsetA. ♦PCR → SSCP & HD → Sequencing of abnormal patterns18/4582102180 (44, 97)68 (49, 83)B
DenmarkB. NoB. 4/6
Single-centerC. ND; NDC. Predicted transcription alteration; literature
Rossi, 2002 (1146);A. Selected from consecutive CRC referrals: Am2 or familial CRC (including HNPCC-related cancer in family), or sporadic CRC aged <50y or with multiple tumorsA. PCR → Sequencing5/252831220 (3, 56)80 (52, 96)B
BrazilB. NoB. 4/6
Single-centerC. 46; 60C. Unclear
Lee, 2005 (105);A. Selection among referrals to tertiary center: Amsterdam criteria, familial disease, onset <40y or multiple tumorsA. PCR → Sequencing5/46a3423743 (10, 82)95 (83, 99)C
SingaporeB. NoB. 6/1
Single-centerC. 39 (median), 65C. Predicted transcript alteration; literature
Genetic testing only in patients selected after MSI and/or ICH
Pinol, 2005 (52)A. Selection of newly diagnosed CRC from 25 centers.A. CRC selected by MSI/IHC: PCR → Sequencing Ø also MLPA22/1222Assuming no mutations in the absence of MSI-H tumors or tumors with negative immunostaining:B
SpainB. Yes: patients without MSI or with negative immunostaining were not sequencedB. 4/74718119736 (11, 69)99 (98, 99)
Multi-centerC. 70, 60C. Predicted transcript alteration; literature and databases
Raedle, 2001 (1363);A. Consecutive referrals to a tertiary center.A. CRC with MSI: PCR→ Sequencing20/125Among patients with MSI-H tumors:B
GermanyB. Yes: patients without MSI were not tested for mutationsB. 8/4 (1 had mutation in both genes)832973 (39, 94)82 (48, 98)
Multi-centerC. 52, 55C. Predicted transcript alteration; literature
Terdiman, 2001A. Retrospective cohort of patients who had ≥2 CRC in 1st degree family, or age <50 years at CRC diagnosis or multiple tumors in the same patientA. CRC with MSI: ♦PCR→ DGGE → Sequencing of abnormal products19/114Among patients with MSI-H tumors:B
USB. Yes: Only patients with MSI-H were tested for mutationsB. 11/101564771 (47, 89)64 (31, 89)
Single-centerC. ND, NDC. Unclear
Pistorius, 2000 (1590);A. Selection among referrals to tertiary center: Bethesda guidelines metA. CRC with MSI: PCR → Sequencing19/72Among patients with MSI-H tumors:B
Germany & Czech RepublicB. Yes: patients without MSI were not genetically testedB. 6/8 (1 MSH6 mutation also found)12351880 (52, 96)78 (56, 93)
Multi-centerC. ND, NDC. Predicted transcript alteration; literature

Only Pistorious et al. assessed genes other than MLH1 and MSH2, namely the MSH6 gene.

Am2: Amsterdam II criteria; CRC: colorectal cancer; DGGE: Denaturating gradient gel electrophoresis; HD: heteroduplex formation; MLPA: Multiple ligation-dependent probe amplification; MSI(-H): microsatellite instability (high); ND: Not described; NAm2:Number fulfilling Amsterdam II criteria; Ntotal: total number of studied CRC; PCR: polymerase chain reaction; SSCP: Single-stranded conformation polymorphism

Conversion analysis was not used in any study.

♦: Gene screening has been used

Ø: Analysis for large deletions has been used

a

Contains two malignant tumors that are not CRC, which could not be separated (>95% are CRC)

Twelve studies described in 14 publications12, 29, 65, 67, 71, 77, 79, 80, 8487, 97, 98 provided data for determining the sensitivity and specificity of the Amsterdam II criteria for predicting the presence of mismatch repair mutations (Appendix F-10 *). Eight assessed sensitivity and specificity of the Amsterdam II criteria among all available patients,65, 67, 71, 77, 79, 80, 8487 three among patients who had tumors with MSI instability,29, 97, 98 and one among patients whose tumors were selected after MSI or IHC testing.12

Genetic Testing Irrespective of MSI or IHC Status. Eight studies provided data on genetic testing irrespective of MSI or IHC status.65, 67, 71, 77, 79, 80, 8487 The populations evaluated were heterogeneous (Appendix F-10 *). One study84 received grade C for overall quality rating while the rest were rated grade B.65, 67, 71, 77, 79, 80, 8587 All eight studies tested only for mutations in MLH1 and MSH2 genes. Seven studies had more than 40 patients in total in the pertinent 2×2 tables (all except for Rossi 200277). The sampling process was described in all but one study.87

An external file that holds a picture, illustration, etc., usually as some form of binary object. The name of referred object is er-hnpccf13.jpg.

   Figure 13. Sensitivity and specificity of the Amsterdam II criteria for detecting mismatch repair gene mutations

An external file that holds a picture, illustration, etc., usually as some form of binary object. The name of referred object is er-hnpccf14.jpg.

   Figure 14. Sensitivity and specificity of the Amsterdam II criteria for detecting mismatch repair mutations: study subgroups according to various factors

Figure 13 provides an overview of the eight studies while Figure 14 shows the various studies according to the presence or absence of various characteristics that may affect the sensitivity and specificity of the Amsterdam II criteria. Overall, sensitivities varied between 22% and 80% and specificities varied between 61% and 100%. The plot suggests that Amsterdam II criteria are not a good screening test for HNPCC. The seven studies did not follow any particular pattern with respect to the factors addressed in Figure 14. The variability is mostly likely due to the very different CRC populations assessed in these studies.

An external file that holds a picture, illustration, etc., usually as some form of binary object. The name of referred object is er-hnpccf15.jpg.

   Figure 15. Sensitivity and specificity of the Amsterdam II criteria for detecting mismatch repair mutations among patients selected after MSI or IHC testing

Genetic Testing Only Among People Who Have MSI Positive (or IHC Negative) Tumors. Three studies performed genetic testing only among patients who fulfilled the Amsterdam II criteria and had MSI high tumors,29, 97, 98 and one12 among patients selected based on the results of MSI and IHC testing (Figure 15).

Pinol 200512 and Raedle 200129 assessed all available consecutive CRC patients. Terdiman 200198 selected patients who fulfilled the Bethesda guidelines and Pistorius 2000,97 patients in whom there was increased clinical suspicion for HNPCC (at least two 1st degree relatives with CRC or young age at diagnosis or multiple tumors in the same patient). Sensitivities ranged from 36% to 80% and specificities ranged from 64% to 99% (Appendix F-10 *).

Amsterdam II Criteria Among Unselected CRC Cases. As noted above, a question of central importance in this report is the accuracy of predictors in unselected patients with CRC. Only two studies assessed the accuracy of the Amsterdam II criteria in such patients (Pinol 2005,12 and Salovaara 200085) (Appendix F-11 *). The latter study85 performed comprehensive genetic testing in a subset of 66 patients who had tumors with MSI but tested the remaining 469 only for founder mutations in the MLH1 gene common in the Finnish population. The study by Pinol 200512 also performed comprehensive testing in only a subset of patients; however we included it by making an assumption that patients who were not selected for genetic testing based on MSI/IHC results would test negative for mutations.

Two studies that focused on unselected CRC probands (Pinol 2005,12 and Salovaara 200085) provided a summary estimate of 28% (95% CI: 15, 47) for sensitivity and 99% (95% CI: 97, 100) for specificity. However, both studies were limited by verification bias.

An external file that holds a picture, illustration, etc., usually as some form of binary object. The name of referred object is er-hnpccf16.jpg.

   Figure 16. Sensitivity and specificity of the Amsterdam II criteria for detecting mismatch repair mutations among populations with an increasing likelihood for HNPCC

Table F-12

Ability of Amsterdam II criteria to identify MLH1 and MSH2 mutation carriers among selected colorectal cancer probands fulfilling the Revised Bethesda criteria
Study, year (Ref ID);A. Study sample characteristicsA. Genetic testingNAm2/NtotalMutation No mutation Diagnostic performance (95% confidence interval) Quality
CountryB. Verification biasB. MLH1/MSH2Am2 (+)Am2 (-)Am2 (+)Am2 (-)Sensitivity [%]Specificity [%]
Single-/multi-centerC. Mean age (y); Males (%)C. Definition of deleterious mutations
Wolf, 2005 (123)A. Retrospective cohort of cancer patients fulfilling the modified Bethesda criteriaA. PCR → Sequencing35/81136224068 (43, 87)65 (51, 76)B
AustriaB. NoB. 12/7
Single-centerC. ND, 48C. Predicted transcription alteration; literature; comparison with healthy controls

Am2: Amsterdam II criteria; CRC: colorectal cancer; ND: Not described; NAm2:Number fulfilling Amsterdam II criteria; Ntotal: total number of studied CRC; PCR: polymerase chain reaction

Conversion analysis, gene screening or deletion analysis methods were not used.

Table F-13

Ability of Amsterdam II criteria to identify MLH1 and MSH2 mutation carriers among selected colorectal cancer probands fulfilling the Bethesda guidelines
Study, year (Ref ID);A. Study sample characteristicsA. Genetic testingNAm2/NtotalMutation No mutation Diagnostic performance (95% confidence interval) Quality
CountryB. Verification biasB. MLH1/MSH2Am2 (+)Am2 (-)Am2 (+)Am2 (-)Sensitivity [%]Specificity [%]
Single-/multi-centerC. Mean age (y); Males (%)C. Definition of deleterious mutations
Genetic testing irrespectively of MSI test results
De Abajo 2005;A. Selection among referrals to a specialized centerA. PCR → DGGE → sequencing (MSH6 assessed in MLH1/MSH2 negative cases)67/132395283789 (75, 96)57 (44, 69)B
SpainB. NoB. 24/17 (and 3 MSH6)
Single-centerC. ND; NDC. Predicted non-conservative transcription alteration; literature; comparison with healthy controls
Syngal, 2000 (1672) & Wahlberg, 2002 (1158);A. Selection among referrals to specialized centerA. PCR → Sequencing34/70144203278 (52, 74)64, (49, 77)B
USB. NoB. 18 (MLH1 and MSH2)
Single-centerC. ND; NDC. Predicted transcription alteration; literature
Genetic testing only in patients selected after MSI
Pistorius, 2000 (1590);A. Selection among referrals to tertiary center: Bethesda guidelines metA. CRC with MSI: PCR → Sequencing19/72Among patients with MSI-H tumors:B
Germany & Czech RepublicB. Yes: patients without MSI were not genetically testedB. 6/8 (1 MSH6 mutation also found)12351880 (52, 96)78 (56, 93)
Multi-centerC. ND, NDC. Predicted transcript alteration; literature

Only Pistorious et al. assessed genes other than MLH1 and MSH2, namely the MSH6 gene

Am2: Amsterdam II criteria; CRC: colorectal cancer; MSI(-H): microsatellite instability (high); ND: Not described; NAm2:Number fulfilling Amsterdam II criteria; Ntotal: total number of studied CRC; PCR: polymerase chain reaction

Conversion analysis, deletion analysis or gene screening were not used in these two studies.

Amsterdam II Criteria Among Different Populations. Figure 16 depicts sensitivity and specificity of the Amsterdam II criteria for identifying MMR mutations, among populations at variable risk for HNPCC. The studies are described in Appendices F-11, F-12 and F-13 *. Studies focusing on populations at increasing risk appear to be associated with better sensitivity and worse specificity, similar to the findings described above for the Amsterdam I criteria.

Modified Amsterdam Criteria

Table F-14

Ability of modified Amsterdam criteria to identify MLH1 and MSH2 mutation carriers among selected colorectal cancer probands
Study, year (Ref ID);A. Comments on sample characteristicsA. Genetic testingNAmMod/NtotalMutation No mutation Diagnostic performance (95% confidence interval) Quality
CountryB. Verification biasB. MLH1/MSH2Am Mod (+)Am Mod (-)Am Mod (+)Am Mod (-)Sensitivity [%]Specificity [%]
Single-/multi-centerC. Mean age (y); Males (%)C. Definition of of deleterious mutations
Wolf, 2005 (123)A. Selection from a retrospective cohort of cancer patients fulfilling the modified Bethesda criteria aA. PCR→ A Sequencing52/81163362682 (60, 97)42 (30, 55)B
AustriaB. NoB. 12/7
Single-centerC. ND, 48D. Predicted transcription alteration; literature; comparison with healthy controls
Syngal, 2000 (1672) & Wahlberg, 2002 (1158);A. Selection among referrals to specialized centerA. PCR → Sequencing39/70135262672 (47, 90)50 (36, 64)B
USB. NoB. 18 (MLH1 and MSH2)
Single-centerC. ND; NDC. Predicted transcription alteration; literature

AmMod: modified Amsterdam criteria; CRC: colorectal cancer; ND: Not described; NAmMod:Number fulfilling Amsterdam criteria; Ntotal: total number of studied CRC; PCR: Polymerase chain reaction.

None of the studies used deletion analysis, conversion analysis or gene screening methods to detect mutations. No other genes apart from MLH1 and MSH2 were assessed.

a

May include some patients without CRC.

The modified Amsterdam criteria are fulfilled when CRC has appeared in more than one generation, there are at least two CRC in 1st degree family, and at least one CRC diagnosed at age younger than 55 years; or when there are at least two 1st degree relatives affected by CRC plus another relative with an unusually early onset neoplasm or endometrial cancer. Two studies (described in three papers79, 80, 86) provided data on the modified Amsterdam criteria (Appendix F-14 *). Both studies received grade B for their overall quality. Neither assessed mutations in genes other than MLH1 or MSH2. The studies differed in their inclusion criteria and neither included unselected patients. Despite these differences, the estimates of sensitivity and specificity were similar. Overall, the summary sensitivity was 78% (95% CI: 61, 89%) and the summary specificity was 46% (95% CI: 37, 55%). It is likely that the sensitivity of the modified Amsterdam criteria in an unselected CRC population would be lower.

Bethesda Guidelines

Five studies described in six papers assessed the sensitivity and specificity of the Bethesda guidelines to detect MMR mutations: Syngal 2000,79, 80 Wolf 2005,86 de Abajo 2005,67 Raedle 2001,29 and Pinol 2005.12 Three studies performed genetic testing irrespective of tumor MSI status67, 79, 80, 86 while the other two performed genetic testing only among patients who were selected based on MSI testing29 or MSI and IHC testing.12 All four studies were rated grade B for the overall quality. All studies examined only the MLH1 and MSH2 genes. Only Syngal 2000 and Wolf 2005 performed sequencing to all available samples.

An external file that holds a picture, illustration, etc., usually as some form of binary object. The name of referred object is er-hnpccf17.jpg.

   Figure 17. Sensitivity and specificity of the Bethesda guidelines for detecting mismatch repair gene mutations: all available studies

Only the study by Pinol 200512 assessed incident, newly diagnosed CRC cases. We included it by making an assumption that patients who were not selected for genetic testing based on MSI/IHC results would test negative for mutations. Figure 17 depicts the sensitivity and specificity of the five studies.

Table F-15

Ability of Bethesda guidelines to identify MLH1 and MSH2 mutation carriers
Study, year (Ref ID);A. Comments on sampling characteristicsA. Genetic testingNBeth/NtotalMutation No mutation Diagnostic performance (95% confidence interval) Quality
CountryB. Verification biasB. MLH1/MSH2Beth (+)Beth (-)Beth (+)Beth (-)Sensitivity [%]Specificity [%]
Single-/multi-centerC. Mean age (y); Males (%)C. Definition of deleterious mutations
Genetic Testing irrespectively of MSI/IHC results
De Abajo 2005;A. Selection among referrals to a specialized centerA. PCR → DGGE → sequencing (MSH6 assessed in MLH1/MSH2 negative cases)67/1324406028100 (92, 100)32 (22, 43)B
SpainB. NoB. 24/17 (and 3 MSH6)
Single-centerC. ND; NDC. Predicted non-conservative transcription alteration; literature; comparison with healthy controls
Wolf, 2005 (123)A. Retrospective cohort of cancer patients fulfilling the modified Bethesda criteriaA. PCR → Sequencing72/81190539100 (82, 100)15 (7, 26)B
AustriaB. NoB. 12/7
Single-centerC. ND, 48C. Predicted transcription alteration; literature; comparison with healthy controls
Syngal, 2000 (1672) & Wahlberg, 2002 1158);A. Selection among referrals to specialized centerA. PCR → Sequencing56/70171391394 (73, 100)25 (14, 39)B
USB. NoB. 18 (MLH1 and MSH2)
Single-centerC. ND; NDC. Predicted transcription alteration; literature
Genetic testing only in patients selected after MSI and/or ICH
Pinol, 2005 (52)A. Selection of newly diagnosed CRC from 25 centers.A. CRC selected by MSI/IHC: PCR → Sequencing Ø also MLPA224/1222Assuming no mutations in the absence of MSI-H tumors or tumors with negative immunostaining:B
SpainB. Yes: patients without MSI or with negative immunostaining were not sequencedB. 4/78321699573 (39, 94)82 (80, 84)
Multi-centerC. 70, 60C. Predicted transcript alteration; literature and databases
Raedle, 2001 (1363)A. Consecutive referrals to a tertiary center.A. CRC with MSI: PCR →Sequencing58/125Among patients with MSI-H tumors:B
GermanyB. Yes: patients without MSI were not tested for mutationsB. 8/4 (1 had mutation in both genes)11065100 (72, 100)45 (17, 77)
Multi-centerC. 52, 55C. Predicted transcript alteration; literature

Beth: Bethesda guidelines; CRC: colorectal cancer; IHC: immunohistochemistry; MLPA: Multiple ligation-dependent probe amplification; MSI: microsatellite instability; ND: Not described; Ntotal: total number of studied CRC; PCR: Polymerase chain reaction

Ø: Deletion analysis (detection of large genomic deletions) was used

No study used gene screening methods or conversion analysis. All studies assessed only MLH1 and MSH2 genes.

Based on the study by Pinol 2005,12 the Bethesda guidelines had a sensitivity of 73% (95% CI: 39, 94%) and a specificity of 82% (95% CI: 80, 84%) for detecting MMR mutations among unselected patients with CRC (Appendix F-15 *). However, these are probably overestimates because of verification bias.

Among a referral population (or otherwise selected CRC populations) the Bethesda guidelines appeared to have high sensitivity (over 90%) but low specificity (below 50%) in all three studies (including the study by Raedle 200129 that focused on patients whose tumors exhibited MSI-H) (Appendix F-15 *).

Revised Bethesda Guidelines

Only one study (Pinol 200512) provided data on the sensitivity and specificity of the revised Bethesda guidelines in a unselected population of patients with CRC (Appendix F-17 *). The sensitivity and specificity of the clinical criteria were calculated to be 91% (95% CI: 59, 100%) and 77% (95% CI: 75, 79%), respectively. Thus, the revised Bethesda guidelines were more sensitive and as specific as the original Bethesda guidelines (Appendices F-16 and F-17 *). However, these may be overestimates because of the possibility of verification bias as discussed above.

Young Age of Onset

Table F-18

Ability of Ability of young age at diagnosis (early disease onset) to identify MLH1 and MSH2 mutation carriers among colorectal cancer probands
Study, year (Ref ID);A. Definition of early onsetA. Genetic testingNtotalMutation No mutation Diagnostic performance (95% confidence interval) Quality
CountryB. Study sample characteristicsB. MLH1/MSH2Early onsetNo early onsetEarly onsetNo early onsetSensitivity [%]Specificity [%]
Single-/multi-centerC. Verification biasC. Definition of deleterious mutations
D. Mean age (y); Males (%)
Genetic testing irrespectively of tumor microsatellite instability status
Salovaara, 2000 (1740)A. <50 yA. PCR → Sequencing Ø PCR for founder mutations in MLH1 gene5355134047728 (10, 53)92 (90, 94)B
FinlandB. Selection of all new unrelated CRC from 9 hospitals between 03/1996 and 06/1998B. 17/1
Multi-centerC. Yes: patients without MSI were screened only for MLH1 founder mutationsC. Literature; comparison with non-cancer controls
D. 67, ND
Aaltonen, 1998 (2282)A. <50 yA. Ø All CRC: PCR for founder mutations 1 & 2 in MLH1 ♦ CRC with MSI: (some) PCR → DGGE → Sequencing(Remaining) PCR → Sequencing509461248767 (22, 96)98 (96, 99)B
FinlandB. Selection of all new unrelated CRC from 9 hospitals between 05/1994 and 04/1996B. 9/1
Multi-centerC. Yes: patients without MSI were screened only for MLH1 founder mutationsC. Literature; comparison with healthy controls
D. ND, ND
Colombino, 2005 (1058);A. <45 yA. ♦ PCR→ DHPLC→ Sequencing of abnormal patterns362a61058238 (15, 65)94 (87, 98)C
ItalyB. Consecutive CRC cases enrolled over 3 years in a tertiary centerbB. 11/10
Single-centerC. Yes: Patients without family history of cancer were screened only for the mutations identified in the familial casesC. Compared to 103 people without cancer
D. 62; 49
Genetic testing only in patients selected after MSI and/or ICH
Pinol, 2005 (52)A. <50 yA. CRC selected by MSI/IHC: PCR → Sequencing also MLPA Ø also MLPA1222Assuming no mutations in the absence of MSI-H tumors or tumors with negative immunostaining:B
SpainB. Selection of newly diagnosed CRC from 25 centers.B. 4/73855115627 (6, 61)95 (94, 97)
Multi-centerC. Yes: patients without MSI or with negative immunostaining were not sequencedC. Predicted transcript alteration; literature and databases
D. 70, 60
Samowitz 2001, (34);A. <55yA. CRC selected by MSI:bPCR → Sequencing Ø Also PCR for founder mutations in the MLH1 gene1066Assuming no mutations in the absence of MSI-H tumors:B
USB. Selection among incident CRCB. 5/3c4315486357 (18,90)85 (83,87)
MulticenterC. Yes: patients without suggestive MSI results were not sequencedC. Predicted transcript alteration; literature
D. ND, ND

Studies are ordered by quality and then by decreasing number of patients available for the calculation of sensitivity and specificity (2 by 2 tables). None of the studies used conversion analysis to detect mismatch repair gene mutations.

Am1/2: Amsterdam I criteria/II; CRC: colorectal cancer; DGGE: Denaturing gradient gel electrophoresis; DHPLC: denaturating high performance liquid chromatography; MLPA: Multiple ligation-dependent probe amplification; MSI: microsatellite instability; ND: Not described; Ntotal: total number of studied CRC; PCR: polymerase chain reaction

♦: Gene screening method

Ø: Detection of large genomic deletions

a

Not clear if all CRC probands belong to unrelated families; only data on 103 familial cases are analyzed here, since the pertinent information was lacking for sporadic cases.

b

130 out of 171 of people with tumors with MSI instability could be genetically tested.

c

One patient had mutations both in the MLH1 and in the MSH2 gene

Appendix F-18 summarizes five studies that assessed young age of onset as a clinical predictor to identify mismatch repair gene mutations (Salovaara 2000,85 Aaltonen 1998,63 Colombino 2005,83 Samowitz 2001,10 and Pinol 200512) (Appendix F-18 *). Young age of onset was defined as less 50 years in all studies, with the exception of Samowitz 2001,10 where the definition was less than 55 years. Colombino 200583 provided data only in patients with familial CRC (Appendix F-18 *). All studies suffered from verification bias because genetic testing was not thorough63, 85 or was not performed at all10, 12 among patients without MSI (MSI or IHC for Pinol 200512).

Among the three studies of unselected patients with CRC (Appendix F-19) that defined young age of onset as less than 50 years old, a summary estimate of sensitivity was 31% (95% CI: 18, 47%) and specificity was 95% (95% CI: 94, 96). Only the specificity estimate was heterogeneous (p<0.01, I2=81%) (Appendix F-18 and F-19 *). These estimates might be inflated because of verification bias. Sensitivity and specificity were similar in the studies by Colombino 200583 and Samowitz 200110 (Appendix F-19 *).

Familial Cancer History

Table F-20

Ability of familial history of malignancy to identify MLH1 and MSH2 mutation carriers among colorectal cancer probands
Study, year (Ref ID)A. Definition of familial history of cancerA. Genetic testingNtotalMutation No mutation Diagnostic performance (95% confidence interval) Quality
CountryB. Definition of sporadic cancerB. MLH1/MSH2Familial Cancer HxSporadic CanceFamilial Cancer HxSporadic CancerSensitivity [%]Specificity [%]
Single-/multi-centerC. Comments on sample characteristicsC. Definition of deleterious mutations
D. Verification bias
E. Mean age (y); Males (%)
Genetic testing irrespectively of tumor microsatellite instability status
Salovaara, 2000 (1740);A. 1st degree relative with CRC or endometrial cancerA. PCR → Sequencing Ø PCR for founder mutations in MLH1 gene5351536245583 (59, 96)88 (85, 91)B
FinlandB. All other CRCB. 17/1
Multi-centerC. Selection of all new unrelated CRC from 9 hospitals between 03/1996 and 06/1998C. Literature; comparison with non-cancer controls
D. Yes: patients without MSI were screened only for MLH1 founder mutations
E. 67, ND
Aaltonen, 1998 (2282);A. 1st degree relative with CRC or endometrial cancerA. Ø All CRC: PCR for founder mutations 1 & 2 in MLH1 ♦ CRC with MSI: (some) PCR → DGGE → Sequencing (Remaining) PCR → Sequencing509917142890 (55, 100)86 (82, 89)B
FinlandB. All other CRCB. 9/1
Multi-centerC. Selection of all new unrelated CRC from 9 hospitals between 05/1994 and 04/1996C. Literature; comparison with healthy controls
D. Yes: patients without MSI were screened only for MLH1 founder mutations
E. ND, ND
Zhu, 2005 (138);A. CRC with cancer in familyA. Ø MLPA → Sequencing of detected aberrations7872383178 (40, 97)45 (33, 57)B
ChinaB. Apparently sporadic CRC consisting of two subgroups (<50y or ≥50y at diagnosis)B. 4/5
Single centerC. Study subgroups assembled without a clear selection processC. Unclear
D. No
E. ND, ND
Wang, 1999 (1939);A. CRC from families fulfilling Am1 criteria, or from families with 1 or 2 Amsterdam criteria missing, or families with aggregation of HNPCCC-related tumorsA. Ø RT-PCR→ IVSP; ♦ PCR→HD→Sequencing; in vivo MLH1 protein expression752603712100 (87, 100)24 (13, 39)B
FranceB. CRC with no family Hx aged <50y at diagnosisB. 19/7
Single-centerC. Sample assembled from referrals to a genetic consultation centerC. Predicted transcription alteration; literature
D. No
E. ND, ND
Yuan 1998 (2229);A. CRC fulfilling the Korean HNPCC criteriaA. ♦ PCR→ SSCP → Sequencing of abnormal Products7671244488 (47, 100)65 (52, 76)C
KoreaB. CRC without family Hx of colorectal cancer aged <40y at diagnosisB. 2/1
Single-centerC. Sample assembled with unclear selection processC. Predicted non-conservative transcription alteration; literature; comparison with non-cancer controls
D. No
E. Familial: 50, 65; sporadic: 39, 49
Moslein 1996 (2545);A. CRC fulfilling Am1; and CRC with “familial Hx of CRC”A. PCR→sequencing46a11118692 (62, 100)25 (10, 47)C
US & GermanyB. CRC without a family Hx of CRCB. 7/6
Multi-centerC. Sample assembled with unclear selection processC. Predicted non-conservative transcription alteration; literature
D. No
E. 51, ND
Lee, 2005 (105)A. CRC fulfilling Amsterdam II criteria; with 3 CRC in 1st degree family; and with 2 CRC in 1st or 2nd degree familyA. PCR → Sequencing46b61211786 (42, 100)45 (29, 62)C
SingaporeB. CRC with no familial Hx and age <40y or with multiple HNPCC-related cancersB. 6/1
Single-centerC. Sample selected from referrals to a tertiary centerC. Predicted transcript alteration; literature
D. No
E. 39 (median); 65
Genetic testing only in patients selected after MSI and/or ICH
Pinol, 2005 (52);A. 1st degree relative with CRC of endometrial cancerA. CRC selected by MSI/IHC: PCR → Sequencing Ø also MLPA1222Assuming no mutations in the absence of MSI-H tumors or tumors with negative immunostainingB
SpainB. All other CRCB. 4/765151106055 (23, 83)88 (86, 89)
Multi-centerC. Selection of newly diagnosed CRC from 25 centers.C. Predicted transcript alteration; literature and databases
D. Yes: patients without MSI or with negative immunostaining were not sequenced
E. 70, 60
Samowitz 2001, (34);A. Family history of CRCA. CRC selected by MSI:cPCR → Sequencing Ø Also PCR for founder mutations in the MLH1 Gene1066Assuming no mutations in the absence of MSI-H tumors:B
USB. All other patientsB. 5/3d4314787057 (18, 90)86 (83, 88)
MulticenterC. Selection among incident CRCC. Predicted transcript alteration; literature
D. Yes: patients without suggestive MSI results were not sequenced
E. ND, ND

Studies are ordered by quality and then by decreasing number of patients available for the calculation of sensitivity and specificity (2 by 2 tables). None of the studies used conversion analysis to detect mismatch repair gene mutations.

Am1: Amsterdam I criteria; CRC: colorectal cancer; DGGE: Denaturing gradient gel electrophoresis; HD: heteroduplex formation; Hx: History; IHC: immunohistochemistry; IVSP: in vitro synthesized protein assay; MSI: microsatellite instability; ND: Not described; Ntotal: total number of studied CRC; PCR: polymerase chain reaction; SSCP: Single-stranded conformation polymorphism

♦: Gene screening method

Ø: Detection of large genomic deletions

a

Interestingly, only 26/46 patients were described to have had CRC in an analytic petioent-level description, and only these are analyzed

b

Contains 2 HNPCC-related non-CRC tumors that could not be separated (>95% of tumors in these data are CRC)

c

130 out of 171 of people with tumors with MSI instability could be genetically tested.

d

One patient had mutations both in the MLH1 and in the MSH2 gene

Nine studies provided data eligible for this analysis10, 12, 63, 75, 81, 84, 85, 87, 99 (Appendix F-20 *). Six studies were rated with grade B in the overall quality scale,10, 12, 63, 81, 85, 87 and the remaining three studies were rated with grade C. Only one study had fewer than 40 patients in total in the 2×2 tables.75

There was variability in the populations that were examined and the definition of familial disease. A familial history of cancer was defined as presence of colorectal cancer or endometrial cancer in a first-degree family member of the proband in three prospective studies that assessed consecutive unselected CRC cases.12, 63, 85 Another study on incident CRC (Samowitz 200110) defined familial cancer as CRC in a first degree family. In these studies, all other CRC cases were used as a comparator.

In the remaining studies, familial cases were highly selected, based on sets of clinical criteria such as the Amsterdam I or II criteria, the Korean HNPCC criteria, the aggregation of HNPCC related tumors in a family, or combinations thereof. Similarly, in these studies the comparator (“sporadic CRC cases”) was defined variably (Appendix F-20 *), and was most often a group of “apparently sporadic” CRC that were selected based on their young age of onset or a diagnosis of multiple tumors.

An external file that holds a picture, illustration, etc., usually as some form of binary object. The name of referred object is er-hnpccf18.jpg.

   Figure 18. Sensitivity and specificity of familial cancer history for detecting mismatch repair gene mutations: all available studies

Figure 18 depicts all studies according to whether they assessed unselected CRC cases.

Four studies reported estimates in unselected, consecutive patients with CRC.10, 12, 63, 83 Three used identical definitions (CRC or endometrial cancer in first degree family),12, 63, 83 and one defined familial cancer as CRC in a first degree family member10 (Appendix F-21 *).

A summary estimate of sensitivity based on the four studies that used similar definitions was 76% (95% CI: 50, 91%) with borderline between-study heterogeneity (p=0.13, I2=50%); the summary estimate of specificity was 87% (95% CI: 86, 89%) (without between-study heterogeneity: p=0.51, I2=0%). The estimates were similar when Samowitz 200110 was included in the calculations, despite the different definition of familial cases. The other studies assessed substantially different populations to allow for a meaningful synthesis (Appendix F-20 *). However, they uniformly suggested high sensitivities (above 75%) and variable, but generally low, specificities (ranging from 24% to 65%).

Multiple CRC or Endometrial Cancer in the Same Patient

Appendix F-22 * summarizes three studies that included unselected CRC and assessed the sensitivity and specificity of multiple, synchronous or metachronous CRC or endometrial cancer in the same proband to predict MMR mutations (Salovaara 2000,85 Aaltonen 1998,63 and Pinol 200512). Their characteristics and limitations have already been discussed. The respective summary estimates of sensitivity and specificity were 38% (95% CI: 25, 54%) with no evidence for between-study heterogeneity (p=0.98, I2=0%) and 97% (95% CI: 91, 99%) with significant between-study heterogeneity (p<0.01, I2=94%).

Familial History of Cancer, Age of Onset Less Than 50 Years, or Multiple Cancers in the Same Proband

Appendix F-23 * summarizes three studies that enrolled unselected CRC (Salovaara 2000,85 Aaltonen 1998,63 and Pinol 200512). The sensitivity and specificity of the presence of either of the following three simple clinical criteria was assessed: history of colorectal or endometrial cancer in first degree family, CRC onset at less than 50 years of age, or multiple tumors in the same proband versus all other cases. Their characteristics and limitations have already been discussed. Summary estimates of sensitivity and specificity were 88% (95% CI: 60, 97%) with little evidence for between-study heterogeneity (p=0.19, I2=39%) and 77% (95% CI: 74, 81%) with significant between-study heterogeneity (p=0.03, I2=73%), respectively.

MSI

The presence of MSI is a marker for replication errors and thus a predictor of MMR mutations. We assessed the sensitivity and specificity of MSI-H versus MSS. We also analyzed combined MSI-H and MSI-L versus MSS

Studies were considered eligible if they performed both MSI testing and MMR genetic testing in CRC patients and each test was applied irrespective of the results of the other test.

In these analyses we assumed that any genetic testing was the reference standard.

Overview of MSI Testing. Overall, MSI testing appeared to have modest to good discriminating ability to identify carriers of MLH1 and MSH2 mutations. The sensitivity of MSI-H versus MSS ranged between 56% and 100% and the specificity between 17% and 93%.

Table F-24

Ability of microsatellite instability to identify MLH1 and MSH2 mutation carriers among colorectal cancer probands
Study, year (Ref ID);A. Comments on sample characteristicsNtotalMutation No mutation Diagnostic performance (95% confidence interval) Micro-dissectionNCI 5 marker setQuality
CountryB. Verification biasMSIMSSMSIMSSSensitivity [%]Specificity [%]
Single-/multi-centerC. Mean age (y); Males (%)
D. Definition of MSI
Barnetson, 2006 (NA)A. Selection of all incident CRC aged <55 y at diagnosis between 02/1999 and 07/2003870a20102429867 (47, 83)93 (89, 95)A
ScotlandB. No
Multi-centerC. 48; 53
D. ≥2 out of ≥5 markers (MSI-H)
≥1 out of ≥5 markers (MSI-H&L)2825027293 (78, 99)84 (80, 88)
Salovaara, 2000 (1740)A. Selection of all new unrelated CRC from 9 hospitals between 03/1996 and 06/199853518048469100 (81, 100)91 (88, 93)XXB
FinlandB. Yes: patients without MSI were screened only for MLH1 founder mutations
Multi-centerC. 67, ND
D. MSI based on BAT26 only
Aaltonen, 1998 (2282)A. Selection of all new unrelated CRC from 9 hospitals between 05/1994 and 04/199650910053446100 (69, 100)89 (86, 92)XXB
FinlandB. Yes: patients without MSI were screened only for MLH1 founder mutations
Multi-centerC. ND, ND
D. ≥30% of 16 markers for tumor analyzed with fluorescence methods or ≥2 out of 7 (≈30%) markers analyzed with radioactive technique (MSI-H)
Southey, 2005 (66);A. Randomly selected from a prospective cohort of all CRC with age of onset <45 y; only patients who received genetic testing are presentedb10513b5b43672 (47, 90)90 (76, 97)B
AustraliaB. No
Single-centerC. <45y; ND
D. >5 out of 10 markers (MSI-H)
>1 out of 10 markers (MSIH&L)17b1b166094 (73, 100)79 (68, 87)
Wolf, 2005 (123);A. Selection from a retrospective cohort of cancer patients fulfilling the modified Bethesda criteria81130933100 (75, 100)79 (63, 90)XB
AustriaB. No
Single-centerC. ND, 48
D. ≥30% out of up to 10 markers (MSI-H)
Syngal, 2000 (1672) & Wahlberg, 2002 (1158);A. Selection among referrals to specialized centerc70c1401420100 (77, 100)59 (41, 75)B
USB. No
Single-centerC. ND; ND
D. ≥2 out of ≥5 markers (MSI-H)
Farrington, 1998 (2205);A. Retrospective cohort of CRC aged <30 y at diagnosis who were still alive (since 1970)5012271986 (57, 98)73 (52, 88)B
ScotlandB. No
Single-centerC. <30y, ND
D. ≥2 out of 7 markers (MSI-H)
Katballe, 2002 (1310) & Christensen, 2002 (1038);A. Familial CRC selected from a population of 1514 newly diagnosed CRC: patients fulfilling Amsterdam II criteria (in extended families and relaxing the age criterion to <55y) and familial CRC with early age of onset45100320100 (69, 100)87 (66, 97)XB
DenmarkB. No
Single-centerC. ND; ND
D. ≥2 out of ≥5 markers (MSI-H)
≥1 out of ≥5 markers (MSI-H&L)100520100 (69, 100)80 (59, 93)
Dieumegard, 2000 (1791);A. Sample assembled with unclear selection process: we present analyses only among familial CRC who were at most 1 criterion short of fulfilling Am1 (n=17); study also included 17 apparently sporadic CRC aged <50y at diagnosis.34d9069100 (66, 100)60 (32, 84)XXB
FranceB. Yes: not all sporadic CRC underwent MMR mutation testing (these are not included in this analysis)
Multi-centerC. Oldest at diagnosis was 56, ND
D. ≥10% of up to 23 markers (But all were ≥30%) (MSI-H)
≥10% of up to 23 markers (MSI-H&L)9069100 (66, 100)60 (32, 84)
Curia, 1999 (1959);A. Sampled from pathology registries, unclear selection criteria: HNPCC related cancerse30e10153100 (0, 100)17 (4, 41)XB
ItalyB. No
Single-centerC. <50y, ND
D. ≥2 markers out of 3 markers or up to a total of 7 markers (MSI-H)
Debniak,, 2000 (1784);A. Sampled from consecutive CRC, selection process not transparent. All patient with available data are included.1685185483 (36, 100)87 (76, 94)C
PolandB. Yes: Only 43/143 apparently sporadic CRC were tested, but it is unclear how they were selected
Single-center(?)C. ND, ND
D. ≥2 out of ≥5 markers or ≥3 out of ≥10 markers (MSI-H)
Lee, 2005 (105);A. Selection among referrals to tertiary center: Amsterdam criteria, familial disease, onset <40y or multiple tumors46f4172180 (28, 99)75 (55, 89)C
SingaporeB. No
Single-centerC. 39 (median); 65
D. ≥2 out of ≥5 markers (MSI-H)
≥1 out of ≥5 markers (MSI-H&L)4192180 (28, 99)70 (51, 85)
Moslein 1996 (2545)A. Sample assembled from various databases; we present analyses only among familial cases (39/46), and only those described to have CRC. Study also included 7 sporadic CRC.g46g544856 (21, 86)67 (35, 90)XXC
US & GermanyB. No
Multi-centerC. 51, ND
D. ≥30% of 9 to 34 markers analyzed (unclear which exactly) (MSI-H)
Callistri, 2000 (1797);A. Study sample assembled with unclear selection process: Familial CRC fulfilling Am1 criteria or missing up to 2/3 Am1 criteria, or a CRC among 1st degree family or CRC diagnosis at age <50y, or multiple tumors in the same patient40h7054100 (59, 100)44 (14, 79)C
ItalyB. No
Multi-centerC. ND; 56 (all sample)
D. ≥2 out of ≥5 markers (MSI-H)
Durno, 2005 (195);A. Retrospective cohort of CRC aged <24 y at diagnosis who were still alive (since 1960)165031100 (48, 100)25 (0, 81)C
CanadaC. <24y, 38
Multi-centerB. No
D. ≥2 out of ≥5 markers, or (MSI-H) ≥40% out of up to 10 markers (MSI-H)
Peel, 1999 (1660);A. Referral HNPCC cases, other than the 1134 CRC probands who were also included but were not assessed with laboratory tests113015100 (29, 100)83 (36, 100)XC
USB. No
Multi-centerC. ND; ND
D. Unclear; at least 5 markers were used (MSIH?)

Note that studies that assessed genetic mutations only in patients with MSI cannot be used to construct 2 by 2 tables for the ability of MSI testing to detect MMR mutations. Thus such studies are not included in this table. Not included in the table are data from Lamberti 1999, where only the contrast of MSI-H versus combined MSI-L and MSI-S was extractable.

CRC: colorectal cancer; MSI(-H/-L): microsatellite instability (-high/-low); MSS: microsatellite-stable (no instability); NA: Not applicable; ND: Not described; Ntotal: total number of studied CRC

a

Overall, 359 patients had available tumor tissue of good quality. Study assessed for mutations in the MSH6 gene also.

b

This study assessed MSH6 and hPSM2 also. The mutation counts include pathogenic mutations in these genes also.

c

Data from the Wahlberg et al. publication

d

Only 7/17 apparently sporadic CRC were genetically tested (unclear how they were selected).

e

Four were not CRC and were excluded from the calculations; numbers among patients with available tumors; only pathogenic mutations are shown.

f

Included are 2 malignant tumors other than CRC that could not be separated.

g

Interestingly, despite the fact that all were characterized as CRC, in an analytic description not all were described with CRC. Only familial cases that were described with CRC are included.

h

Data out of 20 CRC (of 45 total studied patients) who missed at most 2 out of 3 Amsterdam I criteria are analyzed here, because MMR gene mutations were tested inconsistently among the remaining patients.

MSI-H Versus MSS. Sixteen studies described in 18 publications11, 6366, 6971, 75, 79, 80, 8486, 95, 100102 were eligible. One received grade A in the overall quality rating,11 nine received grade B,63, 65, 66, 70, 71, 79, 80, 85, 86, 101, 102 and six received grade C (Appendix F-24 *).

An external file that holds a picture, illustration, etc., usually as some form of binary object. The name of referred object is er-hnpccf19.jpg.

   Figure 19. Sensitivity and specificity of MSI-H to identify mismatch repair gene mutations

Eight studies performed sequencing on all available samples11, 69, 75, 80, 84, 86, 95, 101 and one of them (Barnetson 200611) also used specific methods to detect large genomic deletions or rearrangements. All studies tested for MLH1 and MSH2 gene mutations. One study also assessed the presence of MSH6 mutations (Barnetson 200611) and another tested for MSH6 and PMS2 mutations (Southey 2005102). It was not possible to examine the changes in the sensitivity and specificity of MSI with and without the non-MLH1/non-MSH2 mutations in these studies. Seven out of 16 had information in the 2×2 tables on at least 40 patients (Figure 19, Appendix F-24 *).

Two studies analyzed all available incident CRC cases (Aaltonen 199863 and Salovaara 200085), but had substantial verification bias since individuals who were negative in the MSI testing were assessed only for the presence of founder mutations in the MLH1 gene. Two other prospective studies analyzed incident CRC patients (Barnetson 2006,11 Southey 2005102) who were diagnosed at young age (<55 and <45 years, respectively).

The sample selection process was based on clearly stated selection criteria that were applied to all available patients in ten studies; in five of them, cases were selected among incident CRC patients (Aaltonen 199863, Salovaara 200085, Katballe 200265, 71, Southey 2005102 and Barnetson 200611). Twelve studies used microdissection to help assure that the analyzed tumor tissue contained a high proportion of malignant cells,11, 6466, 69, 71, 79, 80, 84, 86, 95, 100102 and eight used the marker sets proposed by the NCI.11, 64, 69, 79, 80, 84, 100102

Overall, the sensitivity of MSI ranged between 56% and 100% and the specificity between 17% and 93%. Two small studies found a specificity of only 25% (Durno 2005100 among only four patients without a mutation) and 17% (Curia 199966 among 18 patients without a mutation). Notably, the study by Curia 199966 found few pathogenic mismatch repair gene mutations among CRC cases with HNPCC-related cancers (3/30=10%) and thus its applicability is unclear.

An external file that holds a picture, illustration, etc., usually as some form of binary object. The name of referred object is er-hnpccf20.jpg.

   Figure 20. Sensitivity and specificity of MSI-H to identify mismatch repair gene mutations based upon study characteristic

We could not explain the heterogeneity among estimates based on the overall study quality, the comprehensiveness of the genetic testing, the presence of microdissection, the use of NCI-recommended marker sets, or whether the study used a transparent sample selection process (Figure 20). Larger studies (with at least 40 patients in the 2×2 tables) tended to cluster more around the upper left corner of the plot (Figure 19) than studies that used deletion analysis to test for MMR mutations (all four of which had more than 40 patients in the 2×2 tables) (Figure 20).

Among studies with more than 40 patients in the 2×2 tables, a summary estimate of sensitivity was 83% (95% CI: 65, 92%), with little evidence for between study heterogeneity (p=0.15, I2=37%). A summary estimate of specificity was 87% (95% CI: 80, 91%) with high between-study heterogeneity (p<0.01, I2=83%). The estimates were similar after the exclusion of the two Finnish studies (Salovaara 200085 and Aaltonen 199863) in which genetic testing was less rigorous for patients without MSI-H tumors. The latter studies also included the Finnish founder mutations in their analyses; these mutations are not found in populations of non-Finnish origin.

An external file that holds a picture, illustration, etc., usually as some form of binary object. The name of referred object is er-hnpccf21.jpg.

   Figure 21. Summary ROC curve for the diagnostic ability of MSI-H and MSI-L to identify mismatch repair gene mutations

A summary ROC analysis is shown in Figure 21.

Combined MSI-H and MSI-L Versus MSS. There were seven studies in which allowed the comparison of combined MSI-H and MSI-L versus MSS. These were described in eight publications.11, 63, 65, 70, 71, 84, 85, 102

The summary estimate for sensitivity was 94% (95% CI: 86, 97) (no heterogeneity: p=0.85, I2=0%) and for specificity was 83% (95% CI: 77 to 88%) (with substantial heterogeneity: p<0.01, I2=80%). When analyses were limited to the four studies that had at least 40 patients in the 2×2 tables,11, 63, 85, 102 the corresponding results were 87% (95% CI: 82, 91%) and 95% (95% CI: 86, 98%); both estimates had substantial between-study heterogeneity.

What is the role of MSI-L in the detection of MMR mutations? We evaluated the sensitivity and specificity in the seven studies excluding the MSI-L tumors. 11, 63, 65, 70, 71, 84, 85, 102 The summary sensitivity became smaller (80% [95% CI: 63, 90%]) and the summary specificity increased (88% [95% CI: 83, 91%]). The summary sensitivity estimate was not heterogeneous (p=0.21, I2=28%) but the summary specificity estimate was heterogeneous (p<0.01, I2=71%).

MSI-H and Combined MSI-H and MSI-L Versus MSS Among Unselected CRC Probands. There were only two relevant studies, both from Finland (Salovaara 200085 and Aaltonen 199863 (Appendix F-25 *). MSI was assessed based upon the BAT26 marker set in the former, and on at least 30% of at least seven markers being unstable in the latter. Patients without MSI tumors were screened only for founder mutations in the MLH1 gene, which are common in Finland, whereas patients with MSI tumors received more comprehensive genetic testing (for both MLH1 and MSH2 genes). Thus, their estimates are likely to be biased. Summary estimates of sensitivity and specificity were 100% (95% CI: 88, 100%) and 90% (95% CI: 88, 92%), respectively.

Table F-26

Ability of microsatellite instability to identify MLH1 and MSH2 mutation carriers among colorectal cancer probands fulfilling the revised Bethesda criteria
Study, year (Ref ID);A. Comments on sample characteristicsNtotalMutation No mutation Diagnostic performance (95% confidence interval) Micro-dissectionNCI 5 marker setQuality
CountryB. Verification biasMSIMSSMSIMSSSensitivity [%]Specificity [%]
Single-/multi-centerC. Mean age (y); Males (%)
D. Definition of MSI
Wolf, 2005 (123);A. Selection from a retrospective cohort of cancer patients fulfilling the modified Bethesda criteria81130933100 (75, 100)79 (63, 90)XB
AustriaB. No
Single-centerC. ND, 48
D. ≥30% out of up to 10 markers (MSI-H)

Note that studies that assessed genetic mutations only in patients with MSI cannot be used to construct 2 by 2 tables for the ability of MSI testing to detect MMR mutations. Thus such studies are not included in this table.

CRC: colorectal cancer; MSI(-H/-L): microsatellite instability (-high/-low); MSS: microsatellite-stable (no instability); NA: Not applicable; ND: Not described; Ntotal: total number of studied CRC

MSI-H Versus MSS Among Patients Fulfilling the Revised Bethesda Guidelines. Only the study by Wolf 200586 provided relevant data (Table 17, Appendix F-26 *). Sensitivity was 100% (95% CI: 75, 100%) and specificity was 79% (95% CI: 63, 90%).

Table F-27

Ability of microsatellite instability to identify MLH1 and MSH2 mutation carriers among colorectal cancer probands fulfilling the Amsterdam I criteria
Study, year (Ref ID);A. Comments on sample characteristicsNAm1/ NtotalMutation No mutation Diagnostic performance (95% confidence interval) Micro-dissectionNCI 5 marker setQuality
CountryB. Verification biasMSIMSSMSIMSSSensitivity [%]Specificity [%]
Single-/multi-centerC. Definition of MSI
Moslein 1996 (2545)A. Sample assembled from various databases; we present analyses only among familial cases (39/46), and only those described to have CRC. Study also included 7 sporadic CRC.14/465004100 (48, 100)100 (40, 100)XXC
US & GermanyB. No
Multi-centerC. ≥30% of 9 to 34 markers analyzed (unclear which exactly) (MSI-H)
Dieumegard, 2000 (1791);A. Sample assembled with unclear election process: we present analyses only mong familial CRC who were at most 1 riterion short of fulfilling Am1 (n=17); study also included 17 apparently sporadic CRC aged <50y at diagnosis.10/346031100 (54, 100)25 (0, 81)XXB
FranceB. Yes: not all sporadic CRC underwent MMR mutation testing (these are not included in this analysis)
Multi-centerC. ≥10% of up to 23 markers (But all were ≥30%) (MSI-H)
≥10% of up to 23 markers (MSI-H&L)6031100 (54, 100)25 (0, 81)
Peel, 1999 (1660);A. Referral HNPCC cases, other than the 1134 CRC probands who were also included but were not assessed with laboratory tests11/113015100 (29, 100)83 (36, 100)XC
USB. No
Multi-centerC. Unclear; at least 5 markers were used (MSI-H?)

Demographics (data on age and gender distributions) were not available among people with fulfilling the Amsterdam I criteria. Note that studies that assessed genetic mutations only in patients with MSI cannot be used to construct 2 by 2 tables for the ability of MSI testing to detect MMR mutations. Thus such studies are not included in this table.

CRC: colorectal cancer; MSI(-H/-L): microsatellite instability (-high/-low); MSS: microasatellite-stable (no instability); NA: Not applicable; ND: Not described; NAm1: total number of people fulfilling Amsterdam I criteria in the study population; Ntotal: total number of studied CRC

MSI-H Versus MSS Among Patients Fulfilling Amsterdam I Criteria. There were very few patients for these analyses and thus the precision of the estimates is poor (Table 17, Appendix F-27 *). Sensitivity is of MSI-H (and combined MSI-H and MSI-low) versus MSI-stable was universally excellent (100% [95% CI: 62, 100%]) in the three studies that provided the relevant information,70, 75, 95 although none contributed more than 10 patients who fulfilled the Amsterdam I criteria. Overall specificity was 69% (95% CI: 20, 95%).

IHC

Table F-28

Ability of immunohistochemistry to identify MLH1 and MSH2 mutation carriers among selected colorectal cancer probands
Study, year (Ref ID);A. Comments on samplingNtotalMutation No mutation Diagnostic performance (95% confidence interval) Quality
CountryB. Verification biasNo stainingStainingNo stainingStainingSensitivity [%]Specificity [%]
Single-/multi-centerC. Mean age (y); Males (%)
D. Antibodies used
Genetic testing irrespectively of tumor microsatellite instability status
Barnetson, 2006 (NA)A. Selection of all incident CRC aged <55 y ate diagnosis between 02/1999 and 07/2003870a2433928589 (71, 98)88 (84, 91)A
ScotlandB. No
MulticenterC. 48; 53
D. Anti-MSH2: (Oncogene Research Products); anti-MLH1: (PharMingen); anti-MSH6: (Transduction laboratories);
Southey, 2005 (66)A. Randomly selected from a prospective cohort of all CRC with age of onset <45y; only patients who received genetic testing are presentedb105b18b0b8b33b100 (81, 100)80 (65, 91)B
AustraliaB. No
Single-centerC. <45y; ND
D. Anti-MSH2: FE-11 (Oncogene Research Products); anti-MLH1: G168–728 (PharMingen); anti-MSH6: clone 44 (BD transduction laboratories); anti-PMS2: clone A16-4 (PharMingen)
Syngal, 2000 (1672) & Wahlberg, 2002 (1158);A. Selection among referrals to pecialized center c70c6532255 (23, 83)88 (69, 97)B
USB. No
Single-centerC. ND; ND
D. Anti-MSH2: FE11 (Oncogene Research Products); anti-MLH1: G168–728 (PharMingen)
Katballe, 2002 (1310) & Christensen, 2002 (1038);A. Selected from a population of 1514 incident CRC42d9431569 (39, 91)83 (59, 96)B
DenmarkB. No
Single-centerC. ND; ND
D. Anti-MSH2: Ab-1, Ab-2 (Oncogene Research Products); anti-MLH1: G168-15 (PharMingen)
Curia, 1999 (1959)A. Sampled from pathology registries, unclear selection criteria: HNPCC related cancerse30e101310100 (0, 100)57 (34, 77)B
ItalyB. No
Single-centerC. <50y, ND
D. Anti-MSH2: FE11 (Oncogene Research Products); anti-MLH1: clone 14 (Oncogene Research Products)
Dieumegard, 2000 (1791)A. Sample assembled with unclear selection process: familial CRC missing at most 1 Am1 criterion and sporadic CRC aged <50y at diagnosis34435957 (18, 90)64 (35, 87)B
FranceB. Yes: only 7 sporadic CRC underwent genetic testing
MulticenterC. Oldest age at diagnosis 56, ND
D. Anti-MSH2: FE-11 (Oncogene Research Products); anti-MLH1: Ab-1 (Oncogene Research Products)
Debniak,, 2000 (1784);E. Sampled from consecutive CRC, selection process not transparent. All patient with available data are included.1682905618 (2, 51)100 (94, 100)C
PolandF. Yes: Only 43/143 apparently sporadic CRC were tested, but it is unclear how they were selected
Single-center(?)G. ND, ND
H. Unclear
Durno, 2005 (195)E. Retrospective cohort of CRC aged<24 y at diagnosis who were still alive (since 1970)16311375 (19, 99)75 (19, 99)C
CanadaF. No
Multi-centerG. <24y; 38
H. Anti-MSH2: FE-11 (Oncogene Research Products); anti-MLH1: G168–728 (PharMingen
Genetic testing among patients with MSI-H tumors
Terdiman, 2001 (1572)A. Retrospective cohort of CRC probands with ≥2 CRC in first degree family, age <50y at diagnosis or multiple tumors in the same patient11416129494 (71, 100)13 (4, 30)B
USB. Yes: only patients with MSI-H were assessed
Single-centerC. ND, ND
D. Unclear

No (nuclear immuno-) staining is the abnormal response. The number of patients in the 2 by 2 tables is the number of patients with available data and is typically smaller than the total number of patients included in the study.

CRC: colorectal cancer; ND: Not described; Ntotal: total number of studied CRC

a

Overall 359 patients had available tumor tissue of good quality.

b

This study assessed PMS2 and MSH6 also. The mutation and IHC testing include pathogenic mutations in these genes also.

c

Data from the publication by Wahlberg et al.

d

Data from the publication by Christensen et al.

e

4 were not CRC and are excluded from the calculations; Only 24 specimens had available IHC data.

Nine studies (described in 11 publications11, 65, 66, 6971, 79, 80, 98, 100, 102) provided information needed to calculate the sensitivity and specificity of IHC for predicting MMR mutations (Appendix F-28 *). One of these (Terdiman 200198) assessed the ability of IHC only in individuals with MSI-H positive tumors.

Studies That Assessed IHC Irrespective of MSI Testing. Eight studies assessed IHC in patients with available tumor tissue; one received grade A in overall quality,11 five grade B65, 66, 70, 71, 79, 80, 102 and two grade C.69, 100

Three studies performed sequencing in all available patients,11, 69, 79 and one of them (Barnetson 200611)also used specific methods to detect large genomic deletions or rearrangements.

All studies tested for MLH1 and MSH2 gene mutations. One study also tested for the presence of MSH6 mutations (Barnetson 200611) and another tested for MSH6 and PMS2 mutations (Southey 2005102). IHC testing was performed for all assessed MMR genes (MLH1, MSH2 and the additional MMR genes) in the latter two studies.11, 102 It was not possible to examine the changes in the sensitivity and specificity of IHC with and without the non-MLH1/non-MSH2 mutations in these studies.

Three studies had information in the 2×2 tables on at least 40 patients.11, 69, 102 Two papers described prospective studies that analyzed incident CRC patient (Barnetson 200611 and Southey 2005102) diagnosed at young age (<55 and <45 years, respectively).

An external file that holds a picture, illustration, etc., usually as some form of binary object. The name of referred object is er-hnpccf22.jpg.

   Figure 22. Sensitivity and specificity of IHC to identify mismatch repair gene mutations based on study characteristics

Figure 22 shows the distribution of the studies according to the presence or absence of several study characteristics. Overall, the sensitivity ranged from 27% to 100% and the specificity from 43% to 100%. The six good or fair quality studies (grade A or B respectively) had a summary sensitivity of 74% (95% CI: 54, 87%) and specificity of 77% (95% CI: 61, 88%).

An external file that holds a picture, illustration, etc., usually as some form of binary object. The name of referred object is er-hnpccf23.jpg.

   Figure 23. Summary ROC curve for the diagnostic ability of IHC to identify mismatch repair gene mutations

Figure 23 shows the summary ROC curve for the pertinent studies.

Table F-29

Ability of immunohistochemistry to identify MLH1 and MSH2 mutation carriers among colorectal cancer probands fulfilling Amsterdam I criteria
Study, year (Ref ID);A. Comments on samplingNAm1/NtotalMutation No mutation Diagnostic performance (95% confidence interval) Quality
CountryB. Verification biasNo stainingStainingNo stainingStainingSensitivity [%]Specificity [%]
Single-/multi-centerC. Mean age (y); Males (%)
D. Antibodies used
Katballe, 2002 (1310) & Christensen, 2002 (1038);A. Selected from a population of 1514 incident CRC11/42a220550 (7, 93)100 (48, 100)B
DenmarkB. No
Single-centerC. ND; ND
D. Anti-MSH2: Ab-1, Ab-2 (Oncogene Research Products); anti-MLH1: G168-15 (PharMingen)
Dieumegard, 2000 (1791)A. Sample assembled with unclear selection process: familial CRC missing at most 1 Am1 criterion and sporadic CRC aged <50y at diagnosis10/34222250 (7, 93)50 (7, 93)B
FranceB. Yes: only 7 sporadic CRC underwent genetic testing
MulticenterC. Oldest age at diagnosis 56, ND
D. Anti-MSH2: FE-11 (Oncogene Research Products); anti-MLH1: Ab-1 (Oncogene Research Products)

No (nuclear immuno-) staining is the abnormal response. The number of patients in the 2 by 2 tables is the number of patients with available data and is typically smaller than the total number of patients included in the study.

CRC: colorectal cancer;; NAm1: number fulfilling Amsterdam I criteria; ND: Not described; Ntotal: total number of studied CRC

a

Data from the publication by Christensen et al.

IHC among people fulfilling Amsterdam I criteria. Only the studies described by Katballe 2000 (another paper by Christensen 2002 reported the same patients65, 71) and the study by Dieumegard 200070 provided relevant information, and they are described in Appendix F-29 *. Both contributed nine or fewer patients and thus estimates of sensitivity and specificity lack precision (Table 17).

Studies That Assessed IHC After Suggestive MSI Testing. A single study by Terdiman 200198 assessed IHC among individuals who had tumors with MSI-H. The sensitivity of IHC was 94% (95% CI: 71, 100%) and the specificity was only 13% (95% CI: 4, 30%).

Expected Outcomes With Different Testing Strategies

Outline of the Problem

The prevalence of MMR mutations among people who are newly diagnosed with CRC is low.7, 10, 12, 63, 85 Because of practical, economic, and logistical considerations, genetic testing would ideally be performed only in patients with high probability of HNPCC. Such patients may be selected based on heightened suspicion from the clinical history, suggestive laboratory testing of tumor tissue (in particular MSI or IHC), or complex combinations of all of the above. The various strategies differ in the number of tests (MMR, MSI or IHC) that need to be performed and the accuracy of the diagnosis.

We performed analyses using decision trees to model the expected outcomes with different testing strategies from the payers'/third party perspective. The outcomes were the number of incident CRC with positive diagnosis for HNPCC, and the number of tests (MMR, MSI, or IHC) needed to detect them. We also assessed how many patients found to be mutation carriers with each strategy would be truly positive.

This analysis pertains to a cross-section in time. We used a hypothetical population of 100,000 incident cases of CRC. This number is in the order of incident cases expected annually in the US (approximately 150,000, given an annual incidence of 50/100,000 and a population of 300 million) and is a number convenient for calculations. The interested reader could multiply the reported numbers by 1.5 to extrapolate to the whole population in the United States.

We assessed nine different strategies, which were most commonly represented in the studies summarized in this review. The strategies used clinical criteria, MSI, IHC, or a combination of clinical criteria with MSI or IHC to select patients for MMR mutation testing.

Among the various clinical criteria that have been proposed, we opted to model the revised Bethesda guidelines and a set of three clinical criteria that are more easily ascertained (fulfillment of at least one of the following: age less than 50 year old at diagnosis, history of CRC or endometrial cancer in 1st degree family, or presence of multiple -synchronous or metachronous CRC or endometrial cancer in the proband). The revised Bethesda guidelines were selected because they appear to have the best sensitivity and specificity among unselected incident patients with CRC (data from Pinol 200512).

The set of three clinical criteria is a simple alternative that appears to have comparably high sensitivity and specificity, but is much simpler to assess. Interestingly, in the predictive models that have been developed in the literature, the aforementioned three simple clinical criteria have been the most influential predictors of HNPCC status (based on the coefficients from the logistic regression models from Barnetson 2006,11 Wijnen 1998103 and Balmana 200692).

The selected strategies are not exhaustive. However, these strategies have been discussed in the literature as possible options, and some of them have been evaluated in previous decision analyses.19 It would be impractical to provide analyses on a more extensive list of strategies, especially given the paucity of relevant data in the literature.

Brief Description of Strategies and Values Used in the Decision Tree

Nine strategies were modeled as described briefly below.

  • MMR-All: Perform MMR testing on all patients with CRC.

  • BethR-All: Perform MMR testing only among those fulfilling the revised Bethesda guidelines.

  • Clinical-All: Perform MMR testing only among those fulfilling at least one of the three simple clinical criteria (age <50y at diagnosis; 1st degree family history of CRC or endometrial cancer; or multiple, synchronous or metachronous, CRC or endometrial cancer in the same patient).

  • MSI-All: Perform MSI testing on all patients; followed by MMR testing only among those with suggestive MSI test.

  • IHC-All: Perform IHC testing on all patients; followed by MMR testing only among those with suggestive IHC test.

  • BethR-MSI: Perform MSI testing on patients fulfilling the revised Bethesda guidelines; perform MMR only among those with suggestive MSI test.

  • 3Clinical-MSI: Perform MSI testing on patients fulfilling at least one of the three simple clinical criteria (age <50y at diagnosis; 1st degree family history of CRC or endometrial cancer; or multiple, synchronous or metachronous, CRC or endometrial cancer in the same patient); perform MMR only among those with suggestive MSI test.

  • BethR-IHC: Perform IHC testing on patients fulfilling the revised Bethesda guidelines; perform MMR only among those with suggestive IHC test.

  • 3Clinical-IHC: Perform IHC testing on patients fulfilling at least one of the three simple clinical criteria (age <50y at diagnosis; 1st degree family history of CRC or endometrial cancer; or multiple, synchronous or metachronous, CRC or endometrial cancer in the same patient); perform MMR only among those with suggestive IHC test.

An external file that holds a picture, illustration, etc., usually as some form of binary object. The name of referred object is er-hnpccf24.jpg.

   Figure 24. Decision tree model used to calculate the impact of different testing strategies

Figure 24 illustrates the general concepts in the architecture of these decision trees.

The strategies are conceptually organized in similar groups depending upon the pattern they follow in selecting who would be sequenced for MMR mutations.

  • Group 1: Test everyone (MMR-All)

  • Group 2: Screen with a set of clinical criteria (BethR-All, 3Clinical-All)

  • Group 3: Screen with a laboratory test (MSI-All, IHC-All)

  • Group 4: Screen using two serial tests: a set of clinical criteria first and then a laboratory test (BethR-MSI, BethR-IHC, 3Clinical-MSI, 3Clinical-IHC).

Table 18

Probabilities and parameters used in the decision trees for different strategies to detect MMR mutations
VariableBaselineRange for sensitivity analysis Reference
LowHighRationale
Prevalence of HNPCC among unselected CRC assuming no founder mutations in non-Finnish populations, (%)Low=0.900.65.1Lower limit is the lower 95% CI boundary excluding founder mutations in MLH1; Upper limit is more than the upper 95% CI boundary of the higher prevalence estimateAaltonen 1998, Salovaara 2000, Pinol 2005, Samowitz 2001, Hampel 2005
PrevHigher=2.75The range was intentionally broad.
Sensitivity of genetic testing, (%)9572100Assumed to be the same in every subset of CRCAssumption, 5% are not detected by MLH1 or MSH2
S_MMR
Specificity of genetic testing, (%)99.598100Assumed to be the same in every subset of CRCAssumption
C_MMR
Proportion with inconclusive results among those with HNPCC whose MMR test results were not positive, (%)11035Upper limit based on 95% CISyngal 1999
Pinconcl1
Proportion with inconclusive results among those without HNPCC whose MMR test results were not positive, (%)0.2500.7Upper limit based on 95% CIPinol 2005
Pinconcl2
Unselected incident CRC probands
Sensitivity of MSI testing, (%)958199Assuming combined MSI-H and MSI-L is “positive”; limits based on 95% CIAaltonen 1988, Salovaara 2000, Barnetson 2006, Southey 2005
S_MSI
Specificity of MSI testing, (%)878191Assuming combined MSI-H and MSI-L is “positive”; Limits based on 95% CIAaltonen 1988, Salovaara 2000, Barnetson 2006, Southey 2005
C_MSI
Sensitivity of IHC testing, (%)917597among <45 and <55y of age; Limits based on 95% CISouthey 2005, Barnetson 2006
S_IHC
Specificity of IHC testing, (%)878390among <45 & <55y of age; Limits based on 95% CISouthey 2005, Barnetson 2006
C_IHC
Sensitivity of Revised Bethesda Guidelines, (%)9159100Limits based on 95% CIPinol 2005
S_BethR
Specificity of Revised Bethesda Guidelines, (%)777579Limits based on 95% CIPinol 2005
C_BethR
Sensitivity of 3 clinical criteria, (%)886097Limits based on 95% CIAaltonen 1998, Salovaara 2000, Pinol 2005
S_3Clinical
Specificity of composite clinical criteria, (%)777481Limits based on 95% CIAaltonen 1998, Salovaara 2000, Pinol 2005
C_3Clinical
Among CRC fulfilling the composite clinical criteria
Sensitivity of MSI testing, (%)956510010/10 and 17/18; limits based on 95% CIAaltonen 1998, Salovaara 2000
S_MSI_3Clinical
Specificity of MSI testing, (%)87739498/118 and 82/99; Limits based on 95% CIAaltonen 1998, Salovaara 2000
C_MSI_3Clinical
Sensitivity of IHC testing, (%)917597Assumption, see text[Southey 2005, Barnetson 2006]
S_IHC_3Clinical
Specificity of IHC testing, (%)878390Assumption, see text[Southey 2005, Barnetson 2006]
C_IHC_3Clinical
Among CRC fulfilling the Revised Bethesda guidelines
Sensitivity of MSI testing, (%)9565100Assumption, see text[Aaltonen 1998, Salovaara 2000]
S_MSI_BethR
Specificity of MSI testing, (%)877394Assumption, see text[Aaltonen 1998, Salovaara 2000]
C_MSI_BethR
Sensitivity of IHC testing, (%)847396Assumption, see text; Limits based on 95% CI[Southey 2005]
S_IHC_BethR
Specificity of IHC testing, (%)959497Assumption, see text; Limits based on 95% CI[Southey 2005]
C_IHC_BethR

In the first column the italicized word is the name of the pertinent variable in the decision trees. For references that are in brackets: The variable values are based on assumptions that the studies referenced within brackets provide suitable estimates.

CI: confidence interval; CRC: colorectal cancer; IHC: immunohistochemistry; MSI: MSI.

Table 18 shows the selected baseline values for the decision tree parameters, as well as the ranges of the sensitivity analyses. It should be noted that only some of the conditional probabilities that were presented in the previous sections are applicable to the following modeling approach; furthermore some conditional probabilities are imputed based on realistic assumptions because they were not extractable from the reviewed literature. All probabilities, their derivation and the rationale for any assumptions are described in more detail in the sections that follow.

Prevalence of Mutations Among Incident Unselected CRC Patients ( Prev ). The prevalence of mutations among incident unselected CRC is the most influential variable in the analyses (see Appendix G *). Based on the following considerations we present here two sets of results; one using a low prevalence estimate (0.9%) and one using a higher prevalence estimate (2.7%). The rationale for these values is given below. The prevalence value ranged from 0.6% to 5.1% in the sensitivity analyses.

Relevant studies. Among the 40 studies that were assessed for Key Question 2, four (3,332 analyzed patients in total) evaluated incident unselected CRC patients (Aaltonen 1998,63 Salovaara 2000,85 Pinol 2005,12 and Samowitz 200110). All were limited by verification bias, in that comprehensive genetic testing was performed only in patients with suggestive MSI results,10, 63, 85 or MSI and IHC results.12

We also considered the study by Hampel 2005,8 although it was not eligible (did not provide needed data) for the quantitative analyses described in the previous sections. Patients with suggestive MSI were sequenced for MLH1, MSH2, MSH6 and PMS2 mutations; analyses for large genomic deletions/rearrangements were also performed.

Low estimate for mutation prevalence (0.9%). The two Finnish studies63, 85 reported founder mutations (large genomic deletions) in the MLH1 gene of several CRC patients; however the Finnish founder mutations have not been identified in patients of non-Finnish origin.12 Thus, they are not applicable to the US population. Excluding the founder mutations from the analyses, the proportion of mutation carriers among unselected patients with CRC was estimated at 0.9% (95% CI: 0.6 to 1.3%).

An American Founder Mutation (AFM) in the MSH2 gene has been described in one kindred probably originating from German immigrants, but it is unlikely to have a large impact in the general population.90, 91 AFM is expected to account for very few HNPCC incident cases (between 51 and 290 CRC in the US for AMF) annually.90, 91 Thus, we did not model the AFM.

Higher estimate for mutation prevalence (2.7%). In the Hampel 2005 study twenty-three out of 1066 CRC were identified as carriers (prevalence 2.2% [95% CI: 1.4, 3.2%]), after suggestive MSI. Conservative accounting for carriers who did not have suggestive MSI (using the lower 95% CI boundary for the sensitivity of MSI among unselected CRC) raises the prevalence value to 2.7%.

Range of sensitivity analyses. We used a wide range of prevalence values in the sensitivity analyses from 0.6% to 5.1%. 0.6% is the lower 95% CI boundary for the low prevalence estimate. 5.1% is 20% more than the upper 95% CI of the higher prevalence estimate and was deemed to be high enough to encompass practically all realistic prevalence estimates that have been suggested by experts.7

Sensitivity and Specificity of Genetic Testing ( S_MMR, C_MMR ). We assumed:

  • That complete gene sequencing for MMR testing would be done.

  • Near perfect sensitivity and specificity for genetic testing.

  • The proportion of inconclusive genetic test results (that is mutations of unknown clinical significance) was not incorporated in the estimates of sensitivity and specificity of genetic testing; it is rather modeled separately (see below).

Because the available estimates for the diagnostic performance of all clinical predictors were based on MLH1 and MSH2 gene mutation testing in the primary studies, we “penalized” the maximum sensitivity of genetic testing to account for HNPCC cases with mutations other than MLH1 and MSH2. There were limited data on this proportion in the eligible studies. We therefore assumed that 5% of patients with HNPCC would have mutation in MMR genes other than MLH1 and MSH2 (thus we set sensitivity to 95% in the base case). In further analyses, we examined sensitivity as low as 72% based on data from Southey 2005,102 where 28% of the detected mutations among CRC aged less than 45 years of age (a selected population) were due to MSH6 and PMS2 mutations. Thus, the modeling accounts for the incremental value of testing for additional MMR genes other than MLH1 and MSH2.

Proportion of Inconclusive Results Among HNPCC With Non-Positive Test Results ( Pinconcl1 ), and Proportion of Inconclusive Results Among Patients Without HNPCC With Non-Positive Test Results ( Pinconcl2). These estimates are associated with considerable uncertainty. Syngal 199955 found that 2/18 patients with pathogenic mutations also had inconclusive mismatch mutations. Thus we assumed that 11% of HNPCC carriers also have inconclusive mutations.

The proportion of patients with CRC without HNPCC who carry mismatch mutations is more difficult to estimate. We based the estimate on the only study on incident, unselected CRC that provided the relevant information.12 This study was published recently and thus the authors presumably had access to the latest knowledge on which mutations were pathogenic; the corresponding estimate was 0.25%.

Both the aforementioned proportions were varied from 0% to their upper 95% CI values in sensitivity analyses.

Sensitivity and Specificity of MSI ( S_MSI, C_MSI ) and IHC ( S_IHC, C_IHC ) Among Unselected Incident CRC. These values were based on estimates from population-based studies that performed some form of genetic testing in all available patients. Because such IHC estimates were not available in unselected CRC, we assumed that two studies on patients with young age of onset for CRC (Barnetson 200611 and Southey 2005102) provided reliable approximations. This is based on the assumption that the diagnostic ability of laboratory predictors is relatively independent of clinical criteria that were used to select a population.

Similarly, for MSI we used a synthesis from the estimates obtained from four studies on incident CRC (Salovaara 200085, Aaltonen 199863, Barnetson 200611 and Southey 2005102). The values for MSI refer to combined MSI high and MSI low. The range of the sensitivity analyses includes the estimates for MSI high only.

Sensitivity and Specificity of the Revised Bethesda Guidelines Among Unselected CRC ( S_BethR, C_BethR ). These were obtained from the study by Pinol 2005.12

Sensitivity and Specificity of the Three Clinical Criteria (Young Age at Diagnosis, CRC in Family or Multiple Tumors in Proband) Among Unselected Patients With CRC ( S_3Clinical, C_3Clinical ). These were obtained from a meta-analysis of pertinent studies (Aaltonen 1998,63 Salovaara 2000,85 and Pinol 200512). The estimates for the two Finnish studies63, 85 were calculated accounting for the presence of founder mutations.

Sensitivity and Specificity of MSI ( S_MSI_3Clinical, C_MSI_3Clinical ) and IHC ( S_IHC_3Clinical, C_IHC_3Clinical ) Among People Fulfilling the Three Clinical Criteria (Young Age at Diagnosis, CRC in Family or Multiple Tumors in Proband). The values for MSI were based on the studies by Aaltonen 1998 and Salovaara 2000.63, 85 Values include both MSI-H and MSI-low, as discussed above.

Similar values for IHC were not available. We assumed that these could be substituted by the corresponding estimates for the unselected CRC (which were based on data from Barnetson 2006 and Southey 2005, two studies11, 102 that assessed people at young age of CRC diagnosis).

Sensitivity and Specificity of MSI ( S_MSI_BethR, C_MSI_BethR ) and IHC ( S_IHC_BethR, C_IHC_BethR ) Among People Fulfilling the Revised Bethesda Guidelines. A small study on 81 patients by Wolf 200586 provided the relevant information for the accuracy of MSI. However, the study reported perfect sensitivity (100%) for MSI, which was considered improbable. We therefore used the same estimates as for patients fulfilling at least one of the three simple clinical criteria (<50 years of age at diagnosis, CRC or endometrial cancer in family or multiple colorectal or endometrial cancers in proband).

There were no available data for the diagnostic accuracy of IHC among people fulfilling the revised Bethesda guidelines. Therefore, we assumed that Southey 2005102 (a study that assessed incident CRC aged less that 45 at diagnosis) provided suitable corresponding estimates.

Results With the Different Strategies

Testing for MSI (or even IHC) among CRC patients with high clinical suspicion for HNPCC may be a reasonable compromise between the number of laboratory tests that would be required and an accurate diagnosis in the majority of people with HNPCC (i.e., strategies in group 4).

Table 19

Expected number of MMR, MSI or IHC tests and expected MMR testing results with the nine strategies, assuming a population of 100,000 incident cases of CRC
StrategyReceived tests Number of MMR tests that were Unidentified MMR mutation carriers
MMRMSIIHCPositiveTrue positiveInconclusive
Low prevalence estimate for MMR mutation carriers (0.90%)
MMR-All100,000001,35185525245
BethR-All23,6120089277861122
3Clinical-All23,5850086675261148
MSI-All13,738100,00008778123788
IHC-All13,7020100,00084377837122
BethR-MSI3,74123,612075473912161
3Clinical-MSI3,71623,585073071511185
BethR-IHC1,828023,6126596546246
3Clinical-IHC3,684023,58570068511215
Higher prevalence estimate for MMR mutation carriers (2.75%)
MMR-All100,000003,0982,612257138
BethR-All24,870002,4892,37769373
3Clinical-All24,787002,4102,29969451
MSI-All15,255100,00002,5452,48146269
IHC-All15,1450100,0002,4402,37745373
BethR-MSI5,28524,87002,2732,25820492
3Clinical-MSI5,20624,78702,1982,18420566
BethR-IHC3,220024,8702,0021,99714753
3Clinical-IHC5,110024,7872,1062,09220658

In the hypothetical population, for the low prevalence estimate 900/100,000 patients are assumed to carry MMR mutations; for the high prevalence estimate 2750 people are assumed to carry MMR mutations. Strategies are presented with respect to the group (1 to 4) to which they belong.

More specifically, group 4 strategies selected relatively fewer patients for genetic testing (6% or less) and missed at most 27% of patients with HNPCC. In contrast, for strategies in groups 1 to 3, more than 13% and up to 100% of newly diagnosed CRC patients would be genetically tested, and 5% to 16% of patients with HNPCC would be missed. These descriptives are true for both the low (0.9%) and the higher estimate for the prevalence of mutation carriers among incident unselected CRC (Table 19).

Because the revised Bethesda guidelines are more difficult to ascertain compared to the fulfillment of at least one of the three simple clinical criteria, it might be easier to use the combination of the three clinical criteria. Although it seemed that MSI was preferable over IHC as a screening tool among people with high clinical suspicion, estimates were based on several assumptions due to missing information, compromising the validity of this observation.

We decided not to highlight the relative ranking of the strategies within each group because of the many assumptions in the used probabilities. We therefore focus more on the differences across the four groups of strategies. The relative ranking of the 4 strategy groups with respect to each outcome was robust in all one-way sensitivity analyses.

Baseline Analyses.

Number of patients identified as positive - low estimate for prevalence of mutation carriers. In the hypothetical population of 100,000 CRC, 900 individuals had MMR mutations. The number of positive diagnoses with each strategy ranged from 1,351 (MMR-All) to 659 (Beth-IHC) (Table 19). The number of HNPCC patients who were truly identified was highest in the MMR-All strategy (n=855 out of 900) and lowest in group 4 strategies (ranging between 654 and 739, depending on the strategy). Reciprocally, the number of HNPCC patients who were missed with each strategy increased for strategies that performed fewer MMR tests. While only 45 patients would be missed if all CRC were to be genetically tested, up to one out of five (between 161 and 246 out of 900) would be missed if MSI or IHC were performed only on people with a high clinical suspicion for HNPCC.

As shown in Table 19, the number of inconclusive MMR tests increases with the number of total MMR tests. In group 4 strategies it ranged between 6 and 12, and in the MMR-All strategy it was approximately 250.

Number of patients identified as positive - higher estimate for prevalence of mutation carriers. In the hypothetical population of 100,000 CRC, 2,750 individuals had MMR mutations. The number of positive diagnoses with each strategy ranged from 3,098 (MMR-All) to 2,002 (Beth-IHC) (Table 19). The number of HNPCC patients who were truly identified was highest in the MMR-All strategy (n=2,612 out of 2,750) and lowest in group 4 strategies (ranging between 1,997 and 2,258, depending on the strategy). The number of HNPCC patients who were missed with each strategy increased for strategies that performed fewer MMR tests. While only 138 patients would be missed if all CRC were to be genetically tested, up to one out of four (between 492 and 753 out of 2,750) would be missed if MSI or IHC were performed only on people with high clinical suspicion for HNPCC.

As shown in Table 19, the number of inconclusive MMR tests increases with the number of total MMR tests. In group 4 strategies it ranged between 14 and 20, and in the MMR-All strategy it was a bit over 260.

Number of tests performed for assessments - low estimate for prevalence of mutation carriers. The expected percentage of the CRC cohort receiving MMR tests ranged from 100% (MMR-All) to 1.83% (BethR-IHC) (Table 19).

Generally, strategies that used clinical criteria to select patients to be tested with MSI or IHC (BethR-MSI, BethR-IHC, 3Clinical-MSI, 3Clinical-IHC) required fewer MMR genetic tests. Fewer than 4% of newly diagnosed patients with CRC would be expected to need MMR genetic testing based on this approach. Furthermore, for the strategies in group 4, approximately one out of four patients would receive MSI or IHC testing, based upon suggestive clinical criteria.

The use of clinical criteria alone to screen cases (BethR-All, 3 Clinical-All) would require MMR genetic testing in almost a quarter of the incident cases of CRC. Using laboratory tests as a first screening would result in approximately one out of seven patients requiring genetic testing (Table 19). By definition, all patients in the strategies that first screen with MSI or IHC would receive MSI or IHC testing (MSI-All or IHC-All, respectively), but fewer than one out of four patients would need to be screened with MSI or IHC based upon suggestive clinical criteria (Table 19).

Number of tests performed for assessments - higher estimate for prevalence of mutation carriers. The expected percentage of the CRC cohort receiving MMR tests ranged from 100% (MMR-All) to 3.22% (BethR-IHC) (Table 19). The overall percentages of people receiving genetic testing, MSI testing or IHC testing with the various strategies was similar to what was calculated for the low prevalence estimates (Table 19).

Table 20

Overall sensitivity and specificity for each of the nine strategies
StrategySensitivity of strategy (%)Specificity of strategy (%)
MMR-All95.099.3
BethR-All86.599.8
3Clinical-All83.699.8
MSI-All90.399.9
IHC-All86.599.9
BethR-MSI82.1100.0
3Clinical-MSI79.4100.0
BethR-IHC72.6100.0
3Clinical-IHC76.1100.0

The overall sensitivity and specificity values were very similar for both the low and the higher estimates for the prevalence of MMR mutation carriers.

Strategies are presented with respect to the group (1 to 4) to which they belong.

One may consider the nine strategies as nine (composite) diagnostic tests, and thus calculate their overall (strategy-level) sensitivity and specificity (Table 20). In these calculations, inconclusive tests were assumed to be false negative (for the calculation of overall sensitivity for each strategy) or false positive (for the calculation of overall specificity for each strategy). The overall specificity was high in all strategies. Group 4 strategies had the lowest overall sensitivity (ranging between 73% and 82%). The overall sensitivity and specificity values were similar for both the low and the higher estimates for the prevalence of MMR mutation carriers.

Benefits and Harms

Key Question 1: Does Risk Assessment and HNPCC Mutation Testing in Patients With Newly Diagnosed CRC Lead to Improved Outcomes for the Patient or Family Members, or is it Useful in Medical, Personal, or Public Health Decision Making? (Overarching Question)

graphic element

Key Question 1 is a general question that includes all other Key Questions. An ideal study addressing Key Question 1 would enroll patients with CRC patients and/or their family members and randomize them to risk assessment and mutation testing or a control intervention, and follow them up prospectively. The study would compare a spectrum of health outcomes among those who received screening for HNPCC to those who did not, while considering subsequent treatments or interventions in each group.

Summary of Findings. No study directly addressed Key Question 1 based on the ideal framework described above.

Gaps in the Literature. While our literature review did not identify a comprehensive study that directly answered Key Question 1, it is unlikely that such an “ideal” study is feasible. Such a study would likely be prohibitively complex, require multiple years of follow-up and randomization of patients or family members to care that is no longer considered to reflect contemporary practices. However, studies addressing specific components of this general question (as described in the remaining Key Questions) provide some of necessary pieces to better understand this overarching question.

Key Question 3: What Are the Harms Associated With Screening High-Risk Individuals for HNPCC?

graphic element

Studies were considered eligible for Key Question 3 if they reported harms of a risk assessment process (e.g., Amsterdam, Bethesda and/or MSI, IHC) used to identify CRC patients at increased risk for HNPCC.

Summary of Findings. No study described any harms of the risk assessment process in CRC patients at increased risk for HNPCC.

Gaps in the Literature. The goal of the risk assessment process is to identify individuals suspected of having HNPCC who might benefit from subsequent genetic testing. It is possible that such a process could lead to harm, such as stigmatization or worry, but no study directly assessed such associations.

The risk assessment tools also have the potential to misclassify patients. The test characteristics (i.e., sensitivity, specificity and predictive values) of these methods are summarized in the “Clinical Validity” section. We did not consider misclassified patients (i.e., false positive or negatives) as having been harmed. However, it is possible that subsequent genetic testing and/or management options could harm patients who had been misclassified. The harms associated with genetic testing and/or management options are described later in this report.

Future research is needed to identify the best strategy of the risk assessment process that increases the accuracy, feasibility and applicability of diagnostic methodologies to determine HNPCC so the potential harms can be minimized.

Key Question 5: What Are the Harms Associated With Screening for High-Risk Individuals?

graphic element

Studies were considered eligible for Key Question 5 if they reported the harms associated with testing CRC patients for MMR mutations. Common harms that are thought to be associated with genetic testing are labeling, discrimination in health coverage, and emotional distress.

Table 21

Key Question 5. What are the harms associated with genetic testing for HNPCC mutations?
Author, yearStudy design (follow-up duration)nTarget population for genetic testing (Eligible/Enrolled N)N evaluated% Mutation positiveMeasures of psychological impact after revealing genetic testing resultsObserved impact Quality
CountryTest receivers vs. normal rangesaFollow-up vs. baseline (changes over time)Mutation positive vs. negative
Quantitative, Comparative Studies
Gritz, 2005Prosp (2 wk, 6 mo & 1 yr)Affectedb persons at least 18 years old with HNPCC defined by Amsterdam or suggestive family history followed by mutation testing (126/89)8937%Anxiety (State-Trait) [left and right double arrow ] at all f/up [left and right double arrow ] at all f/up A
USDepression (CES-D) [left and right double arrow ] at all f/up [left and right double arrow ] at all f/up
Quality of life (SF-36) [left and right double arrow ] at all f/up [left and right double arrow ] at all f/up
Distress from receiving testing results (RIES) ↓ at 2 wk & 6 mo; [left and right double arrow ] 1 yr.[left and right double arrow ] at all f/up
Keller, 2002Prosp (4–6 wk)Patients with HNPCC-related cancer from families at risk for HNPCC (ND/31)31N/AcAnxiety (HAD) B
GermanyDepression (HAD) [left and right double arrow ]
Cancer-specific distress (IES scales) ↓↓
Murakami, 2004Prosp (1 mo)Probands whose family members had been identified as carrying the MLH1/MSH2 mutation, age ≥20 years, and opted for genetic testing (31/27)2722%Minor depression (DSM-III-R and DSM-IV scales) [left and right double arrow ] [left and right double arrow ] B
JapanGuilt (mutation carriers only)2/6 (33%)

↑ Statistically increased

↑ Increased, but not statistically significant

[left and right double arrow ] No statistically significant differences

↓ Statistically decreased

↓ Decreased, but not statistically significant

a

Published population levels or the normal ranges

b

“Affected” persons included any index patients or relatives with a prior diagnosis of any cancer excluding non-melanoma skin cancer

c

Patients received only pre-test genetic counseling. Psychological measures were done immediately after counseling without performing genetic testing

Table 21a

Author, yearStudy Design (Follow-up duration)Target population for genetic testing (Eligible/Enrolled N)N evaluated% Mutation positiveResultsQuality
Country
Qualitative, Non-Comparative Studies
Porteous, 2003Survery (N/A)Newly diagnosed CRC patients under the age of 55 years old (160/111)111N/AThe majority of participants found it highly acceptable to have information about HNPCC brought to their attention at a time when they were coping with a new diagnosis of colorectal cancer, despite a lack of prior awareness that the disease could run in families. The vast majority reported high levels of subjective understanding concerning genetic testing. 19% of participants (n=21) rated their current level of worry caused by the genetics information at or above the midpoint of 4 on a 1 (not at all) to 7 (all the time) scale.B
UK1 patient (1% ) not opting for genetic testing.

References for standardized instruments:

CES-D: Center for Epidemiologic Studies Depression.

DSM-III-R: Association Psychiatric Association. Diagnostic and statistical manual of mental disorders. 3rd edition, revised. Washington, DC: American Psychiatric Press, 1987.

DSM-IV: Association Psychiatric Association. Diagnostic and statistical manual of mental disorders. 4th edition. Washington, DC: American Psychiatric Press, 1994.

State-Trait Anxiety: Van der Ploeg HM, Defares PB, Spielberger CD. Handleiding bij de Zelfbeoordelingsvragenlijst: een Nederlandstalige bewerking van de Spielberger State-Trait Anxiety Inventory. Lisse: Swets and Zeitlinger, 1980.

Cancer-specific distress (IES scales): Horowitz MJ, Wilner N, Alvarez W. Impact of Event Scale: a measure of subjective stress. Psychosom Med 1979;41:209–18.

Hospital anxiety and depression scale (HAD): Goldberg D, Williams P. A User's Guide to the General Health Questionnaire. Windsor: NFER-Nelson, 1988.

Three quantitative, comparative studies of quality A and B, and one qualitative study of B quality reported harms associated with MMR mutation testing in CRC patients104106 (Table 21).

Summary of Findings. One 1-year prospective study (Grade A) compared the psychological impact of MMR mutation testing between mutation carriers and non-carriers.104 Results for non-carriers are summarized below and also in Table 21. Subjects in this study were CRC probands or relatives from HNPCC families with a prior diagnosis of any cancer (excluding non-melanoma skin cancer). Anxiety, depression, and quality of life measures did not change over time, and there were no differences in these measures between mutation carriers and non-carriers. Distress levels were significantly decreased 2 weeks and 6 months after revealing the genetic testing results, but were not significantly different from the baseline at 1-year follow-up. There was no difference in the distress levels between mutation carriers and non-carriers.

Another 1-month prospective study (Grade B) found that three of the 27 probands (11%) had minor depression at 1 month after revealing the genetic testing results, but the prevalence of minor depression was not significantly different compared to the prevalence at baseline or between mutation carriers and non-carriers.105 Of the six probands who received a positive result, two (33%) felt severe guilt regarding their children.

One prospective study (Grade B) reported changes in the psychological outcomes of CRC patients from self-completed questionnaires pre- and 4–6 weeks post-genetic counseling.107 There was no genetic testing performed in this study. There was a trend toward greater anticipated ability to cope with a positive gene test after counseling, as reflected by a decreased in anxiety and cancer-specific distress.

The qualitative study of 111 newly diagnosed CRC patients reported a high acceptance and understanding about information on HNPCC.106 Nineteen percent of participants rated their current level of worry caused by the genetics information at or above the midpoint of 4 on a 1 (not at all) to 7 (all the time) scale.

Gaps in the Literature. Most research on psychosocial aspects of genetic counseling and testing for cancer risk has focused on hereditary breast and ovarian cancer. Genetic testing for hereditary colorectal cancer has become available only in the past decade. As a result, only few studies with small number of CRC patients have evaluated the acceptability and psychosocial sequelae of genetic counseling and testing. Some of the findings from studies of counseling and testing in other forms of cancer may be applicable to the CRC setting.

Key Question 6a: What Are the Management Options for CRC Patients Who Are HNPCC Positive? b: Does the Identification of HNPCC Mutations Lead to Improved Patient Outcomes in Terms of Early Detection, Mortality/Morbidity, or Management Decisions (e.g., Counseling, Surveillance, Treatment, Other Decision Making) by Patients and Providers?

graphic element

Key Question 6 examines the outcomes of using MMR mutation status to make management decisions compared to conventional management without MMR mutation status. There are three aspects to Key Question 6: 1) Are management options for patients with CRC with a MMR mutation different from those without a MMR mutation? 2) Does the knowledge of MMR mutation status change management decisions by patients and providers? 3) Does changing management options for MMR positive patients with CRC improve outcomes (e.g., prognosis and survival) compared to standard approaches for patients with CRC?

We encountered a variety of surgical and medical management options in patients with CRC who were MMR positive. These included various forms of colonic resection108110 and chemotherapy for patients with stage III tumors.111 However, these studies did not directly address the components of Key Question 6 described above.

Because of the limited data, we broadened the scope of this question to include studies evaluating all forms of cancer related to HNPCC, since patients with CRC from HNPCC families are potentially at increased risk for all of these cancers. We also included studies using clinical criteria and laboratory testing (such as MSI and IHC) as a surrogate for identification of HNPCC mutations.

Despite having broadened the inclusion criteria, we did not identify any prospective, comparative study (direct evidence) addressing any aspect of Key Question 6. However, two retrospective cohort studies indirectly addressed the prognosis of CRC and the survival outcome of patients with endometrial cancer from HNPCC families, in relation to MMR mutation testing.112, 113 Both were of C quality, due to potential selection bias and unclear effects of treatments or interventions on the outcomes.

Table 22

Key Question 6b. Does the identification of HNPCC mutations lead to improved patient outcomes in terms of early detection, mortality/morbidity or management decisions (e.g., counseling, surveillance, treatment, other decision making) by patients and providers?
Author, YearStudy Design (f/up duration)Target population for genetic testing (Eligible/Enrolled N)N evaluated% Positive HNPCC testDescription of HNPCC tests% Received interventions or treatmentsOutcomesQuality
Country
Mutation testing
Benatti, 2001Retro (8.2, 6.7, and 9.4 yrs for group A, B, and C respectively)29 HNPCC families met inclusion criteria: 10 carried MMR gene mutations (Group A), 10 were characterized by MSI phenotype but not by MMR gene mutation (Group B), and 9 did not show mutations or MSI (Group C)Group A: 361: 100% MMR gene mutationND[left and right double arrow ] Compared Group B (or MSI) Prognosis of CRCC
ItalyGroup B: 241 0% Better compared Group C (or MSS) (p=0.001)
Group C: 3550%
Boks, 2002Retro (ND)Patients with endometrial cancer from 46 HNPCC families with a mutation or that met revised Amsterdam criteria (ND/66)5075%MMR gene mutationND[left and right double arrow ] 5-year cumulative survivalC
Netherlands
Clinical criteria and laboratory testing
Bertario, 1999Retro (60 Mo)3 CRC groups: 144 HNPCC 161 FAP 2035 sporadic (ND/2,340)2,3405%Amsterdam criteria“Adjuvant-treatment protocols were the same b/w the 3 groups”[left and right double arrow ] Survival b/w HNPCC, FAP, and sporadic CRC groups adjusting for age, gender, stage and tumor location. HR for HNPCC was 1.01 (95% CI 0.72–1.39) compared with sporadic.C
ItalyHNPCC and FAP patients underwent periodic examinations for different “spectrum of the diseases”
Fujita, 1996Retro (ND)CRC patients who underwent surgery (ND/3,356)17858/1000 Amsterdam I criteria 100% surgery5-year survival rate (30 day mortality excluded):B
Japan17/1000 Japanese criteria A  Amsterdam I=92.3%
56/1000Japanese criteria B Japanese A=81.2%
 Japanese B=66.5%
 Sporadic=60%
Better survival for Amsterdam and Japanese A vs. Japanese B and Sporadic groups (p<0.05)
Tomoda 1966Retro (12–153 mo)Nonpolyposis CRC patients who underwent resection (ND/1042)10423.7%Japanese criteria B100% resectionMean age was significantly younger for cases meeting Japanese criteria (or with HNPCC) than cases who didn't (55.9 yr vs. 61.1 yr, p=0.01)B
Japan ↑ Metachronous (postoperative) CRC, compared cases with HNPCC to those without HNPCC (10.2% vs. 3.5%, p=0.0001)
↑ Survival, compared cases with HNPCC to those without HNPCC (p=0.02)
↑ Survival, compared cases with HNPCC to those without HNPCC with stage III cancers (p=0.06)
Perrin, 2001Retro (ND)Patients diagnosed with sporadic CRC (ND/225)20813%Lack of expression of MSH2 and/or MLH1 by IHCND[left and right double arrow ] Disease-free survival compared MSH2 and/or MLH1 status by IHC. Subpopulation of proximal tumors, MSH2 and/or MLH1 negativity was associated with longer disease-free survivalC
France
Kruhoffer, 2005Retro (ND)Stages II and III CRC patients with sporadic MSI, hereditary MSI, or MSS a tumors (151/101)19 100% Sporadic MSI-H tumors 65 patients with Stage III tumors receiving adjuvant chemotherapyOverall survival highly significantly related to classification in 36 Stage II patients as 10 of 11 patients who died ≤ 5 years belonged to MSS/MSI-L group (p=0.0014)C
Denmark15 100% Hereditary MSI-H tumors b16 classified as MSI and 49 as MSS/MSI-L tumors for 65 Stage III patients receiving adjuvant chemotherapy. [left and right double arrow ] overall survival b/w groups (6 MSI and 30 MSS/MSI-L patients died ≤ 5 years f/up (p=0.55)
670%MSS or MSI-L tumors

FAP=familial adenomatous polyposis

↑ Statistically increased

↑ Increased, but not statistically significant

[left and right double arrow ] No statistically significant differences

↓ Statistically decreased

↓ Decreased, but not statistically significant

a

The definition of MSS in the study was Including MSI-L.

b

MSI tumors with HNPCC origin were classified by a maximum likelihood MSI classifier with a “leave-one-out” cross validation scheme basically as described (Dyrskjot et al, 2003).

In addition, five retrospective cohort studies indirectly addressed mortality or morbidity in relation to risk assessments (clinical criteria and laboratory testing) for HNPCC mutations108, 109, 111, 114, 115 (Table 22). Of these, three studies of B quality described clinical outcomes in patients with CRC who were screened for HNPCC using clinical criteria.108, 109, 115 Another two described clinical outcomes in patients with CRC who were screened for HNPCC with laboratory testing.111, 114 Both were of C quality and limited by the potential selection bias, and/or unclear effects of treatments or interventions on the outcomes.

Summary of Findings. Indirect evidence from one study suggested that identification of HNPCC mutations was associated with better prognosis of CRC. However, there was no data on whether management options for CRC differed based on MMR mutation status.

Indirect evidence from one study showed no difference in survival of patients with endometrial cancer, comparing those who were mutation positive to those who were mutation negative.

Table 1

Overview Table: Key Question 6b
Reported OutcomesBody of evidence (study duration)Summary
Prognosis of CRC1 Retro study (~8 yr)
  • [left and right double arrow ] Comparing mutation carriers to non-carriers with MSI

  • Better, comparing mutation carriers to non-carriers with MSS

Survival of patients with endometrial cancer1 Retro study (ND)
  • [left and right double arrow ] Comparing MMR mutation carriers to non-carriers

Survival of CRC patients5 Retro studies (12–153 mo)a
  • Results were inconsistent among studies that compared survival in patients with CRC who fulfilled Amsterdam I criteria with those considered to have sporadic CRC

  • [left and right double arrow ] Comparing Amsterdam I to Japanese A criteria

  • ↑ Comparing Amsterdam I to Japanese B criteria

  • [left and right double arrow ] Comparing MSH2 and/or MLH1 status by IHC in patients with sporadic CRC

  • [left and right double arrow ] Comparing MSI-H to MSI-L/MSS CRC

  • [left and right double arrow ] 5-year cumulative survival comparing patients with endometrial cancer who were mutation positive to those who were mutation negative.

  • [left and right double arrow ] Comparing stage III CRC patients receiving adjuvant chemotherapy with MSI tumors to those with MSS/MSI-L.

↑ Statistically increased

↑ Increased, but not statistically significant

[left and right double arrow ] No statistically significant differences

↓ Statistically decreased

↓ Decreased, but not statistically significant

a

Only two studies reported the study duration

In five studies with indirect evidence, there was no evidence in favor or against differences in survival, when comparing CRC patients who fulfilled different clinical criteria for HNPCC or screened positive for HNPCC by laboratory testing with those who did not (Overview Table 1; Table 22).

Gaps in the Literature. Some studies described the management of patients with HNPCC but surprisingly, there were no data directly exploring how MMR mutation status influenced the choice among these management options or their outcomes. As a result, the available data do not directly answer whether knowledge of MMR mutation status changes management decisions by patients and providers or whether changes in management for MMR positive patients improves their outcomes compared to standard CRC management. Issues related to MMR mutation testing in influencing decisions to undergo cancer screening procedures is discussed below with Key Question 10.

Key Question 7: What Are the Harms Associated With Subsequent Management Options After Identification of HNPCC Mutations in CRC Patients?

graphic element

Due to limited data on harms associated with subsequent management options or interventions, we broadened the scope of this question to include studies evaluating all forms of cancer related to HNPCC, since patients with CRC from HNPCC families are potentially at risk for all forms of HNPCC-related cancers. We also included studies that reported any outcome relating to subsequent management options or interventions in these patients.

Table 23

Key Question 7. What are the harms associated with subsequent management options after identification of HNPCC mutations in CRC patients?
Author, YearStudy design (Follow-up duration)Target population (Eligible/Enrolled N)% with CRC at baselineN evaluated% who took actionsDescription of subsequent actions or interventionsHarmsOutcomesQuality
Country
Van Dalen 2003Retro (1–49 yr)CRC patients from 39 HNPCC families met Amsterdam I criteria (ND/93)100%93100%33% received RC, 14% L/SC, 18% PSC, 25% TC, and 10% SGCND2nd resections rate7/31 patients received RC; 5/30 patients received L/SC or PSC; 0/23 patients received TC; 4/9 patients receive SGCB
US
Aarnio 1997Retro (ND)Patients with gastric cancers from 51 HNPCC families by Amsterdam I or with a known MMR mutation (ND/45)40%a4536% Radical surgery ND5-year survival48% C
Finland63%Palliative surgery or explorative laparotomy alone with no surgery15%

RC=Right colectomy; L/SC=Left/sigmoid colectomy; PSC=Proctosigmoidectomy; TC=Total/subtotal colectomy; SGC=Segmental colectomy.

a

18 (40%) already had been treated for CRC (13 cases), endometrial cancer (2 cases), ovarian cancer (1 case), urinary-tract cancer (1 case) and testicular cancer (1 case).

Two retrospective studies of B and one of C quality reported outcomes related to subsequent actions or interventions in patients with CRC and gastric cancers, respectively (Table 23).110, 116 The validity of the study of C quality (gastric cancers) is questionable because of unclear participation rates and an unclear description of how survival/death was ascertained.

Summary of Findings. No study described harms associated with subsequent management options after identification of HNPCC mutations in patients with CRC or other forms of HNPCC-related cancers.

One study (involving two centers) described the types of colorectal surgery performed on CRC patients who were part of an Amsterdam criteria-positive family, and compared rates of metachronous cancers that followed each type of index operation.110 The overall rate of second surgeries for metachronous cancer were 23% in patients who underwent right colectomy, 17% in patients who underwent left/sigmoid colectomy or proctosigmoidectomy, 0% in patients who underwent total/subtotal colectomy, and 44% in patients who underwent segmental colectomy. The two centers had significantly different second resection rates for metachronous cancer.

One study described the survival rate of 45 patients with gastric cancer from HNPCC families with MMR mutations.116 Many of these patients had already had treatments for other HNPCC-related cancers, including CRC. The 5-year survival was higher in patients in whom radical surgery was performed (48%) than in patients in whom radical palliative surgery or explorative laparotomy alone was performed (15%).

Gaps in the Literature. There are no data on harms associated with surgical procedures or chemotherapy in CRC patients with HNPCC, although it is likely that such patients encounter the same spectrum of harms associated with chemotherapy and surgery as patients with CRC (or other forms of HNPCC-related cancer) without HNPCC. One cannot assume “no harm” when a study did not report data on harms.

There were also no data on whether cancer patients with MMR mutations derive a greater benefit from specific management options compared with patients without MMR mutations. However, several studies have suggested a relatively favorable prognosis of colorectal cancer in patients with HNPCC or those who have clinical features associated with HNPCC such as tumors that are MSI-H.117120 These data have also suggested that patients with colorectal cancer that demonstrate MSI may not derive a benefit from adjuvant chemotherapy with 5-fluorouracil (5-FU), possibly because of a higher cure rate with surgery alone and/or intrinsic resistance to 5-FU.120

However, a 2004 consensus statement issued by the American Society of Clinical Oncology121 found insufficient evidence to recommend modification of overall treatment recommendations in patients with stage II colorectal cancer with a known mismatch repair mutation or tumors that demonstrate MSI, noting the retrospective and inconclusive nature of the existing evidence. The report cites an ongoing European trial (FOLFIRI), which is comparing irinotecan and 5-FU and is stratifying patients based on tumor MSI status, and a United States Intergroup trial that is also incorporating MSI status as a prognostic factor. The final results of these trials have not been published.

Our review of the literature did not provide additional strong evidence in favor or against the use of adjuvant chemotherapy in patients with HNPCC of any stage. However, our literature search strategy excluded studies with patients who had tumors that demonstrated MSI unless the study performed additional testing for HNPCC (either by clinical criteria, IHC, or genetic testing). Thus, the literature search was not comprehensive for establishing the relationship between tumor MSI status and the outcome of adjuvant chemotherapy. The ongoing trials described above will help clarify this issue (as well as the role of other biologic markers proposed for guiding adjuvant chemotherapy in patients with colorectal cancer).

Key Questions 8 to 11 summarize what is known about the processes and benefits of bringing family members into the testing process. Knowing that a CRC patient is MMR mutation positive has implications for family members. As a general rule, family members receive counseling and, subsequently, genetic testing for MMR mutations ideally based upon the results of MMR testing in the proband.

Key Question 8b: What is the Accuracy of HNPCC Testing in Family Members in Predicting the Risk of CRC?

Key Question 8c: Do Other Factors, Such as Race/Ethnicity, Age, Gender, or Co-Morbidities Affect the Accuracy of the Testing?

graphic element

The analytic framework proposed above greatly restricted the pool of potentially eligible studies since it required that CRC probands were proven to have a MMR mutation. As a result, we broadened the scope of our search to include studies using clinical criteria, laboratory testing or mutation testing in predicting the risk of CRC or extracolonic cancers in family members of CRC probands with HNPCC (based on clinical or genetic criteria) and/or kindreds with HNPCC (based on clinical or genetic criteria). We considered the findings in such studies to be applicable to the Key Question. Any measure of relative risk (e.g., the standardized incidence ratio) was included as indirect evidence for the accuracy of the testing.

Table 24

Key Question 8b. What is the accuracy of HNPCC testing in family members in predicting the risk of CRC? Key Question 8c. Do other factors, such as race/ethnicity, age, gender, or co-morbidities affect the accuracy of the testing?
Author, yearStudy design (follow-up duration)Target population for HNPCC test (Eligible /Enrolled N)N evaluated% Positive HNPCC testDescription of HNPCC testsAccuracy of HNPCC testing in predicting risk of CRC or other HNPCC- related cancers / Factors that affected the accuracy of the testingQuality
Country
Family members of CRC probands with HNPCC based on genetic criteria
Hampel 2005Retro (ND)Probands and 373 mutationpositive family members from 70 HNPCC families (ND/461)461100%Mutations (MLH1 or MSH2) and clinical criteria, mostly Amsterdam I or IILifetime risk of CRC was 68.7% for men and 52.2% for women.B
FinlandLifetime risk of endometrial cancer was approximately 54%
Mean age of diagnosis of CRC 55.1 (95% CI 52.6–57.6)) for men and 60.3 (95% CI 58.0–62.6) for women; approximately 10–15 years older than previous estimates of age at onset for CRC among HNPCC patients.
Dunlop 1997Retro (ND)Relatives of 6 probands with MMR gene mutations (from the Scottish National Cancer Registry) (156/156)15643%Mutations (MLH1 or MSH2By 70 years of age, the male risk of CRC was 74% while the female risk was only 30% (p=0.0066).B
ScotlandThe risk of CRC was significantly higher at all ages in men than in women.
In females, the risk of uterine cancer exceeded the risk of CRC by age 58 years, giving an estimate of 42% by age70 years.
Family members of CRC probands with HNPCC based on clinical criteria
Bermejo 2005Retro (ND)Families from Swedish Family-Cancer Database with ≥4 generations of cancer. No age restrictions for parents but maximum age in 2nd generation was 70 year. (ND/566,877)566,877 families0.04 /1000 Amsterdam I Cumulative risk of CRC (95% CI) by age 75 yr: Am I families=57.1% (46–68.8%) Am II families=41.2% (33.3–50.1%) Bethesda families=  Men 41.7% (39.4–44.1%)  Women 23.3% (22.2–24.4%)B
Sweden0.07 /1000 Amsterdam II Cumulative risk of endometrial cancer (95% CI) by age 75 yr: Am II families=45.4% (34.1–58.5%) Bethesda families=8.7% (8–9.5%)
8.99 /1000Bethesda 1–5Cumulative risk for ovarian cancer (95% CI) by age 75 yr: Bethesda group=4.7% (4.2–5.3%)  Gastric cancer= 2.3% (2–2.7%)
Cederquist, 2001Retro (8 yr)1st degree family members of 36 colon-endometrial caner probands and 43 colon-colon cancer probands. ND/649)64923%Proband<50 yr; MSI+ ↑ CRC risk (SIR =21; 95%CI 12–35)B
Sweden ↑ All cancer risk (SIR =3.2; 95%CI 2.2–4.5)
24%Proband<50 yr; MSS ↑ CRC risk (SIR =7; 95%CI 3–14)
↑ All cancer risk (SIR =2.3; 95%CI 1.6–3.2)
18%Proband>50 yr; MSI+[left and right double arrow ] CRC risk
[left and right double arrow ] All cancer risk
34%Proband>50 yr; MSS[left and right double arrow ] CRC risk
[left and right double arrow ] All cancer risk
Brown 1998Retro (ND)Multiple primary group: 1st degree relatives of CRC probands, who developed a second primary in the HNPCC spectrum1 (166/157)1288%Amsterdam I and modified criteria ↑ CRC risk, compared to the single primary group (RR=3.2, p<0.00001)C
UKSingle primary group: both HNPCC associated and non-HNPCC associated extracolonic cancers had expected frequency.
Single primary group: 1st degree relatives of single CRC patients (595/444)4440.7%Multiple primary group: extracolonic non-HNPCC cancers had expected frequency however, HNPCC associated extracolonic cancers had twice the frequency of general population.
Bradshaw, 2003Prosp (2 yr)Asymptomatic individuals with a family history of CRC at a young age who received colonoscopy (448/190)16328%Amsterdam I (or high risk)Colonoscopy was complete to the cecum in 92%.C
UKNo cases of CRC were detected.
64%Family history of CRC only (moderate risk)4 patients (8%) in high-risk group had adenomas.
In moderate group, overall five individuals had an adenoma (2%).
8%Low riskProportion of patients younger than 50 found to have an adenoma was significantly greater in the high-risk group than those in the moderate risk group (p=0.05).
1

CRC, stomach, urinary, ovary, or endometrial cancers

Table 25

Key Questions 8b and 8c in kindreds with HNPCC based on clinical and/or genetic criteria
Author, yearStudy design (follow-up duration)Target population for HNPCC test (Eligible /Enrolled N)N evaluated% Positive HNPCC testDescription of HNPCC testsAccuracy of HNPCC testing in predicting risk of CRC or other HNPCC-related cancers / Factors that affected the accuracy of the testingQuality
Country
Mutation testing
Aarnio, 1998Retro (43 yr)50 HNPCC families in which a MLH1 gene mutation (47 families) or MSH2 gene mutation (3 families) had been detected (1,763/1,763)1,763100%MLH1/MSH2In mutation carriers, cumulative incidence rate at 70 years of age were 82% for CRC and 60% for endometrial cancer, compared with only 1.6% and 1.3%, respectively, in the Finnish population as a whole.B
FinlandThe cumulative incidence of CRC was 100% in men and 54% in women.
The cumulative incidence for gastric cancer was 13% and, for ovarian cancer 12%. For uroepithelial, kidney and bile-duct cancer and for brain tumors, the cumulative incidences ranged from 2 to 4% by 70 years of age.
Scott, 2001Retro/Prosp (ND)HNPCC families meeting either Amsterdam (34%) or Bethesda (66%) criteria (ND/95)95 families18%MLH12Relative standardized incidence rates and 95%CI of CRC: Mutation (-): 158.61 (132.8–189.4) MLH1 mutation (+): 196.76 (143.0–270.7) MSH2 mutation (+): 134.24 (99.1–181.8)B
AustraliaCompared MSH2 mutation-positive group to MLH1 mutation-positive group: [left and right double arrow ] Trend for lower CRC rate (p=0.087) [left and right double arrow ] Frequency of extracolonic cancers
Malignancies were overrepresented in all 3 groups compared with expected frequency in general population
16%MSH2f[left and right double arrow ] For age at diagnosis compared MSH2 mutation-positive group to MLH1 mutation-positive group, adjusted for familial clustering. (MSH2 mutation-positive families=45.77 yr; MLH1 mutation-positive families=47.16 yr)
↑ For age at diagnosis compared mutation-positive group to mutation-negative group (+ 5 yr)
Plaschke, 2004Retro (ND)HNPCC families meeting Amsterdam I or II, plus Bethesda criteria. Selected members with MSI low or -high, and abnormal IHC, plus MLH1/MSH2 mutation-positive, or MSH6 mutation-positive (706/183 families)1,97480%MLH1/MSH2Compared family members with pathogenic MSH6 mutations to those with MLH1/MSH2 mutations:C
Germany ↓ Prevalence of malignant disease (29% vs. 37.5%)
↓ Cumulative risk by age to develop CRC or any tumor
20%MSH6Compared family members with pathogenic MSH6 mutations to those with MLH1/MSH2 mutations:
↑ Median age of CRC onset (54 vs. 44)
↑ Median age of any tumor onset (51 vs. 43)
Vasen, 2001Retro (ND)Families with HNPCC meeting Amsterdam I or II or high suspicion of HNPCC (193/193)138 families25%MLH1Compared MSH2 carriers to MLH1 carriers:C
Netherlands & Norway ↑ Lifetime risk of developing cancer at any age (p<0.01)
↑ Risk of CRC (p=0.13)
↑ Risk of developing endometrial cancer (p=0.057)
↑ Risk of developing cancer of the urinary tract by age 70 (12%, p<0.05)
↑ Risk of CRC comparing male to female MSH2 mutation carriers (p<0.01), [left and right double arrow ] for MLH1 or MSH6 mutation carriers
Mean age of CRC diagnosis higher in carriers of MSH6 compared with MLH1 or MSH2 (50 versus 43 and 44, respectively), statistical significance not reported
Lin, 1998Retro (ND)22 females and 27 males from 2 kindreds were identified with MSH2 mutation; 28 females and 28 males from 2 kindreds were identified with MLH1 mutations (ND/105)105100%MLH1/MSH2The cumulative incidence of CRC by age 60 was 84% in MLH1 and 71% in MSH2 carriers (p=NS)C
USThe cumulative incidence of CRC by age 60 was 96% in MSH2 males compared to 39% in MSH2 females (p=0.034), and 94% in MLH1 males compared to 63% in MLH1 females (p=NS)
The cumulative incidence of extrocolonic cancers by age 60 was 11% in MLH1 and 48% in MSH2 carriers (p=0.016)
Other HNPCC testing
Lindgren, 2002Retro (ND)Patients who were undergoing colonoscopy surveillance were classified as having HNPCC, defined as meeting Amsterdam criteria, germline mutation, or MSI, HCC, TCR, or OCR (ND/304)30415% HNPCC, at 70% risk3Relative risk of developing adenoma before age 54 yr compared to reference group4:C
Sweden16% HNPCC, at 35% risk5 ↑ HNPCC, at 70% risk group (RR=4.4. p<0.001)
2% HNPCC, at 17% risk6 ↑ TCR group (RR=3.1. p<0.001)
8% HNPCC, at 5% risk7No influence of sex on relative risk of developing adenoma before age 54 years
60%HCC, TCR, or OCR

↑ Statistically increased

↑ Increased, but not statistically significant

[left and right double arrow ] No statistically significant differences

↓ Statistically decreased

↓ Decreased, but not statistically significant

2

Genetic analysis was performed on a fresh blood specimen from the youngest living affected proband in each family.

3

Germline mutation carriers (MSH2, MLH1, or hMSH6).

4

Reference group was based on three published forensic autopsy studies used for estimates of adenoma prevalence in the normal population.

5

Fist generation of HNPCC families.

6

Second generation of HNPCC families.

7

Subjects in HNPCC families who were under surveillance before testing but tested negative for mutation.

We summarize the findings for family members of CRC probands with HNPCC (in Table 24) and for kindreds with HNPCC (in Table 25) separately, because the risk of CRC and/or extracolonic cancers is different between the two groups.

Six studies reported the accuracy of HNPCC testing in family members of CRC probands (based on clinical or genetic criteria) in predicting the risk of CRC20, 122126 (Table 24). Of these, only two (both of quality B) reported the accuracy of MMR mutation testing in family members of CRC probands with a positive MMR mutation.20, 126The other four reported the accuracy of HNPCC testing in family members of CRC probands with HNPCC based on clinical criteria122125 Half studies were of B quality and half were of C quality. These studies were limited by verification bias, selection bias, unclear follow-up duration, and/or bias from post-hoc analyses.

Six studies indirectly reported the accuracy of the HNPCC testing in kindreds with HNPCC (based on clinical or genetic criteria)127132 (Table 25). Of these, two were of B quality and four were of C quality. These studies were limited by selection and verification bias. Most studies did not adjust for familial clustering of cancers.

Summary of Findings. Only two studies of quality B reported the risk of CRC in family members of probands with positive MMR mutations (the proposed framework). The lifetime risk of CRC was 68.7% for men and 52.2% for women with MMR mutations in one study,20 and it was 74% and 30% respectively in the other study.126 Men had a higher lifetime risk of CRC in both studies.

Table 2

Overview Table. Key Questions 8b and 8c
Reported OutcomesBody of evidence (study duration)Summary
CRC risks in family members of probands with positive MMR mutations; factors that influenced the accuracy of testing2 Retro studies (ND)
  • In a Finland population, lifetime risk of CRC was 68.7% for men and 52.2% for women with MMR mutations. Mean age of diagnosis of CRC 55.1 for men and 60.3 for women.

  • In a Scottish population, cumulative risk of CRC (95% CI) by age 70 yr was 74% for men and 30% for women with MMR mutations (P=0.0066). The risk of CRC was significantly higher at all ages in men than in women.

CRC risks in family members of probands with HNPCC based on clinical criteria; factors that influenced the accuracy of testing1 Prosp study (2 yr) and 3 Retro studies (8 yr)a
  • Cumulative risk of CRC (95% CI) by age 75 yr:

    Am I families=57.1% (46–68.8%)

    Am II families=41.2% (33.3–50.1%)

    Bethesda families=

  • Men 41.7% (39.4–44.1%)

  • Women 23.3% (22.2–24.4%)

  • SIR of CRC (95% CI):

    ↑ Proband<50 yr; MSI = 21(12–35)

    ↑ Proband<50 yr; MSS = 7 (3–14)

    [left and right double arrow ] Proband>50 yr = 1.07 (0.74–1.40)

  • 8% in the group fulfilled Amsterdam I criteria had adenomas, while 2% in the group with family history of CRC only had adenomas.

  • ↑ CRC risk, compared 1st degree relatives of CRC probands who developed a second primary in the HNPCC spectrum with the single primary group (RR=3.2, p<0.00001)

CRC risks in kindreds with HNPCC based on clinical criteria and/or genetic criteria; factors that influenced the accuracy of testing6 Retro studies (ND)
  • Cumulative risk of CRC by age 70 yr was 82% in MLH1/MSH2 mutation carriers, compared with only 1.6% in the Finnish population as a whole.

  • Cumulative risk of CRC by age 60 yr:

    MLH1 mutation (+): 84% – 94% in men compared to 63% in women (p=NS)

    MSH2 mutation (+): 71% – 96% in males compared to 39% in women (p=0.034)

  • SIR 95%CI of CRC in HNPCC families based on genetic criteria:

    MLH1/MSH2 mutation (+): 68 (56–81) - SIR was higher in men (83) than in women (48)

  • SIR and 95%CI of CRC in HNPCC families meeting either Amsterdam or Bethesda criteria:

    Mutation (-): 158.61 (132.8–189.4)

    MLH1 mutation (+): 196.76 (143.0–270.7)

    MSH2 mutation (+): 134.24 (99.1–181.8)

  • Comparing family members with pathogenic MSH6 mutations to those with MLH1/MSH2 mutations:

    ↓ Prevalence of CRC

    ↓ Cumulative risk by age to develop CRC or any tumor

  • Compared MSH2 carriers to MLH1 carriers:

    ↑ Risk of CRC (p=0.13)

  • Relative risk of developing adenoma before age 54 yr compared to reference groupb:

    ↑ MMR mutation carriers (MSH2, MLH1, or hMSH6) (RR=4.4. p<0.001)

  • ↑ Risk of CRC comparing male to female MSH2 mutation carriers (p<0.01)

  • [left and right double arrow ] Risk of CRC comparing male to female MLH1 or MSH6 mutation carriers

  • Comparing family members with pathogenic MSH6 mutations to those with MLH1/MSH2 mutations:

    ↑ Median age of CRC onset (54 vs. 44 yr)

  • ↑ Age at diagnosis compared MMR mutation (+) to mutation (-) (+ 5 yr)

  • [left and right double arrow ] Age at diagnosis compared MSH2 mutation (+) to MLH1 mutation (+), adjusted for familial clustering.

  • Proportion of patients younger than 50 found to have an adenoma: ↑ Amsterdam I

SIR=standardized incidence rate.

↑ Statistically increased

↑ Increased, but not statistically significant

[left and right double arrow ] No statistically significant differences

↓ Statistically decreased

↑ Decreased, but not statistically significant

a