The fraction of true positive results (sensitivity) and the fraction of false positive results (1 - specificity) for the diagnostic signature (calculated from log10-transformed values for 18S-normalized CD3ε mRNA, 18S-normalized IP-10 mRNA, and 18S rRNA) as a biomarker of acute cellular rejection are shown in Panels A and B. Panel C shows the calibration plot based on bootstrap validation; vertical lines at the top of the plot indicate individual observations in the data set. In a comparison of the group of patients who had biopsy specimens showing acute cellular rejection with the group of patients who had biopsy specimens showing no rejection, the area under the curve (AUC) was 0.85 (95% CI, 0.78 to 0.91) (Panel A). In a comparison of the group of patients who had biopsy specimens showing acute cellular rejection with the group of patients who had stable graft function, the AUC was 0.81 (95% CI, 0.75 to 0.87) (Panel B). An analysis that included only specimens matched to biopsies performed because of clinical signs of rejection (38 specimens showing acute cellular rejection vs. 107 showing no rejection) showed that the three-gene signature was diagnostic of acute cellular rejection with 80% specificity (95% CI, 73 to 88) and 79% sensitivity (95% CI, 66 to 92) (AUC, 0.85; 95% CI, 0.79 to 0.92; P<0.001). The combination of perforin and IP-10 mRNAs or perforin and CD3ε mRNAs predicted acute cellular rejection almost as well as the combination of 18S-normalized CD3ε mRNA, 18S-normalized IP-10 mRNA, and 18S rRNA. The addition of perforin to the combination of 18S-normalized CD3ε mRNA, 18S-normalized IP-10 mRNA, and 18S rRNA did not improve the prediction. For the combination of 18S-normalized perforin mRNA, 18S-normalized IP-10 mRNA, and 18S rRNA, the AUC was 0.84 (95% CI, 0.78 to 0.90; P<0.001), and for the combination of 18S-normalized CD3ε mRNA, 18S-normalized perforin mRNA, and 18S rRNA, the AUC was 0.84 (95% CI, 0.76 to 0.91; P<0.001). Bootstrap validation confirmed that the best model consisted of 18S-normalized CD3ε mRNA, 18S-normalized IP-10 mRNA, and 18S rRNA as predictors. Cross-validated estimates of the AUC and calibration-curve intercept and slope were 0.83, −0.06, and 0.92, respectively. The loess-smoothed estimates of the cross-validated and unadjusted calibration curves are overlaid on a diagonal reference line representing perfect model calibration (Panel C). The three-gene model of 18S-normalized CD3ε mRNA, 18S-normalized IP-10 mRNA, and 18S rRNA, with all values log10-transformed, was superior to any of the single-gene models considered. The ROC curve of the three-gene signature discriminating between specimens showing acute cellular rejection and those showing no rejection in the external-validation data set had an AUC of 0.74 (95% CI, 0.61 to 0.86; P<0.001) (Panel D), which was not significantly lower than the AUC of 0.85 in the primary data set (P = 0.13).