Format

Send to

Choose Destination
Clin Infect Dis. 2020 Jan 9. pii: ciaa012. doi: 10.1093/cid/ciaa012. [Epub ahead of print]

The Limited Utility of Ranking Hospitals Based on Their Colon Surgery Infection Rates.

Author information

1
Department of Population Medicine, Harvard Medical School and the Harvard Pilgrim Healthcare Institute, Boston, MA.
2
Department of Infectious Diseases, Lahey Hospital and Medical Center, Burlington, MA.
3
Department of Medical Oncology, Dana Farber Cancer Institute, Boston, MA.
4
Boston University School of Medicine, Boston, MA.
5
University of Maryland School of Medicine, Baltimore, MD.
6
HCA Healthcare, Nashville, TN.
7
Ondine Biomedical Inc., McHenry, IL.
8
Division of Infectious Diseases and the Health Policy Research Institute, University of California Irvine School of Medicine, Irvine, CA.

Abstract

BACKGROUND:

The Centers for Medicare and Medicaid Services (CMS) use colon surgical site infection (SSI) rates to rank hospitals and apply financial penalties. CMS's risk adjustment model omits potentially impactful variables that might disadvantage hospitals with complex surgical populations.

METHODS:

We analyzed adult patients who underwent colon surgery within facilities associated with HCA Healthcare from 2014 to 2016. SSIs were identified from National Health Safety Network (NHSN) reporting. We trained and validated three SSI prediction models using 1) current CMS model variables, including hospital-specific random effects (HCA-adapted-CMS), 2) demographics and claims-based comorbidities (expanded-claims), and 3) demographics, claims-based comorbidities, and NHSN variables (claims-plus-EHR). Discrimination, calibration, and resulting rankings were compared among all models and the current CMS model with published coefficient values (CMS).

RESULTS:

We identified 39,468 colon surgeries in 149 hospitals resulting in 1,216 (3.1%) SSIs. Compared to the HCA-adapted-CMS model, the expanded-claims model had similar performance (c-statistic 0.65 vs 0.67), while the claims-plus-EHR model was more accurate (c-statistic 0.70, 95% CI: 0.67-0.73; p=0.004). The sampling variation due to low surgical volume and small number of infections contributed 74% of the total variation in observed SSI rates between hospitals. When CMS model rankings were compared to those from the expanded-claims and claims-plus-EHR models, eighteen (15%) and 26 (22%) hospitals changed quartiles, and 10 (8.3%) and 12 (10%) hospitals changed into or out of the lowest-performing quartile, respectively.

CONCLUSIONS:

An expanded set of variables improved colon SSI risk prediction and quartile assignment, but low procedure volumes and SSI events remain a barrier to effectively compare hospitals.

KEYWORDS:

colon surgery; risk adjustment; surgical site infection

PMID:
31918439
DOI:
10.1093/cid/ciaa012

Supplemental Content

Full text links

Icon for Silverchair Information Systems
Loading ...
Support Center