Format

Send to

Choose Destination
Ann Intensive Care. 2017 Dec;7(1):53. doi: 10.1186/s13613-017-0276-3. Epub 2017 May 18.

External validation of SAPS 3 and MPM0-III scores in 48,816 patients from 72 Brazilian ICUs.

Author information

1
Graduate Program in Translational Medicine, D'Or Institute for Research and Education (IDOR), Rio de Janeiro, Brazil.
2
PPG Internal Medicine, Federal University of Rio de Janeiro, Rio de Janeiro, Brazil.
3
ICU, Hospital Copa D'Or, Rio de Janeiro, Brazil.
4
Complexo Hospitalar, Santa Casa de Misericórdia de Porto Alegre, Porto Alegre, Brazil.
5
ICU, Hospital Esperança Recife, Recife, Brazil.
6
ICU, Hospital Total Cor, Rio de Janeiro, Brazil.
7
ICU, Hospital viValle, São José dos Campos, Brazil.
8
ICU, Hospital Rios D'Or, Rio de Janeiro, Brazil.
9
ICU, Hospital Norte D'Or, Rio de Janeiro, Brazil.
10
Hospital do Coração do Brasil, Brasília, Brazil.
11
Department of Critical Care, D'Or Institute for Research and Education (IDOR), Rio de Janeiro, Brazil.
12
ICU, Santa Casa de Misericórdia de Juiz de Fora, Juiz de Fora, Brazil.
13
ICU, Hospital Oeste D'Or, Rio de Janeiro, Brazil.
14
ICU, Hospital Universitário Lauro Wanderley, João Pessoa, Brazil.
15
ICU, Hospital São Luiz - Unidade Jabaquara, São Paulo, Brazil.
16
Complexo Hospitalar de Niterói, Niterói, Brazil.
17
Instituto Nacional de Infectologia Evandro Chagas, Fundação Oswaldo Cruz-Fiocruz, Rio de Janeiro, Brazil.
18
Department of Critical Care and Graduate Program in Translational Medicine, D'Or Institute for Research and Education (IDOR), Rio de Janeiro, Brazil.
19
PPG Internal Medicine, Federal University of Rio de Janeiro, Rio de Janeiro, Brazil. marciosoaresms@gmail.com.
20
Department of Critical Care and Graduate Program in Translational Medicine, D'Or Institute for Research and Education (IDOR), Rio de Janeiro, Brazil. marciosoaresms@gmail.com.
21
Department of Critical Care, D'Or Institute for Research and Education, Rua Diniz Cordeiro, 30. Botafogo, Rio de Janeiro, 22281-100, Brazil. marciosoaresms@gmail.com.

Abstract

BACKGROUND:

The performance of severity-of-illness scores varies in different scenarios and must be validated prior of being used in a specific settings and geographic regions. Moreover, models' calibration may deteriorate overtime and performance of such instruments should be reassessed regularly. Therefore, we aimed at to validate the SAPS 3 in a large contemporary cohort of patients admitted to Brazilian ICUs. In addition, we also compared the performance of the SAPS 3 with the MPM0-III.

METHODS:

This is a retrospective cohort study in which 48,816 (medical admissions = 67.9%) adult patients are admitted to 72 Brazilian ICUs during 2013. We evaluated models' discrimination using the area under the receiver operating characteristic curve (AUROC). We applied the calibration belt to evaluate the agreement between observed and expected mortality rates (calibration).

RESULTS:

Mean SAPS 3 score was 44.3 ± 15.4 points. ICU and hospital mortality rates were 11.0 and 16.5%. We estimated predicted mortality using both standard (SE) and Central and South American (CSA) customized equations. Predicted mortality rates were 16.4 ± 19.3% (SAPS 3-SE), 21.7 ± 23.2% (SAPS 3-CSA) and 14.3 ± 14.0% (MPM0-III). Standardized mortality ratios (SMR) obtained for each model were: 1.00 (95% CI, 0.98-0.102) for the SAPS 3-SE, 0.75 (0.74-0.77) for the SAPS 3-CSA and 1.15 (1.13-1.18) for the MPM0-III. Discrimination was better for SAPS 3 models (AUROC = 0.85) than for MPM0-III (AUROC = 0.80) (p < 0.001). We applied the calibration belt to evaluate the agreement between observed and expected mortality rates (calibration): the SAPS 3-CSA overestimated mortality throughout all risk classes while the MPM0-III underestimated it uniformly. The SAPS 3-SE did not show relevant deviations from ideal calibration.

CONCLUSIONS:

In a large contemporary database, the SAPS 3-SE was accurate in predicting outcomes, supporting its use for performance evaluation and benchmarking in Brazilian ICUs.

KEYWORDS:

Intensive care units; Outcomes; Severity-of-illness scores; Standardized mortality rate; Validation

Supplemental Content

Full text links

Icon for Springer Icon for PubMed Central
Loading ...
Support Center