Display Settings:

Format

Send to:

Choose Destination
See comment in PubMed Commons below
Health Serv Res. 2003 Apr;38(2):751-76.

Developing and testing a model to predict outcomes of organizational change.

Author information

  • 1University of Wisconsin-Madison, USA.

Abstract

OBJECTIVE:

To test the effectiveness of a Bayesian model employing subjective probability estimates for predicting success and failure of health care improvement projects.

DATA SOURCES:

Experts' subjective assessment data for model development and independent retrospective data on 221 healthcare improvement projects in the United States, Canada, and The Netherlands collected between 1996 and 2000 for validation.

METHODS:

A panel of theoretical and practical experts and literature in organizational change were used to identify factors predicting the outcome of improvement efforts. A Bayesian model was developed to estimate probability of successful change using subjective estimates of likelihood ratios and prior odds elicited from the panel of experts. A subsequent retrospective empirical analysis of change efforts in 198 health care organizations was performed to validate the model. Logistic regression and ROC analysis were used to evaluate the model's performance using three alternative definitions of success.

DATA COLLECTION:

For the model development, experts' subjective assessments were elicited using an integrative group process. For the validation study, a staff person intimately involved in each improvement project responded to a written survey asking questions about model factors and project outcomes.

RESULTS:

Logistic regression chi-square statistics and areas under the ROC curve demonstrated a high level of model performance in predicting success. Chi-square statistics were significant at the 0.001 level and areas under the ROC curve were greater than 0.84.

CONCLUSIONS:

A subjective Bayesian model was effective in predicting the outcome of actual improvement projects. Additional prospective evaluations as well as testing the impact of this model as an intervention are warranted.

PMID:
12785571
[PubMed - indexed for MEDLINE]
PMCID:
PMC1360903
Free PMC Article
PubMed Commons home

PubMed Commons

0 comments
How to join PubMed Commons

    Supplemental Content

    Icon for Blackwell Publishing Icon for PubMed Central
    Loading ...
    Write to the Help Desk