Format

Send to

Choose Destination
Health Serv Res. 2013 Aug;48(4):1487-507. doi: 10.1111/1475-6773.12020. Epub 2012 Dec 6.

Squeezing the balloon: propensity scores and unmeasured covariate balance.

Author information

1
College of Pharmacy and College of Public Health, University of Iowa, Iowa City, IA 52242, USA. john-brooks@uiowa.edu

Abstract

OBJECTIVE:

To assess the covariate balancing properties of propensity score-based algorithms in which covariates affecting treatment choice are both measured and unmeasured.

DATA SOURCES/STUDY SETTING:

A simulation model of treatment choice and outcome.

STUDY DESIGN:

Simulation.

DATA COLLECTION/EXTRACTION METHODS:

Eight simulation scenarios varied with the values placed on measured and unmeasured covariates and the strength of the relationships between the measured and unmeasured covariates. The balance of both measured and unmeasured covariates was compared across patients either grouped or reweighted by propensity scores methods.

PRINCIPAL FINDINGS:

Propensity score algorithms require unmeasured covariate variation that is unrelated to measured covariates, and they exacerbate the imbalance in this variation between treated and untreated patients relative to the full unweighted sample.

CONCLUSIONS:

The balance of measured covariates between treated and untreated patients has opposite implications for unmeasured covariates in randomized and observational studies. Measured covariate balance between treated and untreated patients in randomized studies reinforces the notion that all covariates are balanced. In contrast, forced balance of measured covariates using propensity score methods in observational studies exacerbates the imbalance in the independent portion of the variation in the unmeasured covariates, which can be likened to squeezing a balloon. If the unmeasured covariates affecting treatment choice are confounders, propensity score methods can exacerbate the bias in treatment effect estimates.

KEYWORDS:

Propensity scores; assumptions; binning; covariate balance; matching; simulation

PMID:
23216471
PMCID:
PMC3725536
DOI:
10.1111/1475-6773.12020
[Indexed for MEDLINE]
Free PMC Article

Supplemental Content

Full text links

Icon for Wiley Icon for PubMed Central
Loading ...
Support Center