Format

Send to

Choose Destination
Health Serv Res. 2014 Feb;49(1):284-303. doi: 10.1111/1475-6773.12090. Epub 2013 Jul 16.

Generalizing observational study results: applying propensity score methods to complex surveys.

Author information

1
Department of Health Policy and Management, Johns Hopkins Bloomberg School of Public Health, 624 N. Broadway, Rm 301, Baltimore, MD, 21205.

Abstract

OBJECTIVE:

To provide a tutorial for using propensity score methods with complex survey data.

DATA SOURCES:

Simulated data and the 2008 Medical Expenditure Panel Survey.

STUDY DESIGN:

Using simulation, we compared the following methods for estimating the treatment effect: a naïve estimate (ignoring both survey weights and propensity scores), survey weighting, propensity score methods (nearest neighbor matching, weighting, and subclassification), and propensity score methods in combination with survey weighting. Methods are compared in terms of bias and 95 percent confidence interval coverage. In Example 2, we used these methods to estimate the effect on health care spending of having a generalist versus a specialist as a usual source of care.

PRINCIPAL FINDINGS:

In general, combining a propensity score method and survey weighting is necessary to achieve unbiased treatment effect estimates that are generalizable to the original survey target population.

CONCLUSIONS:

Propensity score methods are an essential tool for addressing confounding in observational studies. Ignoring survey weights may lead to results that are not generalizable to the survey target population. This paper clarifies the appropriate inferences for different propensity score methods and suggests guidelines for selecting an appropriate propensity score method based on a researcher's goal.

KEYWORDS:

Survey research; health care costs; primary care

PMID:
23855598
PMCID:
PMC3894255
DOI:
10.1111/1475-6773.12090
[Indexed for MEDLINE]
Free PMC Article

Supplemental Content

Full text links

Icon for Wiley Icon for PubMed Central
Loading ...
Support Center