NCBI » Bookshelf » Health Services/Technology Assessment Text (HSTAT) » AHRQ Evidence Reports » Economic Incentives for Preventive Care
 
hserta
AHRQ Evidence Reports
public health

Chapter  101:  Economic Incentives for Preventive Care

A151156

Prepared for:

Agency for Healthcare Research and Quality

U.S. Department of Health and Human Services

540 Gaither Road

Rockville, MD 20850

www.ahrq.gov

Contract No. 290-02-0009

Prepared by:

University of Minnesota Evidence-based Practice Center, Minneapolis, Minnesota

Investigators

Robert L. Kane, MD

Paul E. Johnson, PhD

Robert J. Town, PhD

Mary Butler, MBA

AHRQ Publication No. 04-E024-2

August 2004

ISBN: 1-58763-162-8

ISSN: 1530-4396

This document is in the public domain and may be used and reprinted without permission except those copyrighted materials noted for which further reproduction is prohibited without the specific permission of copyright holders.

This report may be used, in whole or in part, as the basis for development of clinical practice guidelines and other quality enhancement tools, or a basis for reimbursement and coverage policies. AHRQ or U.S. Department of Health and Human Services endorsement of such derivative products may not be stated or implied.

AHRQ is the lead Federal agency charged with supporting research designed to improve the quality of health care, reduce its cost, address patient safety and medical errors, and broaden access to essential services. AHRQ sponsors and conducts research that provides evidence-based information on health care outcomes; quality; and cost, use, and access. The information helps health care decisionmakers—patients and clinicians, health system leaders, and policymakers—make more informed decisions and improve the quality of health care services.

Suggested Citation:

Kane RL, Johnson PE, Town RJ, Butler M. Economic Incentives for Preventive Care. Evidence Report/Technology Assessment No. 101 (Prepared by the University of Minnesota Evidence-based Practice Center under Contract No. 290-02-0009.) AHRQ Publication No. 04-E024-2. Rockville, MD. Agency for Healthcare Research and Quality. August 2004.

Prepared for:

Agency for Healthcare Research and Quality

U.S. Department of Health and Human Services

540 Gaither Road

Rockville, MD 20850

www.ahrq.gov

Contract No. 290-02-0009

Prepared by:

University of Minnesota Evidence-based Practice Center, Minneapolis, Minnesota

Investigators

Robert L. Kane, MD

Paul E. Johnson, PhD

Robert J. Town, PhD

Mary Butler, MBA

AHRQ Publication No. 04-E024-2

August 2004

ISBN: 1-58763-162-8

ISSN: 1530-4396

This document is in the public domain and may be used and reprinted without permission except those copyrighted materials noted for which further reproduction is prohibited without the specific permission of copyright holders.

This report may be used, in whole or in part, as the basis for development of clinical practice guidelines and other quality enhancement tools, or a basis for reimbursement and coverage policies. AHRQ or U.S. Department of Health and Human Services endorsement of such derivative products may not be stated or implied.

AHRQ is the lead Federal agency charged with supporting research designed to improve the quality of health care, reduce its cost, address patient safety and medical errors, and broaden access to essential services. AHRQ sponsors and conducts research that provides evidence-based information on health care outcomes; quality; and cost, use, and access. The information helps health care decisionmakers—patients and clinicians, health system leaders, and policymakers—make more informed decisions and improve the quality of health care services.

Suggested Citation:

Kane RL, Johnson PE, Town RJ, Butler M. Economic Incentives for Preventive Care. Evidence Report/Technology Assessment No. 101 (Prepared by the University of Minnesota Evidence-based Practice Center under Contract No. 290-02-0009.) AHRQ Publication No. 04-E024-2. Rockville, MD. Agency for Healthcare Research and Quality. August 2004.

Preface

The Agency for Healthcare Research and Quality (AHRQ), through its Evidence-Based Practice Centers (EPCs), sponsors the development of evidence reports and technology assessments to assist public- and private-sector organizations in their efforts to improve the quality of health care in the United States. The reports and assessments provide organizations with comprehensive, science-based information on common, costly medical conditions and new health care technologies. The EPCs systematically review the relevant scientific literature on topics assigned to them by AHRQ and conduct additional analyses when appropriate prior to developing their reports and assessments.

To bring the broadest range of experts into the development of evidence reports and health technology assessments, AHRQ encourages the EPCs to form partnerships and enter into collaborations with other medical and research organizations. The EPCs work with these partner organizations to ensure that the evidence reports and technology assessments they produce will become building blocks for health care quality improvement projects throughout the Nation. The reports undergo peer review prior to their release.

AHRQ expects that the EPC evidence reports and technology assessments will inform individual health plans, providers, and purchasers as well as the health care system as a whole by providing important information to help improve health care quality.

We welcome written comments on this evidence report. They may be sent to: Director, Center for Outcomes and Evidence, Agency for Healthcare Research and Quality, 540 Gaither Road, Rockville, MD 20850.

Carolyn M. Clancy, M.D

Director

Agency for Healthcare Research and Quality

Jean Slutsky, P.A., M.S.P.H.

Acting Director, Center for Outcomes and Evidence

Agency for Healthcare Research and Quality

The authors of this report are responsible for its content. Statements in the report should not be construed as endorsement by the Agency for Healthcare Research and Quality or the U.S. Department of Health and Human Services of a particular drug, device, test, treatment, or other clinical service.

Acknowledgments

We would like to thank Marilyn Eells for editing and formatting this report.

Structured Abstract

Context. In recent years “pay for prevention” initiatives have been devised to address gaps between the high cost of preventable disease and deaths and the actual prevention practices of health providers and consumers. These initiatives use explicit, or extrinsic, incentives such as bonuses and cash or other in-kind financial incentives for providers and consumers to engage in specific preventive care or health promotion practices. The question is whether such economic incentives are a useful approach. In this report, we evaluate evidence from the literature on the impact of economic incentives targeted at providers and consumers on preventive health behaviors. The review is designed to 1) help develop more effective preventive strategies (evidence-based practice), and 2) help inform key stakeholders about the role of such practices, (evidence-based policymaking).

Objectives. A systematic review of the literature was undertaken to address four questions:

Key Question 1 - How have “preventive care” and “economic incentive” been defined in the literature?

Key Question 2 - Do incentives work?

Key Question 3 - Is there evidence of a dose/response curve?

Key Question 4 - What is the evidence for cost-effectiveness of economic incentive interventions?

Data Sources. We identified MEDLINE® , the Cochrane Library, EconLit, Business Source Premier, and PsychINFO as the literature sources for this review. Reference lists from previous systematic reviews, including the Cochrane Library were also examined as well. We also culled relevant articles from reference lists of identified studies.

Study Selection. Articles for both provider and consumer incentives were subjected to the inclusion and exclusion criteria. Individual articles must be primary studies in which preventive care or health promotion was a primary outcome measure. Preventive care was defined as care prior to illness diagnosis, thus excluding adherence studies. Also excluded were studies which included multiple factors in addition to economic incentives within the intervention arm, as were studies examining payment forms provided by more than one payment system, ie, HMO vs. FFS (as there are too many potential confounding factors). We included only RCTs, time series, and prospective quasi-experimental designs for the structured literature reviews. However, we also provided information from relatively well-designed econometric cross-sectional studies for the provider incentives as another perspective for consideration. Nineteen articles passed the inclusion criteria for provider economic incentives, and 47 articles passed the criteria for the consumer economic incentives.

Data Extraction. The abstraction tool was created with the purpose of facilitating the ability to capture emergent themes from the heterogeneous literature. The form was reviewed and commented on by the TEP members, piloted, and subsequently revised. Abstraction of the articles was performed by two independent reviewers. Disagreements were resolved by consensus of the group.

Data Synthesis. Formal meta-analysis of the incentive literature was not possible because there were not a large number of studies that examined the same incentive type, research outcome measures, and similar populations. General trends were summarized.

Conclusions. Definitions for neither “prevention” nor “economic incentive” are specifically addressed in the literature. Research on the effects of incentive interventions on preventive care and health promotion appears to be driven by policy considerations. Definitions for preventive care and economic incentives are not emphasized in the literature, not only in terms of locating the incentive intervention within larger environmental contexts, but also with regard to the function of the incentive.

There is little evidence available to support the idea that explicit provider financial incentives, particularly of the modest and artificial nature that were evaluated in the studies, are effective. Further, it appears bonuses do not work simply and easily. In the short run, consumer economic incentives are effective for simple preventive care and distinct behavioral goals that are well defined. There isn't sufficient evidence at this time to say that economic incentives are effective for promoting the long-term lifestyle changes required for health promotion.

The reviewed literature cannot answer whether there is a dose response for provider incentives, although one may assume that a sizable enough incentive should produce the desired behavior, if at a high cost. There is a possible dose response for consumer incentives. Even more interesting for consumer incentives is the effectiveness of relatively modest incentives. The threshold dose appears low.

None of the provider studies and few of the consumer studies undertook to make this calculation, thus it is difficult for us to assess the net predicted benefit of a given financial incentive.

Overall, the scientific quality of the current evidence is fair. While many studies were adequately designed to address the specific research question, the question itself was often uninformative.

Chapter 1. Introduction

Overview

The IOM's recent Quality Chasm report argues that the U.S. health care system requires major re-engineering, including major realignment of incentives, if health care is to provide collaborative quality care and care management and effectively prevent and manage chronic disease.1 Growing recognition of this need for realignment has led in recent years to “pay for quality” initiatives for providers.2 Similar “pay for prevention” initiatives are used to address the gap between the high cost of preventable morbidity and death through recognized disease prevention and health promotion3 and the actual practices of health providers and consumers. These initiatives use explicit, or extrinsic, incentives such as bonuses and cash or other in-kind financial incentives for providers and consumers to engage in specific preventive care or health promotion practices. This report explores the impact of explicit economic incentives targeted at motivating providers and consumers to adopt preventive health behaviors. The review is designed to 1) help develop more effective preventive strategies (evidence-based practice), and 2) help inform key stakeholders about the role of such practices, (evidence-based policymaking). It poses four key questions:

Key Question 1 How have “preventive care” and “economic incentive” been defined in the literature?

Key Question 2 Do incentives work?

Key Question 3 Is there evidence of a dose/response curve?

Key Question 4 What is the evidence for cost-effectiveness of economic incentive interventions?

Background

Conceptual Framework

Disease prevention and health promotion cover a wide spectrum of behaviors for both consumers and providers, from simple, one-time vaccinations to complex behavioral changes such as weight control. Where a particular preventive concern falls on the spectrum is determined by: 1) the complexity of attitudinal or behavioral changes and commitment required by the consumer; 2) the complexity of attitudinal or behavioral changes and commitment required by the provider; and 3) the relative complexity of the prevention technology itself, e.g., nicotine patches or counseling. For the purposes of this study, the determining factor for whether a study was classified as a simple or complex preventive health concern was whether a sustained behavior change over time was required of the consumer.

From an economist's point of view, the proper question to ask is not whether economic incentives work, but rather how large they need to be, when they should be used, and to whom they should be given. It is likely that the impact of a given incentive on preventive behavior will depend on whether the prevention is simple or complex. If one views the creation of an incentive as overcoming barriers of some sort, the magnitude of those barriers will likely be complex functions of social, psychological, and philosophical values, beliefs, attitudes, conscious and sub-conscious cognitive processes. Contextual and economic issues help define and shape the understanding of the perceived problem the incentive is intended to address, and appropriate attention to these issues would improve the potential success of the incentive.

An external file that holds a picture, illustration, etc., usually as some form of binary object. The name of referred object is er-econincf1.jpg.

   Figure 1. Conceptual framework

The basic conceptual model that includes both provider and consumer actions is shown in Figure 1. This model does not reflect a specific theoretical base, but instead describes the actions that occur as preventive services are encouraged. As indicated in Figure 1, prevention and health promotion operate along a pathway of preventive behaviors. The framework condenses the process and begins with the consumer's orientation to a preventive concern. This orientation is partially determined by the level of awareness of the various preventive concerns and their impact on the consumer's health and well-being. Increased levels of awareness may lead the consumer to take responsibility for personal behavioral and lifestyle changes, to seek care or counsel from a health provider, or to be open to unsolicited preventive care or counsel from the health provider. The provider may offer preventive care and health promotion counseling, which the consumer then chooses whether to accept or not. Each place along the pathway represents a possible point to apply economic incentives to change the level of preventive care and health promotion.

Preventive services offered by a provider are likely influenced by many factors in addition to reimbursement concerns. These include factors such as convenience, held beliefs regarding the appropriateness and effectiveness of the preventive service, patient volume, external pressures on clinic office procedures arising from quality programs such as HEDIS, or uncoordinated practice guidelines from multiple managed care organizations. Barriers to changing levels of preventive services offered may include such concerns as resistance to changes in information technology systems, lack of organizational support, incongruence between economic and other philosophical views held by the provider, the opportunity cost of office visit time, and social cognition processes. Even if undertaken, the consequences of preventive care and health promotion counseling may create further unexpected barriers to change. For example, Bowman et al. found that patients reported declines in social and emotional functional status, including mental health, social health, self-esteem, and higher anxiety and depression scores for up to three months after physician recommendations for behavioral change during routine health maintenance visits and suggested such declines may inhibit a physician from making such recommendations.4

Preventive services demanded by the consumer are likewise influenced by many factors. Convenience, out-of-pocket outlays, and held beliefs about the effectiveness of preventive care and health promotion efforts are clearly important, perhaps particularly for the simple preventive concerns. Complex preventive concerns and health promotion, however, requiring sustained effort, over time, may be more strongly impacted by the readiness of the consumer to embrace a behavior change, self-discipline, feelings of self-efficacy and the belief that change is possible, and the willingness of the consumer to accept the provider's authority or collaboration in matters of personal lifestyle. Again, social psychological processes and potential incongruence between economic, patient autonomy and agency, and other philosophical views of the consumer would be expected to come into play.

Table 1. Conceptual framework: Level of action
ParticipateAct
ConsumerAttend educational sessionsAccept service
Change behavior
ProviderIdentify prevention needsGive service
There are, then, many possible attitudes and behaviors within both providers and consumers, and many places along the pathways of preventive care and health promotion, which might be identified to promote or support change. Within the overarching diagram of Figure 1 are the components of simple/complex and levels of action. Providers and consumers have several options that can be influenced by incentives. Table 1 provides a few simple examples within each category. Consumers might be motivated to simply attend sessions where preventive actions might be offered, or they can be induced to actually follow the desired behavior. Likewise, providers can be encouraged to recognize the problem that needs attention and to give the preventive service needed. These actions can occur separately or they could be combined into a comprehensive program. In the case of simple preventive services, such as immunizations, the two levels of action are usually combined; getting a patient in contact with the service can usually mean administering the service.

The financial incentive to provide a service may extend beyond direct reimbursement. The provision of preventive care may enhance the provider's quality reputation and that in turn may lead to increased payments from insurers or patients. Incentives offered to providers could include direct payments to the provider or their group, bonuses, or enhanced status by virtue of profiling, or meeting external regulatory pressures (e.g., HEDIS). Incentives for consumers could include monetary payments and gifts, lower costs for designated services, coverage of necessary components, or lower premiums for those who participate.

The overall perceived value of an incentive may reflect a number of expectations and assumptions held by the provider and consumer. A provider may perceive the incentive, aggregated over the caseload, as inadequate given the case mix as defined by the stages of change. Or, a consumer may give more salience to economic incentives for simple preventive services because the decision to utilize such services requires relatively less cognitive processing. Alternatively, economic incentives may be less salient for complex decisions that require significant cognitive processing which draws on multiple sources of input. Incentives offered to consumers may affect the provider's beliefs and behaviors as well as the consumer's.

Economic and contextual issues may also affect the impact of economic incentives, even well-designed ones, through unnoticed or unintended disincentives. Perhaps of largest concern is the effect of practice environments, including managed care, group practice, and individual practice arrangements, on economic incentives. There is also the potential impact of incentives on trust and patient autonomy within the provider/patient relationship.

Applicable Theory

The purpose of financial incentives is to induce behavior that otherwise would not occur. If appropriately designed, financial incentives move providers and consumers toward better (in a societal sense) behaviors.a Financial incentives can take many forms. Providers can be paid per service provided (often called fee-for service, FFS), paid per service with a bonus or penalty paid based on assessed performance (often called fee-for-service with withhold) on the basis of their costs (often called cost-based or retrospective payment), a fixed payment (often called capitation or prospective payment), or a mixture of payment types.

The ability of several academic disciplines to provide meaningful insight into the question of effective economic incentives touched upon in this introduction, and the complexity of the processes and structures of decision making and processes of care, point out the importance of social ecological approaches to health care improvement. Addressing macro-level economic forces embedded within the health care system, and broad environmental and social supports for healthy and unhealthy behaviors, it is argued, requires multi-component interventions that address multiple factors.2

In a simple world, basic economic theory suggests that providers should be paid the value of their marginal product for the provision of preventive services. However, there are several real world complications that prevent this optimal payment structure from being implemented. First, there are important externalities in preventive care. Disease prevention on the part of one patient (e.g., stop smoking, vaccinations) reduces the health risk to the population as a whole.5 Thus, paying the provider the value of the marginal benefit to a patient would lead to an under-provision of preventive care. Second, the importance of third party payers implies that patients rarely pay the full cost of their care. Third, there are important informational asymmetries between providers and patients and providers and payers. Economic theory has long recognized that the presence of informational asymmetries can result in a wedge between the actual and optimal payment levels. Agency theory and mechanism design branches of economics have arisen to study the role of information and the optimal incentive structures.

Agency theory studies the behavior of two or more groups whose welfare is interdependent but whose incentives are not naturally aligned. An example is the patient-physician relationship. Physicians and patients both need each other, however, physicians may not have the incentive to prevent illness since, in general, the sicker the patient is the more they can earn. Agency theory steps into the problem and designs a payment mechanism that brings the interests of the physician into alignment with the patient. In this example, a solution to this agency problem might be to pay the physician a capitated payment regardless of whether the patient is sick or well. Under this arrangement it is in the physician's interest to have the patient avoid illness thereby reducing the effort and expenditure the physician must spend on treating an ill patient. However, as we show in the following discussion on the basic forms of provider economic incentives, capitation generates other incentives that may be less desirable.

The payment for services is the basic form of economic incentives for providers. Roughly speaking, provider incentives may be divided into two types, FFS or capitation for some portion of the medical services under their control. These two payment methods give physician organizations differing incentives to provide preventive services.

Under FFS it may be difficult for the physician to get reimbursed for implementing preventive services (e.g. smoking/alcohol counseling). Health plans have been disinclined to cover preventive services under FFS payment system because it is difficult to verify if they have been performed. If physicians can attract more patients by performing preventive care, they may be more inclined to do so. In addition, it is difficult ex ante for patients to judge the quality of preventive services provided by physicians and thus they may be unable to select physicians on that basis. Thus, physicians may have little incentive to provide these services if they do not gain more (or better paying) patients for this provision.

Under capitation, since the risk is shifted to the provider, the physician faces many of the same financial incentives to provide preventive care as a health plan. Providers functioning as insurers face a complex web of often offsetting incentives to cover and promote the use of preventive services. They must consider the net cost of its potential preventive care promotion versus the gain in revenue of a given program. Most preventive care, even if cost effective, is not cost saving. Thus, the incentives for a provider to cover a particular preventive service will depend on their ability to recoup the increased cost of preventive care coverage through increases in revenue or through decreased costs due to changing the risk profile of its enrollees. If enrollees appropriately value cost-effective preventive care (and there are several reasons why they may not), then the insurer may indeed increase revenues sufficiently to cover its increased costs through the provision of preventive services.

The financial incentives to provide preventive services under capitation are tied to the ability of the physician to recoup preventive care expenditures. If an enrollee stays with the provider for a long time, it is immediately in the provider's interest, independent of how the enrollees value the service, to cover and promote the use of cost-saving preventive services. However, the time lag between preventive care expenditure and benefits can be long (e.g. diet and exercise).6 Because the provider may not keep an enrollee long enough to benefit from the provision of cost-saving care, they may have little financial incentive to provide this care in spite of the potential societal gain from the provision of these services. Given the disincentive caused by enrollee churning, it likely makes more sense for large employers to engage in preventive interventions. However, while employees stay longer with employers than with health plans, there is still significant turnover of employees and the employer faces the same dilemma as the insurer for the provision of preventive services.

The use of bonuses as a means to direct the attention of the provider to preventive services is a relatively new development within the overall provider remuneration structures. While bonus qualification may be directly linked to a specific procedure, such as immunization, it may also be linked to quality of care measures, of which preventive concerns are only contributing factors.

Conditional upon their health insurance status, consumers typically face a less complex array of direct financial incentives for obtaining preventative services. They may have to pay a co-pay to visit the provider and, if the service is not covered under their insurance or they do not have health insurance, they may have to pay a substantial amount to receive preventative care. Perhaps more relevant for consumers in determining their preventive behavior is the opportunity cost. If the care requires a trip to the physician, the transportation, opportunity cost in time, and the psychological cost of the physician visit may loom larger than the out-of-pocket expenditures. If the preventive activity requires a sustained behavior change(e.g. weight loss), the primary disincentive to engage in this behavior may simply be the cost of the time devoted to preventive care and the discomfort that the new behavior may induce. For example, the financial incentives designed to induce weight loss will have to be sufficient to overcome these time costs and the psychic cost of discomfort.

The first managed care organizations emphasized the role of preventive services in maintaining the overall health of their enrollee population. However, there is a sense that the emphasis on preventive care that was one of the hallmarks of the first HMOs is no longer common among managed care organizations. Thus, it is reasonable to ask: “If health care consumers value preventive services, what might deter health plans from offering these services?” Below we discuss some of the market imperfections that may impede individuals from getting the right amount of care.

First, we note that individuals appear to be price sensitive towards preventive services. Kenkel finds that women with insurance are five percentage points more likely to have breast exams and cervical screenings.7 Mullahy finds that those with insurance are three percentage points more likely to get a flu shot.8 Cherkin et al. finds that $5 co-pay resulted in fewer physical exams.9 In the Rand Health Insurance experiment women with free care were three to seven percentage points more likely to receive preventive care.10

Individuals seeking preventive care face monetary, time, and psychological costs. Poor segments of the population may simply not have the monetary means as they may not have health insurance or the access to the necessary infrastructure (e.g. transportation) to obtain preventive services. Many preventive behaviors by individuals require them to make significant time investments. Changing life style by exercising or quitting smoking is psychologically more costly than getting an immunization. It means giving up things that are pleasant. Sustained change is harder to achieve than one-time events.

Recent developments in economic theory have emphasized the importance of observed departures from the rational decision making model.11–13 These models highlight that individuals may have time-inconsistent preferences and are therefore procrastinators. That is, individuals know that certain behaviors are bad for them, but they are unable to change their behavior even though they realize that changing their behavior would ultimately make them better off. Therefore, in these models, individuals who engaged in unhealthy behaviors may be better off if commitment mechanisms are put in place to help them change their behavior.11

Since many individuals have access to health insurance (or certainly will at age 65) they have less incentive to engage in preventive care, as they will not have to pay the direct cost of treatment. However, the evidence on this indicates that insured individuals are less likely to engage in “dangerous” health behaviors.14 That is, those who select into insurance are likely to be less risk averse or have lower discount rates and therefore invest more in their health. Individuals may already have an incentive to engage in healthy behavior to avoid the disutility of illness.

Information may be an important barrier for individuals in seeking out preventive care. Many individuals rely on their physicians to inform them on what preventive services they should have performed and, as discussed above, physicians may not have the appropriate incentives to inform their patients. It is possible that individuals may not know about the health benefits/risks of certain behaviors/screening. However, there is evidence that people do respond to information regarding health consequences of behavior (e.g., Surgeon General's Report on Smoking, 1962) and diet.15, 16 Furthermore, individuals may not be able to assess their risk of various diseases. There is mixed evidence on whether individuals under or over estimate the risks of particular behaviors. Viscusi et al. find that smokers overestimate the risks associated with smoking.17–19 However, Schoenbaum finds that heavy smokers over-estimate the likelihood they will live to 75.20

Designing the appropriate incentive structures are non-trivial problems requiring an understanding of the information structures (e.g. who knows what and what behaviors are observable or measurable) and the responsiveness of providers, consumers, and payers to different incentive structures. The economics literature within the field of “mechanism design” has devoted significant amounts of effort to understanding the structure of the optimal incentive design. Viewed somewhat differently, instituting a new incentive structure is presumably a response to a perceived problem in how actors in the health care system are currently behaving. It is important to recognize that understanding the source of the problem is required in order to create an appropriate incentive design.

The question necessarily arises then - what would an effective economic incentive arm of a multi-component intervention for preventive care and health promotion look like. This is itself a complex question. While remaining mindful of the larger health care quality context, we can deepen our understanding of the role of economic incentives for preventive care by confining an examination of the literature to those studies which allow us to directly address the effectiveness of economic incentives for preventive care and health promotion.

This review focuses on evaluating the evidence for an intervention intended to modify behaviors, not health states. That is, we are looking for marginal changes in specific behavior embedded within a complex context. As such, study outcome measures should focus on measuring behaviors, such as utilization of preventive services, rather than, or in addition to, patient health outcomes.

This review does not directly assess the impact of HMOs and other managed care organization risk-sharing and payment mechanisms as compared to FFS. While there is considerable and understandable interest in the effects of these larger economic incentives, the focus is on explicit economic incentives for preventive care. In addition, the potentially numerous confounding factors derived from different patient populations, physician populations, and structures and processes of different systems might overwhelm the potential usefulness of a review of explicit incentives.21

Cost Effectiveness

A frequent criticism of the US health care system is that not enough preventive care is performed. In these critiques, several reasons for the dearth of preventive care are usually offered, and the list of causal forces that cap the level of care below what it “should” be is that providers and consumers are not given the appropriate economic incentives to perform or seek out preventive care. However, while the calls for more preventive services have been made, it is unclear whether more preventive services would make the health care system more cost-effective.22

Cost-effectiveness can be thought about in two basic ways: 1) achieving a given preventive goal at a lower cost (sometimes called productive efficiency) and 2) achieving an improvement in health per unit of cost that exceeds a societally acceptable threshold (sometimes called allocative efficiency). Most of the work addressed here is restricted to the first definition, although ultimately the cost effectiveness of the incentive will depend on the cost effectiveness of the underlying preventive behavior it is designed to encourage. Screening for diseases and prevention of illness is very expensive. Russell estimates that if the recommendations of the US Preventive Services Task Force and the American Cancer Society were followed, screening for cervical cancer, prostate cancer, and cholesterol alone would cost as much as $80 billion per year.22 Tengs and Graham conclude that the most cost-effective interventions are not those most frequently used, suggesting that what is needed is not more preventive care, but rather a reallocation of preventive services.23 The Tengs and Graham finding also suggests that the appropriate incentives (financial or otherwise) are not currently in place for providing the right mix of preventive services.

Definitions of Terms for the Study

Prevention. Clinical preventive medicine is that part of preventive medicine concerned with the maintenance and promotion of health and the reduction of risk factors that result in injury and disease.24 The three main types of prevention are primary prevention aimed at not allowing a disease or adverse event to occur, secondary prevention aimed at the early detection of an asymptomatic disease, and tertiary prevention aimed at reducing the adverse consequences of a diagnosed disease. Immunizations are primary preventive acts. So is health promotion, such as smoking cessation, exercise, and attention to nutrition.

In the current environment of growing chronic illness burden and improving identification of risk factors for major diseases such as heart disease, the boundaries between primary, secondary, and tertiary prevention begin to blur. For example, high cholesterol and hypertension, though risk factors, are identified as treatable conditions. However, the purpose of treating high cholesterol is prevention of full-blown heart disease.

The fuzziness of the distinction between prevention and treatment compelled us to place specific boundaries on the literature search in order to narrow the scope of the project. For the purposes of this report, we defined preventive care and health promotion as involving those situations where consumers may consider themselves healthy or physically at risk but not yet labeled with a diagnosis. This would include individual-based health promotion and preventives services as defined in Healthy People 2000 and 2010, but excluding mental health, substance abuse, and health protection concerns such as injury prevention, occupational health and safety, environmental health, and oral health. Tertiary care, including self-care and management of diagnosed chronic illnesses such as diabetes and heart disease, was also excluded. The scope definition accords with the recent US Preventive Services Task Force's scope and selection of topics.12

Prevention and health promotion is the purview of both medical and public health professionals. We recognized this shared contribution by including non-clinical settings, such as worksite and community-based health promotion settings.

Economic Incentive. This review examines explicit incentives targeted at specific individuals, either providers or consumers. Consumer incentives are fairly straightforward and include cash, gifts, lotteries, and other free or reduced price goods and services for the benefit of the specific consumer.

Any provider fee or reimbursement system within health care is by definition an economic incentive. Financial incentives are paid at the organizational level, both at health plan to independent practice associations (IPA), and from IPAs to medical groups. Financial incentives are paid at the direct provider level as well. Financial incentives can be designed to direct attention to different measures of quality of care, utilization management, and other administrative and organizational concerns regarding shared risk and profits. As we are focused on target incentives for specific individuals for preventive care, this review examines incentives that are below the organizational level, directly payable to physicians or other health care staff members, and affect the providers' marginal income, not base income.

Incentives offered to providers could include direct payments or bonuses to the provider or his/her group. It was expected that economic incentives would vary considerably by the nature of the incentive, the components involved, size, frequency, duration, and the conditions that triggered payment of the incentive.

The definitions of preventive care and economic incentives given above are not easily applied cleanly to the literature. Research questions regarding the effectiveness of financial incentives are conceptualized such that they shade into questions regarding insurance status, access to care, and utilization of resources, rather than preventive care behaviors and outcomes. For example, Adams investigated whether fee generosity for Medicaid's Early and Periodic Screening, Diagnostic, and Treatment (EPSTD) program affects the number of physicians providing the services and improved access to care for an underserved population.25 Also, as stated previously, prevention is often used as only one component of quality of care when measuring effectiveness of incentives. For example, Dudley conducted a literature review on the effect of financial incentives on quality of care that relied on IOM's definition of quality (the degree to which health services for individuals and populations increase the likelihood of desired health outcomes and are consistent with current professional knowledge) and included a general category of preventive services utilization as one of eight study outcome measures.26, 27

Chapter 2. Methods

Solicitation of Input and Data

We began the review process conferencing with AHRQ to clarify the scope of the project and other background information. Six experts also agreed to serve as members of a technical expert panel group (TEP, see Appendix A). The comments and suggestions provided by the TEP were helpful in clarifying the conceptual framework used for the project. The research strategy consulting staff at the University of Minnesota Biomedical Library was invaluable in developing the search strategies, which the TEP members also reviewed.

Literature Search

We conducted the searches for both the provider and the consumer incentives simultaneously, as most search terms were in common to both. We identified MEDLINE®, the Cochrane Library, EconLit, Business Source Premier, and PsychInfo as the literature sources for this review. We searched MEDLINE® for relevant articles published between 1966 and 2002 using the strategy shown in Appendix B. Results of this search, transferred to an EndNote database and cleaned of nine duplicate records, identified 306 articles. PsychInfo, EconLit and Business Source Premier, were approached with a very simple strategy of combining keyword searches for “incent$” and “health”. The results of these keyword searches added an additional 76 articles to the database for a total of 382 articles.

The 382 articles were subjected to a review of the abstracts. For the provider incentive review, experimental, quasi-experimental, including observational with controls, and simple pre-post designs were included in this stage of the screening to avoid premature loss of potentially useful information. From this number, eight articles for provider incentives were pulled for full text review. Given the sparsity of the literature, we also conducted a title scan of the 2,834 entries tagged merely as “journal articles” from the original MEDLINE® search results to identify potentially relevant articles. This resulted in an additional eight articles for full text review.

Reference lists from previous systematic reviews,26, 28–37 including the Cochrane Library, were examined as well, resulting in further four articles. In all, including six articles culled from reference lists of articles pulled for full text review, 26 articles were identified for possible inclusion in the structured review for provider incentives.

For the consumer incentives, 50 articles were identified from MEDLINE®, six from PsychInfo, 11 were pulled from review articles. An additional 17 were culled from reference lists of identified studies pulled for review. In total, 84 articles were identified for possible inclusion in the structured review for consumer incentives.

Articles for both provider and consumer incentives were subjected to the inclusion and exclusion criteria using the screening tool found in Appendix C.

Inclusion Criteria

  • Published between 1966 and Oct 2002.

  • Address primary preventive care defined as vaccination, screening, and health promotion behaviors such as smoking cessation and weight loss.

  • Be a primary study.

  • Take place in an industrialized country.

  • Be written in English.

  • Examine preventive care as at least one primary outcome.

Exclusion Criteria

  • Patient adherence to drug therapy. For example, the treatment of tuberculosis, which has been the subject of many adherence studies and could be considered a preventive step because it prevents the spread of the disease, is excluded. For our purposes, primary prevention is defined as occurring pre-diagnosis.

  • Financial rewards for participating in a research study. The economic incentive must be conceived as part of the intervention.

  • Multiple component interventions in which the economic incentive is only one component and the study design precluded analyzing the effect of the incentive separate from the other components. Education and outreach efforts are examples of components in addition to economic incentives. This was most strongly noted with community and education-based prevention programs and worksite health promotion programs.

  • Studies examining payment forms provided by more than one payment system, i.e., HMO vs. FFS were excluded because there are too many potential confounding factors. It was therefore too difficult to isolate the effect of specific economic incentives.

Selection bias is a major concern for outcomes research on economic incentives. The opportunity for self-selection of consumers, in particular, is high, given all of the unmeasured economic and contextual issues that may come into play for any specific economic incentive intervention. A strong research design including randomization greatly minimizes this concern. Therefore, we included only RCTs, time series, and prospective quasi-experimental designs for the structured literature reviews. However, we also provided information from relatively well-designed econometric cross-sectional studies for the provider incentives as another perspective for consideration.

An external file that holds a picture, illustration, etc., usually as some form of binary object. The name of referred object is er-econincf2.jpg.

   Figure 2. Economic incentives search result flow chart

A list of the identified articles was distributed to the TEP members and other colleagues, asking for whether they were aware of other relevant studies that were not represented. No further articles were identified from this query. Figure 2 provides a tree diagram of included and excluded references.

Abstraction

A single data abstraction form for both the provider and consumer incentive reviews was devised during the initial stages of the literature search. Formal meta-analysis of the incentive literature was not possible because there were not a large number of studies that examined the same incentive type, research outcome measures, and similar populations. The abstraction tool was created with the purpose of facilitating the ability to capture emergent themes from the heterogeneous literature. The form was reviewed and commented on by the TEP members, piloted, and subsequently revised. Abstraction of the articles was performed by two independent reviewers. Disagreements were resolved by consensus of the group. See Appendix D for the full abstract forms.

Emergent Themes

Given the lack of consensus and implied, rather than specifically reported, concepts and assumptions underlying explicit economic incentives, we characterized the incentives based on what appeared to emerge as the predominant, if implicit, conceptualizations within the identified studies. We used three different approaches for this process: psychological, economic, and functional views. These characterizations, imposed upon the studies as they are, do not fit perfectly and certainly there is room for debate as to which category each is slotted into.

The psychological approach established four major incentive categories of reward, negative reinforcement and/or punishment, structural barrier removal, and attitudinal barrier removal. The approach was informed by several theories and frameworks that are standard fare in psychological or health services research literature and were directly cited or implied in at least one study article.

One set of psychological theories are the non-motivational operant and information-processing theories. Basic operant or behavioral theory implies a causal model of Stimulus → Organism → Response (SOR) which essentially states an external stimulus acts upon the organism, or human, through reinforcements, and the human responds with a behavior. In the operant view, people respond to stimuli because they were reinforced for responding to those stimuli in the past. Cognitive models introduced into the SOR models a focus on expectations of future reinforcements or rewards, and people's attributions about why they engaged in certain behaviors in the past.

Many of the health psychology theories applied in health services research, such as social learning theory and the Health Belief Model, were outgrowths of SOR models.38, 39 The incentive categories of rewards and negative reinforcement/punishments, then, are incentives or disincentives that act as consequences, reinforcements, or behavioral goals.

A second set of psychological theories views the causal model as Organism → Stimulus → Organism → Response (OSOR). Here, the human is seen as selecting and interpreting stimuli or information based on their individual drives, needs, and orientations. The environment and events surrounding the human are seen as ambiguous enough that a person can apply considerable discretion as to the salience placed on, and interpretation of, these events.

Frame's framework of barriers to the practice of preventive care and health promoting behavior could be viewed as limited attempts to introduce this broader view into the discussion of contributions to preventive health behavior.40 From this perspective, one might apply an incentive as a device to attract attention to what is believed an appropriate stimulus, such as the healthy effects of exercise, increasing the salience of the stimulus, an attitudinal barrier removal.

Several studies also clearly stated the incentive was intended to remove a specific economic structural barrier, such as transportation costs, or lower the cost of a health care service. The majority of structural barrier removals are found within simple preventive care, seven of ten, and both punishment disincentives. Rewards were well represented within both simple (58 percent) and complex (78 percent) preventive care categories.

The economic approach established two major categories based on whether the incentive was triggering a purchasing behavior or income-generating behavior on the part of the participant. “Purchasing behavior” was defined as behavior characterized by a money-saving orientation. In such cases, the participant would realize the benefit of the incentive only through a “purchase” of the targeted behavior or service. Examples would include free postage if a package was mailed, free flu shots if the participant showed at the clinic for immunization, or free nicotine patches if the participant filled the prescription.

“Income-generating behavior” was defined as behavior that leads to a payment of some kind (cash or in-kind transfer). That is, how could the participant maximize the potential money in his or her pocket for discretionary use, either in cash or goods. Examples of this approach would include cash, vouchers and coupons, proceeds from a lottery, and gifts. We note all of the mixed intervention studies were of this category. We found a relatively clean correlation between structural barrier removal and purchasing behavior, and rewards/punishment and income-generating behavior.

The functional approach established categories based on what appeared to be the problem the researchers were intending to address. We identified four major types: facilitating, participating, adhering, and outcome.

“Facilitating incentives” included incentives aimed at making it easier for the consumer to engage in the behavior. This category includes reducing the costs of specific preventive medical services or necessary steps in the process to seek or complete such care.

“Participating incentives” included those incentives aimed at increasing the rate at which consumers participated in a desirable behavior. These incentives attempted to draw people into the specific preventive care or health promotion process in question, to join in, and would include such situations as enticing people to attend educational sessions. It is generally assumed participation in education or other experiential programs that increase understanding of and exposure to a desired behavior will lead to downstream effects of adapting positive health and lifestyle changes. The measure of the effectiveness of the incentives would be reflected in direct measures of the targeted behavior.

“Adhering incentives” are incentives aimed at increasing the rate at which consumers adhered to the specific preventive care guidelines or change in health or lifestyle behaviors. In the case of complex preventive care behaviors, the incentives may be applied to reinforce a behavior until such time as a person's internal motivation is activated and sufficient to sustain the behavior. Direct measures of adhering incentives would then focus on the maintenance of the target behavior.

“Outcome incentives” are incentives that promote achievement of a particular outcome or goal. As both simple and complex preventive care concerns may involve possible multiple paths to achieve the target goal, the researcher would need to take care to assess whether the desired behaviors are actually increased or whether the participant had employed unintended, or even potentially unhealthy, behavior to gain the incentive. For example, a person may choose to attain weight loss through healthy means of exercise and moderate calorie intake or through behaviors such as skipping meals or extreme calorie reduction—behaviors which undermine weight loss in the long run.

Rating Strength of the Evidence

Given the presence of both experimental and quasi-experimental designs within the relevant literature, the checklist for assessing methodological quality devised by Downs and Black41 and recommended by the EPC Technology Report #47, “Strength of the Evidence” was chosen for this project.42 After assessing the checklist for each article, a grade of 1 (poor) to 4 (excellent) was assigned to each article. A minimum level of study validity was assured in part by the selection criteria listed above.

It would be good to remember the social science experiments involving economic incentives differ from clinical trials in that it is not possible to mask the intervention from the patient or provider, nor always blind the researchers to the participant's group assignment. Empirical research into the critical components of social science experimentation is not at the level of clinical trials.42 There is, therefore, necessarily subjectivity and expert opinion involved in the grading process.

In addition, this review is at the edge of evidence-based practice in that it includes econometric studies of the type usually performed to guide policy. Study quality and strength of evidence literature for evidence-based reviews has not addressed econometric research. Thus, we created an assessment tool to assist in this review. (See Appendix E.) The application of the assessment tool was performed by two independent reviewers. Disagreements were resolved by consensus of the group.

Econometric Research

Studies that rely on non-randomized trials (we will refer to these as observational studies) can teach us a great deal about health care provider and consumer behavior.b In fact, data from observational studies in which subject are not randomized into “treatment” categories form the foundation of the empirical body of knowledge for both health economics and medical sociology. However, because the subjects are not randomized, the data analysis often requires special statistical attention to address potential biases induced by the nonrandomization. If the data meet certain criteria and appropriate statistical methods are applied given the nature of the data, observational studies can yield inferences that are equally valid (and in some circumstances the inferences are more easily generalized to real world practice) than those inferences made from a randomized trial. While observational studies can yield valid inferences if the appropriate statistical methods are applied, often those methods are not applied, or there are no methods that can correct for the biases given the nature of the data, and the resulting inferences are incorrect. Thus, in assessing the validity of the conclusions from a body of observational studies, careful consideration of the nature of the data and the appropriateness of the statistical methods is necessary. In order to provide a systematic method for assessing the strength of the evidence for literatures in which observational studies comprise an important component of the body of work, we developed an instrument to assess the validity of a given study's conclusions. This algorithm is provided in Appendix E.

The instrument attempts to jointly assess the quality of the data used in the analysis and, given the nature of the data, the appropriateness of the statistical methods applied to the data. Specifically, the instrument places studies into one of three categories: Very Informative, Informative, and Not Informative. The underlying logic of the instrument is that the greatest risk in making biased inferences from observational studies is from poor identification of the variables of interest from the lack of appropriate exogenous variation in the variables of interest. Thus, the instrument measures two categories of characteristics: ones that may bias the coefficient estimates, and dimensions of the study that affect the generalizability of the findings.

In order to place a given study in one of these three categories the algorithm first assesses if there is the appropriate variation in the data to measure the coefficients of interest. Then, the instrument assesses the nature of the variation in the data. That is, observational studies are at risk for “endogenous” variation in the variables of interest. An endogenous variable is one in which there is correlation between the error term and the right hand side variables. That is, there is some unobserved factor that impacts both the outcome of interest and the intervention thereby confounding inferences regarding the independent impact of the intervention on the outcome. The instrument ascertains whether the data generating process can be viewed as exogenous of the unobserved factors. It is often the case in observational data the variables of interest are endogenous and the study uses an appropriate statistical method to correct for any bias that would result from Ordinary Least Squares analysis. In a given study, if data is likely endogenous, then the instrument asks if appropriate statistical methods have been employed to correct for this potential bias. For a study to be categorized as ‘Very Informative’ it must have both appropriate variation in the data and either exogenous variation in the data or employ an appropriate statistical method to correct for the potential bias (e.g. instrumental variables with appropriate instruments). In addition, for the study to score in the ‘Very Informative’ category it must also score well in the other study criteria.

The other criteria attempt to measure the generalizability of the findings to populations outside of the sample population analyzed in the study and the appropriateness of the statistical methods.

Peer Review Process

Several individual experts in the fields of health economics and preventive medicine independently reviewed an earlier draft of this report. They are acknowledged in Appendix A. In addition we asked our TEP members to review the draft report. We revised the report in response to the suggestions of all these individuals.

Chapter 3. Results

For the literature review on economic incentives for providers, 26 articles were retained for full text review and 19 articles passed the inclusion criteria. All 19 articles were published after 1990. Fourteen of the articles were published since 1995.

The articles were categorized into three classes based on the nature of the economic incentive and study design. The first class includes those nine articles that directly address the impact of targeted economic incentives on provider behavior and represent the main body of articles for the structured review. These articles were subjected to an analysis of the comparability of the nature of the interventions, operational definitions, populations under study, and patterns of outcomes.

The second class includes relevant observational studies that inform the literature on incentives for prevention. The articles that were not included in the formal structural review are discussed in some detail.

The third class includes Medicare and Medicaid demonstration projects. The demonstration projects generally randomized patients to differing levels of covered preventive care benefits and created comparison groups between providers through differing compensation packages. Creating a separate classification for these studies allows us to avoid redundancy of articles between the provider and consumer economic incentives while recognizing the complexity of the interventions.

For the literature review on consumers, 84 articles were retained for full review, with 47 articles passing the inclusion criteria for use in the structured literature review. The consumer research covers a much longer period of time, including articles published from the early 1980s.

Simple vs. Complex Prevention

As discussed earlier, definitions for simple or complex preventive concerns rest on the behavior required of the consumer, not the specific preventive health target. Simple preventive concerns are those situations that involve discrete actions where the specific targeted behavior has an endpoint. Complex preventive concerns are those situations where the consumer's actions must be sustained over time. For example, while smoking cessation is generally conceived as requiring complex lifestyle changes, interventions using economic incentives to increase recruitment to, or decrease attrition from, smoking cessation programs are classified as simple preventive concerns for the purposes of this review. In this case, the behavior in question is attending a program of limited duration, rather than smoking cessation itself .

All studies for provider incentives addressed simple preventive care: six articles examined immunizations, two looked at cancer screening, one looked at prenatal care, one looked at well-child visits, and one examined cholesterol screening. (Numbers do not add to nine as two studies used more than one preventive care measure as an outcome.) Evidence Table 1 in Appendix F provides a list of the included provider studies.

A greater range in preventive concerns was addressed in the consumer literature. Twenty-four articles addressed simple preventive care: seven on immunization, two on cancer screening, two on prenatal care, three on attendance to educational sessions for STD/HIV prevention, one on recruitment for a smoking cessation program, and nine on preventive care followup; cholesterol and tuberculosis screening, cancer screening, and postpartum exams. Twenty-three articles addressed complex preventive care concerns: ten on smoking cessation, two on exercise, seven on obesity and weight loss, and one each on breastfeeding, nutrition, CVD prevention, and cholesterol management. Evidence Tables 2 and 3 in Appendix F provide a list of the included consumer studies.

Key Question 1. How have “preventive care” and “economic incentive” been defined in the literature?

Provider. In general, definitions for neither term are specifically addressed in the literature.

All studies approached preventive care from the perspective of the study's targeted preventive care service. Both Fairbrother, Hanson, Friedman et al. and Fairbrother, Siegal, Friedman et al. explicitly based the operational definition of the immunization outcome on expert panel guidelines.43, 44 Studies by Hillman, Ripley, Goldfarb et al. and Morrow, Gooding, and Clark referenced expert panel guidelines as justification for the chosen outcomes. 45–47 No study provided a conceptual discussion of prevention or the study's outcome measures with regard to the simplicity or complexity of the preventive processes under examination.

While intending to examine the effects of incentive interventions on preventive behavior changes, most studies used operational definitions of prevention that relied on measuring change by recorded activity rather than actual observed behavior changes. Recorded activity allowed for preventive services obtained from other sources as well as from the provider subject to the economic incentive. Thus, apparent increases in preventive services may have reflected improvement in chart documentation procedures rather than actual increases in inoculations. Only Fairbrother, Hanson, Friedman et al. and Fairbrother, Siegal, Friedman et al., included a bonus targeted at increasing inoculations given by a provider, or the provider's staff, as one intervention arm under investigation, and Grady, Lemkau, Lee et al. included a behavioral outcome of mammography referrals.43, 44, 48

No study based the outcome measure on evidence from the literature, nor discussed whether any relevant evidence literature was available to benchmark the preventive behavior of the provider participating in the study. Thus, it is not surprising no study reported examining providers' pre-test performance to verify the level of preventive care provided according to criteria for appropriate levels of preventive care as established by empirical evidence of expert panels. Without this examination, we are unable to assess the potential for ceiling effects.

Only Grady, Lemkau, Lee et al. included a conceptual discussion of economic incentives from the behavioral psychology theoretical perspective.48 No report provided a definition or discussion of financial incentives as a map to locate the chosen intervention design for the study on such attributes as size, eligibility (threshold levels, individual performance, tournament style), or form (fixed or continuous payments).

Consumer. No study provided a conceptual discussion of prevention or health promotion for the study's outcome measures with regard to the simplicity or complexity of the preventive measures being examined. It appears consumer research is generally motivated by policy considerations such as responding to the federal Healthy People initiatives or achieving recommendations of national expert panels.

As seen in Evidence Table 2 in Appendix F, only seven of the 24 simple preventive care and 14 of the 23 complex studies mentioned a theoretical basis for economic incentives in their reporting, with little explicit connection between the theory and the design of the incentive. It appears the incentives themselves are also generally left unexamined, an issue we will explore in greater detail in the discussion on the nature of the interventions. At this point we simply note the lack of a clear and commonly shared conceptual map, or set of maps, for what an incentive is, its intended purpose, and how it is hypothesized to impact the consumer.

As was discussed in the Methods chapter, given the lack of consensus and implied, rather than specifically reported, concepts and assumptions underlying the research, we created categorization schemes based on the themes which emerged from the analysis. These categorization schemes were used to assist in answering Key Questions 2–4.

Key Question 2. Do incentives work?

To answer this question, we first discuss observed study design issues, that is, who was being studied, both the intervention target and the patients involved, what was the nature of the interventions applied, and how was effectiveness measured. We then turn to what can and cannot be said, based on the patterns of outcomes.

Populations under study

Provider.

Provider populations: Among incentives aimed at providers, all incentives were targeted to physicians (Evidence Table 4 in Appendix F), but it was not always clear from the reports whether the financial incentives were paid to the physician or the practice. No published studies targeted incentives to nursing personnel or other physician aides, although physicians could delegate many of the related tasks. The physicians have been located in northeastern section of the United States - Philadelphia,45–47 New York,43, 44, 47, 49 Maryland,50 Connecticut, Delaware, New Hampshire, New Jersey, Pennsylvania,47 Massachusetts,47, 48 and Ohio,48 or the UK51

Incented physicians included family practitioners,43–46 48 general practitioners,46, 48, 51 internal medicine,45, 48 or pediatricians.43, 44, 46 Fox and Phau examined providers of obstetric services.50 Morrow, Gooding, Clark and Kouides, Bennett, Lewis et al. cited otherwise unspecified primary care providers.47, 49

Further, the practice setting itself was often not clearly reported. With the exception of Fox and Phau, it appeared that all of the studies took place in non-academic solo and group practices.50 However, “group” was frequently left undefined. Kouides, Bennett, Lewis et al. and Grady, Lemkau, Lee et al. provided statistics for group practice sizes, with the majority of group practices consisting of less than five physicians.48, 49 Morrow, Gooding, and Clark did not provide evidence but suggested that most participating practices are solo or two-physician practices.47 Those studies not reporting solo or group practice participation examined physicians providing Medicaid care, who often work in solo and small offices. Thus, we might speculate on the possibility that studies have directed target payments to individual physicians through solo and small group practices.

Patient populations: Incented physicians tended to emphasize vulnerable patient populations. Urban, Medicaid-eligible children accounted for three of the four US studies involving childhood immunization.43, 44, 46 Medicaid-eligible women accounted for two of the nine studies.45, 50 The remaining two US studies were with a general HMO population47 and women over age 50 from Dayton, Massachusetts.

Consumer. Patient populations are given in Evidence Table 5 in Appendix F. Populations tended to fall into two broad categories that correlated with the simple/complex classification. Vulnerable populations of low SES, the first category, were the most frequent populations studied for simple preventive care, such as immunizations and cancer screening and followup. This constituted 16 of the 24 simple preventive studies but only four of the 23 complex studies. These populations included active drug users,52–54 teen mothers,55, 56 low-income children with mothers on WIC or AFDC,57, 58 and patients of public clinics and safety-net hospitals.59–63 These populations were also generally considered at high risk for the study's targeted health concern. Worksite employees and general population, generally healthy, middle-class populations for the second category, were most frequently the recruitment base for studies that promoted complex health promotion lifestyle changes.

Very few reports outlined a clear link between the design of the economic incentive and the specific population intended to receive the incentive. The study investigators may have put considerable effort into the design phase of the study, or have been very familiar with the study populations, but this does not come through in the reporting. The information that could be derived from complete reporting of the design process would be beneficial to future researchers.

Nature of the intervention

Provider. In general, studies did not include justification for the specific design of the economic incentive.

Types of incentives: As shown in Evidence Table 6 in Appendix F, most explicit incentives were bonuses potentially payable to all qualifying physicians. The exceptions are the Hillman studies which paid bonuses in a tournament-style manner.45, 46 That is, only the top performing providers are rewarded with bonus incentives. Providers would need to estimate their ability to win such tournaments.

Only a few studies provided data on the range and mean size of bonus payments. Kouides, Bennett, Lewis et al. reported an average $242 bonus.49 This seems to be a very small amount compared to typical physician incomes. In this study physicians created the patient list to target for immunizations. This collaborative involvement in the study may have increased the salience and personal motivation of the provider to reach the immunization goal. Hillman et al. reported bonus averages and ranges that were slightly more significant—up to $4,682 for one study.45, 46 The overall amounts are still small, and since bonuses were paid tournament style to only the top performing or improving sites, the marginal benefit of the bonus would need to be tempered by the physician's expectation of receiving the bonus. Grady, Lemkau, Lee et al. provided token amounts of $50 for achieving the target behavior goal.48

No study provided information on the frequency and timing of payments. Reports also did not include the investment costs the physician or provider may have faced to establish the clinical and office procedures necessary to support production and behavioral changes, or whether they had the time, staff, or office system supports available for such changes to be feasible. We cannot assess from the information provided how these factors, plus the anticipated length of time for the bonus program, would have influenced the physician's decision on whether the incentive was considered financially beneficial.

Incentive conditions: In general, incentives were based either on patient outcomes or physician performance of a behavioral goal (Evidence Table 6 in Appendix F). Six studies used performance bonuses that rewarded the physician for achieving a target outcome rate based on patient utilization, in these instances immunizations43, 44, 46, 49, 51 and cancer screening.45 Grady, Lemkau, Lee et al. applied a performance bonus that rewarded the physician for achieving a target behavior goal, a 50 percent mammography referral rate.48 The Fairbrother studies also pitted the target outcome bonus against a per-input bonus, a more direct way of measuring physician behavior, which paid the physician for each additional shot administered and office visits that brought the child up to date in immunization coverage.43, 44 Morrow, Gooding, Clark et al. examined the effect of adjusted capitation rates partially based on a practice achieving preventive care outcome rates.47 Fox and Phau examined the effect of raised delivery and prenatal visit fees, an incentive based on physician behavior.50

Salience of the incentive: Only the Hillman studies attempted to directly assess awareness of the incentive program within a practice.45, 46 Only 56 percent and 67 percent of sites, respectively, responding to a survey indicated they were aware of the incentive program. As the incentive apparently was communicated to providers through regular HMO communication practices, this design aspect may be more indicative of “real world” responses to incentive programs than the remainder of the studies that involved more direct communication of the experiment to potential participants. Communications from HMOs may be buried under the busyness of a physician's normal daily practice.

The total incentive size paid to any one provider would arguably also impact the salience of an incentive program. While several studies did provide some payout information, as noted above, no study provided an assessment of the relative impact of the incentive on the provider's overall income.

Expectation of payment: Expectation to receive the bonus is also likely to impact a provider's decision to change preventive care behaviors. Physicians may have higher expectations to earn incentive payments if such payments are based on their own behaviors, not utilization behavior of the patients. Expectations would be affected not only by how the criteria of success are determined, but also whether the incentive is potentially payable to all physicians if they meet the target levels, or if the incentive is distributed in a tournament style.

As was mentioned earlier, because reports did not include information on pre-test assessments of preventive care performance against set criteria, it is uncertain whether physicians would have had low or high expectations of earning the incentive payments, regardless of tournament style or the potential for all to qualify.

In short, estimating the chance of receiving the bonus would likely be very difficult for the provider. The provider may not have been aware of his or her starting position when estimating the likelihood of success. Some of the bonus structures were very complex. The provider would have little to no control over the patient's choices regarding whether or not to accept the incented service.

Other factors: Timing of payment and the interplay between financial incentives and performance feedback may potentially impact the effectiveness of the incentive and should be taken into consideration. The studies did not generally address the average time lag between the provider activities which influence the potential for receiving a bonus and the actual receipt of the bonus. If everything else is constant, the longer the delay between the behavior and the reinforcement, the weaker the effect.

Performance incentives include an element of feedback. Feedback may be formal, through the use of reports, or informal, in that receipt of the incentive itself functions as feedback of performance levels. Feedback may also be private or public to all providers participating in the incentive program. As seen in Evidence Table 6 in Appendix F, some studies did include formal feedback reports. However, the studies often did not clarify whether such reports were private or public. Thus, it is difficult to assess the contribution of feedback to the effect of economic incentives. However, it should be noted Grady Lemkau, Lee et al. found a token bonus of $50, intended as a feedback mechanism, was not significant for changed behavior.48

Consumer. Few studies provided justification for the specific design of the chosen economic incentive, although Smith, Weinman, Johnson et al.55 and Kamb, Rhodes, Hoxworth et al.64 noted using focus groups to establish the form and size of the incentive, while Laken and Ager65 cited advice from the study population. Interestingly, while a few articles do mention Prochaska's meta-theory as a basis for the design of educational or motivational counseling sessions, no study discussed the impact of the theory on the design of the incentive.

Although several studies did provide some descriptive information on the uptake and desirability of the study incentive, only nine studies could be said to include direct tests of the uptake of an incentive (Evidence Table 2 in Appendix F). Another ten studies set different forms of economic incentives against each other as a direct test of the desirability of incentive form.

Table 2. Consumer incentive type
Incentive Type Positive Findings to Total Studies
LotteryGiftCashCouponFree MedicalPunishmentTotals
Simple2 of 5 (40%)2 of 5 (40%)5 of 5 (100%)10 of 12 (83%)3 of 4 (75%)3 of 3 (100%)25 of 34 (74%)
Complex4 of 5 (80%)2 of 2 (100%)3 of 6 (50%)2 of 3 (67%)1 of 2 (50%) *6 of 7 (86%)18 of 25 (72%)
Totals6 of 10 (60%)4 of 7 (57%)8 of 11 (73%)12 of 15 (80%)4 of 6 (67%)9 of 10 (90%)43 of 59 (73%)
*

One non-significant study mismatched test for effect of incentive. No direct measure of uptake.

Coupon = coupons, vouchers, gift certificates, free or reduced non-medical services

Free = free or reduced medical services

Punishment:

Punishment for simple category was clearly punishment.

Punishment for complex category was monetary return contracts that included a reward element. Those that measured followup periods showed rebound back to non-significant levels.

Non-significant test was for smoking cessation. The rest were weight loss.

Types of economic incentives: The 59 incentives offered in the studies were highly varied in type and size (Table 2). There were ten lotteries, seven gifts, 11 cash incentives, 15 coupons for free or reduced price goods or non-medical services, six free or reduced price medical services, and ten incentives involving negative reinforcement or the opportunity to avoid punishment.

All lotteries and raffles are included in the lottery category. Five of the ten lotteries were for cash prizes, ranging from $40 to $100. The remaining prizes included a microwave, dinner for two at a local restaurant, travel packages, and groceries. Few studies provided information regarding the expected value of the lottery per participant, leaving it difficult to compare the value against the incentive categories that did not involve uncertainty in receiving the incentive. In addition, lottery values depend on the cognitive processing of assessing expectations, which may or may not be ‘accurate.’ Lotteries were generally used as rewards for adhering, participating, and outcome categories.

Gifts were physical goods provided as incentives. Gifts ranged from a nutritional information package valued at $2 to inexpensive jewelry, baby blankets, and other infant products. Gifts within interventions for the two complex preventive concerns were accompanied by other intervention components such as lotteries, tournaments, and other educational components. Gifts were all given as rewards and evenly split between the adhering and participating categories.

Cash incentives ranged from $5 to return a tuberculosis skin test reading, to a potential $500 over ten months for smoking abstinence. Simple preventive incentives were $5, $10, or $15 per event. Complex preventive incentives ranged from $1 to $25 per payable event, payable from once per week to several months apart, with potential total payment per person, when the information was provided, of $50 to $500. Cash incentives were treated as rewards and were relatively evenly divided between the adhering, participating, and outcome categories.

Coupons included free or reduced-price coupons, vouchers, and gift certificates for non-medical goods and services. The coupon values were generally modest, from $2 to $15, when the values were provided. Coupons might be related to an encouraged healthy behavior, such as exercise passes, farmers markets, and condom purchase; to address barriers such as transportation; or were unrelated to the specific aim of the study, such as haircuts and infant formula. Given the flexible nature of this category, it is not surprising that it is well represented in virtually all categories, with coupons not used for only the outcome category, and more likely to be used for simple, rather than complex, preventive concerns.

Free or reduced cost medical services involved free influenza immunizations, reduced fees for clinic visits, and free or reduced price nicotine replacements. The studies providing this form of incentive viewed price as a barrier to care-seeking and healthy behavior. The values of incentives in this category were generally higher on a per event basis than the other incentive categories (assuming the expected value of an uncertain lottery is less than the face value), ranging from $10 to $25. All free or reduced medical service incentives were categorized as barrier removal and were evenly divided between the facilitating and adhering categories.

The last type of incentive included those interventions that intentionally incorporated a disincentive to exhibit behaviors counter to the desired behavior, including both punishments and negative reinforcement. Punishments were examined in three simple preventive concern studies, all related to vulnerable populations and the receipt of government subsidies. Birkhead LeBaron, Parsons et al. and Kerpelman, Connell, & Gunn required mothers to return to WIC offices more frequently to receive their benefits if the children were not up to date in immunization coverage.57, 58 Kerpelman, Connell, & Gunn tested whether the threat of loss of AFDC benefits for non-immunized children would effectively prompt parents to immunize.58 All three incentives were represented in the adhering category.

The remainder of the studies in this category involved the use of monetary contracts; the participant deposited his/her own money in a contract whereby the money was returned in increments if agreed upon goals were met. The money was forfeited if the goals were not met. Such contracts were often made in the presence of other participants, perhaps working in teams, and the kitty of forfeited money was split among those participants who qualified to participate in the kitty, often by meeting their own health behavior goals. Incentives in this group were evenly split between adhering and outcome categories. No study provided information on incentives per individual when there was potential variability, or in total for the study.

Incentive condition: Seventy-eight percent of incentives required a target behavior of the participant as a condition for the distribution of the incentive. The remainder required the participant to attain a particular outcome. Marcus et al. is unusual in that the free bus-passes were essentially bribes, distributed without any required behavior or outcome from the participant.60 This may have caused some cognitive problems for some participants in that the gift may have created a sense of obligation. However, only 33 percent of the participants reported actually using the bus pass (see Evidence Table 2 in Appendix F).

Multiple components: Several studies included other intervention components that potentially confounded the impact of the incentive. Of interest is the inclusion of other social pressures. Two studies provided incentives not only for the participant, but also for the significant other who was supporting the participant's efforts to change behaviors.66, 67 Another three studies introduced team competition into a worksite health promotion program, where cash prizes were distributed to the teams who best met the health promotion goals.68–70 The reports of these studies did not address the potential effects of these social pressures, whether the results would be positively or negatively affected by them.

Study outcome measures

Provider. Outcomes were primarily measured as the percent of charts documenting compliance with the target outcome, with data collected from chart audits. A chart was generally defined as being in compliance if the preventive care service, such as immunization or mammography, was documented as having occurred whether or not the physician, or his/her office staff, directly provided the service. Grady, Lemkau, Lee et al. differed in that they also measured documented referral rates.48 Denominators for the percentage calculations were based on patients who had visited the provider's office within a set period of time. However, providers who participated in the Kouides, Bennett, Louis et al. study created a target list of Medicare patients from their patient base.49 This list then determined the denominator.

Consumer. All of the simple preventive care studies used hard outcome measures. Complex preventive care studies were perhaps necessarily forced to use self-report in some instances. Smoking cessation has fairly well established valid and reliable laboratory tests available to confirm self-reported abstinence, keeping overall costs of the study lower. While body mass index can be measured and attendance at exercise sessions counted, many relevant lifestyle behavior changes related to health promotion, such as exercise and eating patterns, cannot be directly observed by the investigator.

As mentioned before, unfortunately most studies did not include as primary outcome measures direct tests of the salience and uptake of the economic incentives themselves, as well as the hypothesized effect of the incentive on the preventive behavior. Health outcomes are indirect measures of incentives that are aimed at a behavior that is only one component of a complex chain of events that eventually expresses as obesity or high cholesterol. Enabling a behavior, or reducing an attitudinal barrier, may be a helpful but not necessarily sufficient condition for improved preventive health behaviors.

As shown in Evidence Table 2, generally only the structural barrier removal studies demonstrated direct effects aimed at the true preventive health goal. We see this in only simple preventive health behaviors.

Consistency of outcomes

Table 3. Impact of provider incentives
Study CharacteristicsFrequency of Interventions with Positive EffectsFrequency of Interventions with No Effects
Total studies45
Performance bonus - target outcome33
 Bonus structure - Tournament02
 Bonus structure - All providers have potential to qualify43
 Bonus structure - Reward/punishment01
Performance bonus - target behavior03
Adjusted capitation rates10
Raised fees01
Subgroup analysis - Group practice vs. solo30
Source of bonus - Paid by HMO13
Source of bonus - Not paid by HMO32
Prevention target - Immunizations42
Prevention target - Other13
Provider. As shown in Table 3, outcome patterns were mixed. Target outcome performance bonuses showed positive results in three studies,43, 44, 49 but no results in three studies.45, 46, 51 The three studies showing positive results measured immunization compliance by chart documentation. Provision of the immunization services may have come from sources other than the study provider. Within the Fairbrother studies, outcome measures that directly addressed provider behavior, per-input bonuses, and percent of missed opportunities to provide immunizations, did not show positive results.43, 44 Thus it appears in these cases that the financial incentives were motivating providers to change chart documentation behaviors as opposed to increasing preventive services. In addition, the physicians participating in the Kouides study were required to create the patient list for targeted immunizations.49 This up-front involvement may have increased the awareness of the bonus for the physicians.

Morrow, Gooding, & Clark did show significant increases in the percent of charts in compliance with MMR immunization and cholesterol screening indicators.47 However, the capitation rate adjustments were based on both utilization and improvements in preventive care practices. The analysis did not include controls such as possible rate adjustments due to utilization. The study period also covered a time period when the awareness of prevention and quality of care, in which prevention is included, was increasing in the general physician population. Thus, it is difficult to determine whether the financial incentive itself was the causative factor.

Practice settings: Several studies included practice-level variables in the analyses. Group practices appeared to have better results than solo practices. The Hillman and Ritchie studies found evidence that increases in preventive care were greater for group practices.45, 46, 51 There is uncertainty regarding the effect of remuneration packages for physicians within group practices. Studies did not clearly report who was actually paid the incentives. No data was collected on physicians within group practices who may have been paid salary and whether they participated in the incentives.

Other factors: No other provider or patient characteristics included in the studies were found to be significant. Many factors of interest were not addressed in any study. These would include: how the readiness stage of a provider to change behavior may have affected the salience of the incentive program, the effects of non-economic barriers such as attitudes of the physicians regarding the perceived accuracy of the data, the effects of physician work-flow decisions when only a portion of the patient base may be affected by an MCO incentive program, the effect of the providers' level of knowledge and understanding of the preventive care guidelines, and what was necessary to reach incented target levels.

We also cannot speak to the effect practice area variations would have on effectiveness of incentives in other regions of the country or non-physician health care personnel.

Not all studies reported effect sizes or provided enough information to construct relative risk ratios. Attempts to contact lead authors to obtain such information were met with limited success. Based on what was provided in the articles, the effect size is moderate at best. Economic incentives were responsible for a seven percent increase in documentation of immunizations based on regression analysis in the Kouides, Bennett, Lewis et al. study.49

Table 4. Potential explanations by category
CategoryNumber of Studies
Study design - Insufficient power2
Study design - Inadequate size and duration of bonus5
Study design - Historical trends4
Salience - Physician beliefs and attitudes about the bonus3
Salience - Lack of physician awareness2
Given the mixed outcomes for the provider incentives, it can be informative to look at the explanations offered by the investigators for their findings (Table 4). Both Kouides, Bennett, Lewis et al. and Hillman, Ripley, Goldfarb et al. noted low power for detecting differences in absolute rates.46, 49 However, Hillman also noted it was unlikely that the small effect size a higher powered study could provide would be unlikely to motivate MCOs to commit significant financial resources to target economic incentives.

Five studies specifically pointed to inadequate size and duration of the bonus. Bonuses were too small in either absolute size or relative to the physician's overall income.43–46 48

Four studies cited national trends increasing preventive care in general.45–47, 51 Ritchie, Bisset, Russell et al. noted jawboning of national preventive care goals had already begun to raise awareness and practice levels before the target payments were implemented.51 Likewise, Hillman noted increases in both intervention and control groups mirrored secular national trends.45, 46

Several studies cited physician beliefs, attitudes, and inferences through social cognition processes. Morrow, Gooding, & Clark reported the potential factors of: peer pressure from physician committee or normalizing force of knowing how other offices perform; non-financial motivation of pride in job well-done; and fear of retribution for poor performance.47 Likewise, Fairbrother's studies noted that physicians perceived that the incentive goals were not attainable.43, 44 In particular, the physicians saw their patients as subject to lack of continuity of care and themselves as “sick doctors,” which detracts from their ability to provide the preventive care. Since they were not the primary source for immunizations, they were less likely to take responsibility for patient immunizations. Lastly, Hillman's studies, noted a definite lack of awareness of the bonus on the part of the physician.45, 46

Consumer.

Table 5. Overall positive findings to total consumer studies
FacilitatingParticipatingAdheringOutcomeStructural Barrier RemovalAttitude Barrier RemovalRewardPunishmentPurchasing BehaviorIncome Behavior
Simple6 of 6 (100%)4 of 6 (67%)9 of 12 (75%)0 studies6 of 6 (100%)0 studies10 of 14 (71%)2 of 2 (100%)6 of 7 (86%)13 of 17 (76%)
Complex1 of 1 (100%)4 of 5 (80%)5 of 8 (63%) *10 of 12 (83%)2 of 3 (67%) *1 of 2 (50%)11 of 15 (73%)5 of 6 (83%)7 of 8 (88%)*10 of 15 (67%)
*

One non-significant study mismatched test for effect of incentive. No direct measure of uptake.

Outcome studies - 8 of the 10 positive studies either did not check for long-term results or showed rebound to original levels and non-significant.

Only 1 of the Attitude Barrier studies actually measured change in attitude - negative finding.

Four of the five positive findings for punishment showed rebound to original levels.

Complex reward changes to 12 of 18 (67%) and 9 of 13 (69%) if remove studies which included punishment

Complex income behavior drops to 8 of 19 (42%) and 6 of 15 (40%) with long term results.

Categories: (Table 5) The facilitating category, which included removal of structural barriers, showed significant positive findings. This group of studies demonstrated perhaps the tightest links between incentives, desired outcomes, and direct tests of the uptake of the incentives. However, Marcus' studies stand out in that only a minority of patients self-reported using the bus passes or were logged as turning in vouchers.60, 61 It is possible the population involved had much deeper cognitive and affective barriers, such as denial in a frightening situation where cancer might be detected, and that the structural barrier incentives were not strong enough to overcome the personal barriers.

The studies on disincentives found effective interventions. Caution should be used in interpreting the findings of these studies, however. For the simple preventive concerns, the Birkhead, LeBaron, Parons et al. study took place immediately following a measles epidemic when public attention and concern was running high.57 The findings of Kerpelman, Connell, & Gunn may be overestimations as parental permission was needed to review charts and some families may have left the AFDC program due to the policy of linking immunizations to benefits.58

As rewards, economic incentives for participating and adhering categories, whether for simple or complex preventive concerns, are, in general, effective in prompting people to change their behavior in order to attain the reward. Most studies matched a short-term incentive with a short-term behavioral change or outcome.

When looking at the outcome and penalty categories for complex preventive concerns, however, one begins to see a change. While many of the studies in the outcome and negative reinforcement categories showed positive effects in the short run, of the four studies that checked for long-term results, all the significantly improved measures had returned to original levels and non-significant findings.66, 71–73

In modifying behavior, economic incentives may have unintended consequences which offset the ultimate aim of the incentives. For example, Jeffery and French found cash incentives to participate in group exercise sessions did increase participation.74 However, overall exercise effort, when compared to the control group, was not different. Barring the possibility of over-reporting of exercise due to social desirability, it would appear the participants exchanged the convenience of walking at their choice of location on their own schedules for the group activity in order to maximize the cash incentives.

There may be evidence of a differential in the outcomes of economic definitions categories, although the evidence is too thin to speak with confidence. A significant finding when the majority of people do not actually collect or use the incentive suggests the possibility the impact of the incentive was informational rather than economic. Evidence Table 2 in Appendix F shows four studies that fit this case. Perhaps the incentive generated feelings of social support or cohesiveness, that they and their health are important, improving self-esteem or self-worth. Or perhaps the existence of the incentive sharpened the participant's attention to the health behavior in question.

Alternatively, a finding of not significant may have more to do with an incentive that is not large enough or meaningful enough to the target population than it does with the overall idea that economic incentives may or may not be effective.

Populations: As there is a definite correlation between vulnerable populations, low SES, and simple preventive care, it is difficult to infer whether the effects of incentives are consistent across populations. It would seem reasonable, as discussed above, to suggest that much more information is needed before any such inference could be made with confidence, as the nature of the intervention, type, duration, and frequency, would be dependent upon the target population.

Settings: As seen in Evidence Table 5 in Appendix F, the settings for the studies are quite diverse. It appears that the setting is less a concern than the general question of whether it is appropriate, to some consumers' minds, to offer economic incentives at all within the context of health care. Moran, Nelson, Wofford et al. provided anecdotal evidence from a few participants that questioned providing a lottery to encourage people to get a flu shot.63

Key Question 3. Is there evidence of a dose/response curve?

Provider. Given the paucity of evidence for the effectiveness of provider incentives, we can not address this question for provider incentives at this time.

Table 6. Consumer incentive type by significance
Non-Significant Findings StudiesSignificant Findings Studies
Lotteries:
$50/session + $2,000 travel package. For middle-class people to attend group exercise program.91 (complex)$100/month; a 1 in 10 chance to win over 3 years. For low SES and middle-class people to return monthly nutrition newsletter postcards.74 (complex)
Microwave. For people who showed for community program cholesterol retest.73 (simple)Three travel packages: one week in Hawaii, weekend in San Juan, weekend at local hotel. For self-help smoking members of GHCPS.72 (complex)*
Dinner for two. For car dealership employees attending off-hour smoking cessation class.92 (simple)Five $100 cash prizes; 5 in 29 chance if all participants make goal. For health fair participants with high cholesterol.93 (complex) **
$100 cash. For low SES women returning for post-partum check.65 (simple)Two $40 cash for meeting three-month goal; 1 in 4 chance at $1,000 competitive lottery. For employees of ambulance services.69 (complex)*
$25, $50, and $100 cash prizes. For immunizing parents of children/patients at public clinic.62 (simple)
Three $50 grocery gift certificates. For low SES urban community health center.63 (simple)
Gifts:
Nutritional information package. For community women attending mammography.94 (simple)Nutritional information package. For community women attending mammography.95 (simple)
Jewelry. For low SES women attending post-partum check.55 (simple)Ceramic coffee mug (also lottery). For smoking members of GHCPS in self-help program.72 (complex)*
Baby blanket. For low SES women attending prenatal checks.77 (simple)Turkey buffet and pooled kitty to winning worksites for competitive smoking cessation program. For employees of state government department.71 (complex)**
Gerry Cuddler. For low SES women attending post-partum check.56 (simple)
Cash:
$50 payment. For middle-class worksite employees for cigarette abstinence.96 (complex)$5 cash payment. For active drug users to return for TB skin test reading.53 (simple)
Potential of up to $266 over 18 months; $1 to $3 per exercise session. For middle-class people to attend group exercise program.97 (complex)$10 cash payment. For active drug users to return for TB skin test reading.53 (simple)
$12.50 to $25 per week for 20 weeks. For middle-class people to lose weight.98 (complex)$10 cash payment. For active drug users to return for TB skin test reading.54 (simple)
Two $15 payments. For low SES people to attend STD prevention education.64 (simple)
Three cash payments totaling $35. For active drug users to attend AIDS prevention education.52 (simple)
$5 to $15 per participant for competitive team members. For employees of diverse firms for smoking cessation.70 (complex)*
$1 to $10 per day for six weeks. For mostly hospital workers for decreased smoking.75 (complex)**
$50 for participation, $15/month for abstinence, $1,980 competitive kitty. For employees of aerospace firms for smoking cessation.68 (complex)*
$50/month for smoking abstinence, maximum ten months. For low SES pregnant women.67 (complex)***
Coupons:
Fitness center passes. For lower SES people for attending motivational counseling for exercise program.99 (complex)Free postage. For lower SES people to return completed FOBT.59 (simple)
Bus passes. For lower SES women returning for abnormal pap.100 (simple)Bus passes. For lower SES women returning for abnormal pap.60 (simple)
$5 department store gift certificate. For lower SES women returning for post-partum check.65 (simple)75% off coupons for box of condoms. For young adults for STD prevention.101 (simple)
Coupon for infant formula. For low SES women to attend post-partum check.55 (simple)
Free taxicab fare. For low SES women to attend prenatal visit.77 (simple)
$10 of free bus passes or fast food coupons. For active drug users to return for TB skin test reading.54 (simple)
$10 grocery gift certificate. For active drug users to return for TB skin test reading.54 (simple)
$20 in coupons for farmer's market fresh produce. For low SES women to improve nutrition.102 (complex)**
Two $15 coupons for goods or services. For low SES people to attend STD prevention education.64 (simple)
Free evening day care. For immunizing parents of children/patients at public clinic.62 (simple)
Three grocery gift certificates totaling $35. For active drug users to attend AIDS prevention education.52 (simple)
Multiple kinds, of high frequency and moderate to high value. For low SES women to breast feed.66 (complex)***
Free/Reduced Medical:
Free nicotine patches - did not test for uptake, only effect on cessation.103 (complex)Free or reduced price of $6 or $20 (vs. $24) per pack of nicotine gum. For smoking rural family practice patients.76 (complex)
Voucher for reduced clinic visit. For low SES women for abnormal pap.100 (simple)Voucher for reduced clinic visit. For low SES women for abnormal pap.61 (simple)
Free flu shots. New Zealand104 (simple)
Free flu shots. Denmark78 (simple)
Punishment
Return contracted amount, minimum $5 per paycheck. For worksite employees for smoking abstinence.105 (complex)Return contracted amount, minimum $5 per paycheck. For worksite employees for meeting weight loss goals.105 (complex)**
Return $20 per session for ten sessions. For overweight people to attend meet weight loss goals.106 (complex)**
Return $20 per session for ten sessions. For overweight people to attend weight loss sessions.106 (complex)**
Return $30 per every five pound reduction, up to $150. For overweight people to meet weight loss goals.107 (complex)**
Return $1, $5, or $10 per session for 30 sessions. For overweight people to meet weight loss goals.108 (complex)**
Return $5 per session, 14 sessions; forfeit money split. For mostly female employees of a hospital to attend weight loss sessions.109 (complex)
Return to WIC offices monthly (not bimonthly) for vouchers. For low SES parents of non-immunized children.57 (simple)
Return to WIC offices monthly (not quarterly) for vouchers. For low SES parents of non-immunized children.110 (simple)
Lose AFDC benefits. For low SES parents of non-immunized children.58 (simple)
*

Studies showed rebound of outcomes back to pre-test levels

**

Studies did not follow up participants for long-term effects

***

Incentives also paid to participant's chosen Significant Other

Consumer. There is minimal evidence of a dose response within the consumer research. (Table 6) Of the few studies that offer a direct comparison between different forms of incentives, cash is king. Malotte, Hollingshead, & Rhodes; Kamb, Rhodes, Hoxworth et al., and Deren, Stephen, Davis et al. show that cash incentives were preferred over coupons.52, 54, 64 However, generalizability of this group of studies is extremely limited as the participants were from highly vulnerable populations.

Cash incentives have the expected rank ordering. Malotte, Rhodes, Mais showed a $10 cash incentive was more effective than a $5 incentive.53 Stitzer and Bigelow also showed a rank ordering of $1, $5, and $10 per day incentives for reducing daily cigarette smoking.75 Hughes, Wadland, Fenwick et al. showed price elasticity was higher for $6 vs. $20 than $0 vs. $6, suggesting larger incentive increases had a stronger impact on the participants to reduce daily cigarette intake.76 Malotte suggested the street value of a coupon is half-price off face value, perhaps suggesting another interpretation of the finding that cash is preferred to coupons with an equivalent face value.53

Although more open to interpretation, we might also suggest that coupons are preferred to gifts. Both studies that pitted a coupon incentive to a gift incentive found the coupon the more effective incentive.55, 77 In addition, while coupon incentives were in general effective, with 12 of 15 studies showing positive results, only four of seven gift incentives had positive results, and two of the positive results were potentially confounded by other intervention components comprised of a lottery or competition.

Key Question 4. What is the evidence for cost-effectiveness of economic incentive interventions?

Those limited number of studies that did address cost-effectiveness tended to do so from the perspective of productive efficiency, i.e., examining the cost of achieving the determined preventive goal.

Provider. Among the provider studies, only one study addressed cost-effectiveness and calculated a marginal cost of $3 per additional immunization.49 The study did not provide any other figures against which to weigh this cost.

Consumer. Only seven of the 47 studies included cost-effectiveness calculations for the study itself (Evidence Table 7). In five of the seven cases, a treatment arm that consisted of a similar intervention without the incentive itself was reported to be a more cost-effective approach. In the Freedman and Mitchell study, simply providing a return envelope cost $1.61 per completed and returned fecal occult blood test kit based on a 57 percent compliance rate.59 A stamped, return envelope, increased the cost to $1.71 and improved compliance to 71 percent. Both were more cost-effective than the baseline condition which had a compliance rate of only 37 percent and costs per completed and returned fecal occult blood test of $2.24. Nexoe, Krogstrup, & Ronne found the cost per prevented influenza related death was $3,990 for those who received an invitation letter reminding the patient of the upcoming flu season, versus $17,860 for those who received the letter plus free flu shots.78 Similarly, Yokley and Glenwick estimated the least cost intervention was also a personalized letter prompting parents to immunize their children, at $2.27 per target child who received immunizations.62 Free day care and lottery incentives increased the cost by $4 to $5. Moran, Nelson, Wofford et al. found the cost per additional flu immunization was $3.45 for an educational brochure but $8.74 for the lottery incentive.63 Lastly, in the mixed-incentive group, Gomel, Oldenburg, Simpson et al. found the incentive group to be the least cost effective.69 The cost per “health risk unit” reduced at six months was $26.50 for risk factor education, $24.47 for behavioral counseling, and $49.80 for behavioral counseling and an incentive.

All of the calculations were relatively crude. No study included an attempt to generalize cost-effectiveness over time for the estimated potential population morbidity or mortality that would be affected by a policy decision to implement the economic incentive.

Other Perspectives

In this section we look at the limited pool of observational studies that have attempted to directly address whether preventive services are affected by economic incentives using econometric methods to analyze cross-sectional databases. We also look at what the Medicare/Medicaid demonstrations have to offer.

Econometric studies

Incentives, prenatal care and birth weight. Two studies addressed the relationship between physician payment incentives and the use of prenatal care for Medicaid enrollees. Gray examined the impact of increased Medicaid physician payment generosity and the use of prenatal care and birth outcomes for Medicaid enrollees.79 Gray used individual birth data from the National Maternal and Infant Health Survey and matches the individual data to the state Medicaid payment rate. Gray identified the impact of the payment rate on outcome using a difference-in-difference approach—comparing expected differential outcomes between Medicaid and non-Medicaid enrollees as a function of the generosity of the Medicaid physician payment. This estimation strategy differences out unobserved, state specific effects that might be correlated with the payment rate. However, the difference-in-difference strategy will not correct for unobserved variables that impact the outcome of only one of the groups that might be correlated with the payment rate.

The increases in the payment rate did not significantly impact the use of prenatal care, but increased payment generosity is correlated with fewer low birth weight infants. These results are somewhat puzzling in that it does not identify a mechanism by which increased payments increase birth weight. That is, if increased physician payments are not increasing the use of prenatal care, then how is it that the payments are increasing birth weight? A possible answer is that increased payments are correlated with a more generous menu of financial support available to Medicaid enrollees. In this scenario, the physician payment effect is just an omitted variable bias associated with the researcher not observing other income transfers to the poor.

Oleske, Branca, Schmidt et al. examined the relationship between FFS and capitation payment to physicians in California's Medicaid program, Medi-Cal.80 In the Medi-Cal program counties within California have different contract structures with the physicians and the authors use this difference to identify the impact of capitation payments on the use of prenatal care and birth outcomes. Similar to Gray, they found that capitation payments are not related to the use of prenatal care but lowered the likelihood of low birth weight babies.79 Thus, like Gray, the causal mechanism by which capitation lowers low birth weight outcomes is unclear if it is not through the use of prenatal care. The lack of identifying a causal mechanism increases the likelihood that there might be some omitted variable that is correlated with payment structure and impacts birth outcomes. If the authors had used a difference-in-difference approach similar to Gray, that possibility would have been mitigated to some degree.

NHS. Two econometric studies have examined the impact of incentives on preventive care within Britain's National Health Service (NHS). In 1990, the NHS introduced target-linked payments for pre-school/childhood immunization (as well as cervical cytology). GPs can earn up to £1,800 (in 1990) for achieving 90 percent immunization uptake. Lynch analyzed the uptake data in Greater Glasgow, Scotland, in an attempt to estimate the factors that determine physician group immunization uptake.81 She found that 25 percent of the practices did not achieve the high uptake target. To understand the variance in practice immunization uptake, she regressed (in an OLS framework) the uptake rate on the percentage of the total compensation that the immunizations payments make along with other covariates. The idea is that physicians are more likely to focus on the target payments if they comprise a larger percentage of their income. Consistent with this hypothesis, she found a significant positive relationship between the importance of the immunization payment and the percentage of children immunized. This difference variable explains 28 percent of the variance in immunization rates. However, it is not clear in which direction the causation works here. For example, practices that specialize in pediatrics may have higher immunization rates simply because they focus on that type of care. These are also the same practices that are likely to rely more heavily on the target payments.

Hughes and Yule used aggregate time-series data on payments and care provision rates within the NHS for cervical cytology, maternity care, contraceptive advice, and vaccinations.82 They found little relationship between the rate of use and the payment rates. This is not surprising, as they identified the parameters of interest of time-series variation. Their approach does not allow for the inclusion of most demand side and supply side variables, control variables that are likely to be important. Thus, it is difficult to put much weight on their results.

U.S. Survey Data. Balkrishnan, Hall, Mehrabi et al. examined the relationship between capitation and the number of preventive health counseling visits in the National Ambulatory Medical Care Survey (NAMCS).83 The NAMCS samples approximately 1,200 physicians and the physicians in its sample return approximately an average of 24 patient encounter record forms. The authors regressed the patient specific payment type (FFS or capitation) on the variable on interest. Patients in capitation plans were more likely to receive health counseling and preventive care. However, the authors made no attempt to control for differential selection into physician contract types.1 That said, for physicians that received a mix of FFS and capitation (more than 20 percent capitation patients) there was no difference in care between FFS and capitated patients, suggesting to us that physician selection effect may be important.

Wee, Phillips, Burstin et al. surveyed 4,473 patient charts from 169 physicians in the Boston area to examine the relationship between HEDIS measures and the reported compensation structure (salary versus productivity pay).84 They hypothesized (without much discussion or reference to the economic literature on incentives) that physicians who are paid on a productivity basis are less likely to perform preventive services. They found that physicians with financial productivity incentives in their compensation are less likely to perform certain types of preventive care (Pap smears and cholesterol screening) but there is no difference in the rates of mammography and influenza vaccination (point estimates indicate that productivity compensated physicians are more likely to give influenza vaccines). Like Balkrishnan, Hall, Mehrabi et al. the authors made no attempt to correct for the endogeniety of the contract form.83 For this reason, it is likely that their parameter estimates do not represent causal relationships.83

Medicare/Medicaid demonstrations. During the 1980s, the Health Care Financing Administration conducted several Medicare and Medicaid competitive demonstration projects in order to assess the impact of different competitive interventions on the cost and quality of care. Several of these projects studied the impact of the physician payment structure on the delivery of preventive services. Preventive care services such as immunization, cancer screening, or health promotion counseling were made free to the consumers, through the use of capitation rates or vouchers for FFS. The advantage of these demonstrations is that they can provide payment interventions on a large proportion of a physician's caseload thereby providing a change in an incentive structure that potentially has a large bite on the physician's income. A potential disadvantage of these studies is that the intervention may last only one year, thus physicians may be unwilling to reorganize their work practice when facing a change in payment structure with a short window.

Carey, Weis, Homer et al. examined the impact of capitation on the delivery of preventive services in California and Missouri.85 In this demonstration, all Medicaid eligible people in two counties (Santa Barbara and Jackson) were enrolled in a program that paid the physicians a capitation payment for specifically preventive services. The behavior of physicians in caring for Medicaid enrollees in these counties was then compared to their counterpart physicians in adjacent counties. Carey, Weis, and Homer found little significant difference between the performance of physicians in the demonstration project and in the FFS control group.85

Lave, Ives, Traven et al. reported in several articles the results of a Medicare demonstration project in rural Pennsylvania.86–88 In this project, hospital-based physicians were paid a capitated payment for providing a series of preventive services (influenza vaccinations, health counseling, depression evaluation) while the rest of the physicians were paid for each service provided. Patients were then randomly assigned into each group or a control group. Patients in the treatment arms received vouchers for free preventive services. The authors found those in the treatment arms were more likely to receive influenza vaccinations.86 They also found that while participation rates in the health screenings, nutritional counseling, smoking and alcohol cessation, and depression/dementia services were variable depending on the program and treatment arm, there were no differences in the consumers' use of medical care services or health outcomes between the treatment and control groups. The authors also found little difference in the performance of the physicians across preventive inventions.87 However, because physicians were not randomized into each group. it is difficult to know if the lack of differences is the result of the correlation of the “type” of physician with the payment structure or that mean physician behavior is insensitive to the form of payment.

Ohmit, Furumoto, Dawson et al. examined the impact of free influenza vaccinations in Michigan as part of a community intervention program that included community promotion and outreach, and educational materials and cost reimbursement to the providers.89 The behavior of the consumers was then compared with their counterpart consumers from a comparison county which was not involved in the demonstration. They found the community intervention program, including fully reimbursed shots for the providers, significantly increased the likelihood of consumers receiving an immunization.

Morrissey, Harris, Kincade-Norburn et al. examined the effects of financial and office systems on the level of preventive care as part of a demonstration project in North Carolina.90 Patients were randomized within practices to a treatment or usual-care control group. Patients in the treatment arm were treated by physicians who were fully reimbursed for the preventive care and health promotion packages, and who received office system support for personal reminders of scheduled preventive care, clinic staff to carry out many of the preventive care procedures, and new charting forms for patient records. They found that while screening tests increased significantly, there was evidence of a lack of followup of abnormal findings. Also, there was little difference between the treatment and control groups in health-related quality of life measures at the two year study followup. Again, it was not possible to separate the impact of the financial incentive from the other intervention component of patient prompting and other office system improvement.

Chapter 4. Discussion

Key Question 1. Definitions

Definitions for economic incentives are remarkably absent in the literature, not only in terms of locating the incentive intervention within larger environmental contexts, but also with regard to the function of the incentive. That is, is the incentive to function as a goal state, as an external reinforcement of behaviors until such time as the individual's internal motivation is sufficient, as a reinforcement until habituation, or perhaps as reinforcement until some learning task is accomplished, or simply as a means of directing a person's attention to a neglected area. As a whole, the studies lack a clear and commonly shared conceptual map, or set of maps, for what an incentive is, its intended purpose, and how it is hypothesized to impact the consumer.

In general, research on the effects of incentive interventions on preventive care and health promotion appears to be driven by policy considerations. Policy guidelines developed by national organizations, expert panels, and governmental bodies at the national and state levels provide the goals which in turn determine the operational definitions of preventive care. While advancing understanding for specific health conditions and constituencies, this fact also has the potential to result in a fragmented research agenda that inhibits transferring the gains across varied preventive domains.

We note the imbalance of provider research into simple preventive care, leaving complex preventive care situations quite unexplored. We can only speculate at this time whether issues of data collection, i.e., cost and difficulty, or difficulty in defining a unit of health promotion care are the greater barriers to further research.

Our approach did not address broader concepts of economic incentives such as those implied in the shift from fee-for-service payment to capitation.

Key Question 2. Do Incentives Work?

Provider

There is little evidence available to support the idea that explicit provider financial incentives, particularly of the perhaps modest and artificial nature such as were evaluated in the studies, are effective. The literature is scarce. Further, from the studies that have been performed, it appears bonuses don't work as simply and easily as some may have assumed they would. It would seem we have been functioning under core beliefs regarding the appropriateness and efficacy of financial incentives that have only recently begun to be subjected to examination through either experimentation or well-designed quasi-experimental or observational studies.

While there was some evidence that increases for preventive care were greater for group practices than solo practices, there is not enough evidence to sort out the causes. The improvements could signal increased staff and office system resources available to group practices. As the evidence isn't clear regarding whether the incentives were paid directly to the physician or to the group, the question remains open. Note Debrock and Arnould found that financial incentives were more effective if directed at individual physicians.111

Even in its sparseness, some lessons can be gleaned from the literature. Perhaps most obviously, incentives need to be easily understood; simple, transparent, and have a clear connection between the incentive and the desired behavior. The complexity of the clinical practice and differing reimbursement systems should not be minimized. As MCOs are not homogenous, market penetration of MCOs in a local market is a significant factor in provider behavior.83 Physicians may use a heuristic approach and manage their practices as an amalgam of the various guidelines and procedures required by plans and other reimbursement sources along with their own professional opinion.

Another lesson is that the effects of incentives need to be understood within the larger context of the process of preventive care and health promotion. How far down the stream of preventive care did the effects go? An intervention can change a facilitating preventive care behavior, yet not reach the outcome that is of most importance. Findings of a lack of office procedures to follow up on abnormal findings from preventive screening is an illustration of the importance of this issue.90 Grumbach, Osmond, Vranizan et al. found that over one-third of physicians who reported facing incentives could not specify the amount of their overall income that was involved in bonus payments.112 In addition, attention should be given to the role of other reinforcers such as profiling and feedback.

According to the National Health Care Purchasing Institute monographs,113, 114 the key factors for a successful implementation of explicit target economic incentives, as determined in an interview with a focus group comprised of physicians and plan administrators, included:

  • The size of the financial incentive

  • Peer and/or consumer knowledge of individual provider performance regarding the incentive target

  • Recognition among the physicians of a need for change

  • Support for the incentive program among medical leadership

  • The practicing physician's knowledge and understanding of the performance incentives/sanctions

  • Simplicity and directness of the incentive program

  • Perceived and actual accuracy of the data on which the incentives are based. There is a lack of physician trust in data and data sources.

As a warning, it must be recognized that incentive models perceived as penalizing providers for patient behavior may inadvertently create incentives for providers to drop non-adherent patients.

Consumer

We may guardedly say that in the short run, for simple preventive care and distinct behavioral goals that are well defined, economic incentives are effective. There isn't sufficient evidence to say that economic incentives are effective for promoting the long-term lifestyle changes required for health promotion.

Funding bias may be contributing to our lack of information on the long-term effects of economic incentives. Research proposals to examine whether there is extinction of behaviors after the removal of economic incentives are not as exciting as testing a new intervention.

Perhaps most intriguing was the psychological impact of incentives. The Melnikow et al. study showed a positive effect for free taxi rides when only one of 34 vouchers was redeemed.77 Marcus et al. showed similar findings with the incentive demonstrating a positive effect, yet only 33 percent of the patients used the bus passes provided, and 41.7 percent of those eligible redeemed the reduced clinic fee vouchers.60, 61 It has been noted that participants tend to underestimate the role of external incentives on their behavior.115 This may partly underlie reports that only a handful of participants were swayed by the lotteries or gifts.65, 92, 93

There are also alternative views to the cognitive behavioral models in the studies which may help explain the effect of explicit economic incentives on consumer behavior. These views focus on expectations of future reinforcements or rewards as motivators and people's attributions about why they engaged in certain behaviors in the past. Deci and Ryan view the study of motivation as an “exploration of the energization and direction of behavior” and consider intrinsic motivation to be at least as important a factor in explaining human behavior as drives and external or environmental controls.116 They argue extrinsic motivators, such as economic incentives, actually inhibit intrinsic motivation, the spontaneous, internal experiences that accompany behavior. A person who is intrinsically motivated enjoys the rewards that are inherent in the activity and perform the activity for its own sake. This has the unintended consequence of reducing the likelihood of the desired behavior in the long run.

Curry, Wagner, & Grothaus attempted to address this question directly by testing a form of intrinsic motivation, represented by personalized feedback designed to improve self-efficacy and enhance a direct cognitive link between behavior and outcome, against an extrinsic motivation of gifts and lotteries for smoking cessation.72 While the extrinsic incentive improved participation in the smoking cessation program, abstinence rates post-program were not significantly different from the control group. The intrinsic motivation group, however, showed abstinence rates double those of the control group at followup.

Inhibition of intrinsic motivation, if this view is correct, is particularly important to the complex preventive health concerns found in the lifestyle changes for health promotion. Any economic incentive that is a reward must be viewed by the consumer as temporary support toward a personal goal. To do otherwise would not only impose an economic cost on an already strained system, and a cost that would be difficult to justify from a purely cost-effectiveness stance, it also creates a psychic environment which does not promote the personal responsibility and autonomy of the consumer for his own health.

On the other hand, if extrinsic motivations do not dampen intrinsic motivations, we are unable to infer from the given literature the rate of decline of preventive behavior back to baseline levels or the length of the time gap between the extinction of the incented preventive care behavior and the increase of the intrinsic motivation to whatever is the threshold level that would sustain the preventive or health promoting behaviors.

Special Populations Concerns

Pediatric population. The nature of incentives for children's preventive services differs from that for adults.117 Children's healthcare needs differ from adults. First, children are in a dependent relationship with adults who may not make choices based on the best interest of the child. Incentives need to “actively encourage such access.” Second, children's preventive services take place within a very dynamic context. Children are constantly developing and changing, and it is important to provide regular care and avoid pigeonholing into a specific disease category. Third, intertemporal relationships are even more relevant. A provider of children's preventive care will not reap benefits when a child reaches adulthood. Another provider will.

Vulnerable populations. It should be noted that the use of economic incentives, and the research regarding the incentives, is not without controversy. The ethical problem seen in public programs that threatened withholding public benefits as incentive to induce parents to immunize their children is the fact that the financial penalties were threatened only to people already at high risk for economic deprivation.118 Even simply requiring people to return more frequently to government offices to collect public benefits imposes additional costs. Further, the evaluation research of these programs is often conducted without the oversight of a Human Research Protection Review Board. The ethical imperative in research efforts is to decrease, not potentially increase, the overall risk borne by individuals already at higher risk for deprivation and poor health.118

It is also not surprising that studies that directly tested the desirability of different incentive were focused on high-risk and vulnerable populations, where public health policy and ethical considerations of economic incentives are at the fore. In fact, the opportunity for a natural experiment was created out of the policy decision to change from cash to non-cash incentives in AIDS/HIV prevention outreach programs, due to argument over the ethics of cash incentives to active drug users.52

There is also concern that incentives may further fracture care for vulnerable populations. LeBaron noted in interview followups that low SES mothers did not wish to take their children to mobile clinics for free immunizations because they preferred to see their regular providers for shots.119 Ironically, the providers in the Fairbrother studies, who served a similar vulnerable population, didn't think of themselves as well-care providers, but rather sick-child providers.43, 44 This is a considerable disconnect between the stated needs of the parent and the perceptions of the providers.

Comparison of Provider and Consumer Incentive Research

Research shows a tendency to favor different rubrics for providers and consumers. Consumer research shows much more attention to psychological and behavioral theories. Provider research approaches research from an economics/business perspective. This is perhaps to be expected, given the roles consumers or providers play, and unfortunate in that both roles are played by humans who share in common many social, psychological, and philosophical qualities.

Both provider and consumer incentives evidenced “gaming the system,” that is, adjusting behavior to maximize income production without necessarily increasing the desired behavior. In physicians there was an adjustment in documentation and reimbursement behaviors.43, 44 In turn, consumers appeared to have adjusted where, rather than how much, they exercised.97 Further, Breen, Feuer, Depuy et al. found little increase in reported mammography rates but an increase in reporting using public payment sources for the mammograms after Medicare extended its mammography benefit to reimburse for breast cancer screening mammograms.120

It may seem reasonable to speculate that target incentives for preventive care might be generally welcomed by both providers and consumers as a structurally reinforced motivation for appropriate and quality care. There is evidence from the physician perspective that bonuses based on quality of care, including preventive measures, may promote job satisfaction among physicians.112 Consumers may view bonuses for increasing a service, signaling the health of the consumer comes first, as inherently more trustworthy than financial incentives linked to physician resource use. Incentives of this kind lead to the Supreme Court case regarding the patient's right to sue HMOs for such cost containment efforts.29, 121

In summary, the findings that “artificial” explicit economic incentives do work, but modestly and in the short term, fit well with the growing call for multi-component system changes are often needed to for prevention and health promotion.36, 122

Key Question 3. Dose Response

The reviewed literature cannot answer whether there is a dose response for provider incentives. There does appear to be the possibility of a dose response for consumer incentives. What is perhaps most interesting for consumer incentives is the effectiveness of relatively modest-sized incentives. The threshold for the question “how much” appears low. However, the literature, at best, provides only a tantalizing prospect.

Key Question 4. Cost-Effectiveness

As noted earlier, only a minority of studies addressed cost-effectiveness at all, and most of those came at the question from the more limited perspective of finding a less expensive way to achieve a determined preventive target. None of the provider studies and only a few of the consumer studies under review in this report undertook to address the larger and ultimately more policy-relevant question of the cost per quality life years (QALYs) gained. For the latter question, the cost-effectiveness of an economic incentive ultimately depends on the cost-effectiveness of the underlying preventive service. To evaluate the value of a given financial incentive mechanism, it ultimately requires assessing the benefits of the additional preventive care (usually expressed in terms of QALYs gained) against the total cost of the implementation of the intervention. The first step in this analysis should be the determination of whether the preventive service is, without the extra cost of the financial incentive, cost-effective. As noted by Tengs, Adams, Pliskin et al.,123 many preventive services are not cost-effective—in particular, many screening activities fall into this category. Many of the services targeted in this review did not fall within those identified elsewhere as being adequately cost-effective.124

The relative cost of achieving a preventive goal must consider whether the goal is equally achieved under different strategies and how large a gain was achieved. In some instances, different approaches may prove more effective with different populations or different preventive goals. For example, lower income populations may be more responsive to economic incentives than are wealthier people. Economic incentives appear to work best for more discrete preventive targets.

From the provider perspective, one potential factor not considered as an incentive in the literature is the benefit of free or reduced cost changes for new office/clinic procedure startup costs. Studies that implemented provider feedback or patient followup procedures often provided such services prior to the intervention. Reduced startup costs such as this would allow a provider to reduce investment costs in systems that support preventive care.

An area that has received little attention in analyses of cost-effectiveness with regard to almost any shift in medical practice is the law of unforeseen consequences. Presumably, if a physician is incented to change his/her practice to spend more time on preventive activities, s/he will spend less time on other activities. This shift in emphasis could have health consequences, which are rarely explored. Fontanesi, DeGuire, Holcomb et al. provide one illustration of this concern.125 A question was how physicians were to reasonably “comply with the 136 pediatric preventive quality indicators suggested by the 1997 RAND recommendations, the 25 well-child preventive “interventions” recommended by the US Preventive Services Task Force; the 22 requirements for well-child visits in Early and Periodic Screening, Diagnosis, and Treatment (EPSDT) visits funded by the Health Care Financing Administration (HCFA); the National Committee for Quality Assurance (NCQA) pediatric quality measures; and the AAP's recommendations for anticipatory guidance in place at the time of the study.” The study addressed this issue of tradeoff between services using a time and motion analysis of pediatric well-child visits that did and did not include immunizations in a patient population with unmet primary care needs. The study found no significant difference in total clinic duration or direct patient-provider duration between visits during which patients were immunized and visits during which patients were not immunized, yet charting and updating patient immunization cards alone required over three minutes in time. The investigators suggested that the “price” of immunization delivery in terms of record gathering, review, writing orders, administering the vaccine, and providing parent information is an opportunity cost that comes at the expense of other health care activities.

The pressing policy question is ultimately whether economic incentives are the most cost-effective strategy to promote the delivery of preventive care. If policy makers or providers have made the commitment to invest in more preventive care, specific studies are needed that directly compare the effectiveness (and cost-effectiveness) of economic incentives against other strategies such as information systems, registries, or better information or advertising. Because the infrastructure costs of these approaches are quite different, the cost-effectiveness is likely to vary substantially. These studies may prove to vary with the nature of clientele and the preventive goal.

Assessing the relative cost-effectiveness of interventions to improve provider and consumer participation would pit economic incentives against infrastructure changes. The outcome of the comparison will depend on the time frame. In the short run, economic incentives are likely to prove less expensive, but there is scant evidence that the behavior will sustain once the incentives are withdrawn. Infrastructure changes, by contrast, are more expensive to implement, but once established they should continue to produce their effect.

It is easy to envision infrastructure changes for providers. They might be variations of information systems, such as tickler files or special tags for persons at risk of needing the service; they could even involve systematic searches of the patient data files to develop alert notices. Infrastructure changes for consumers are harder to consider. Most would seem to revolve around some form of direct to consumer advertising, either broadly targeted through the media or by specific target such as educational materials for persons identified as at risk.

Other Perspectives

The Medicare/Medicaid demonstrations illustrate the complexity of understanding the effects of price changes on both the providers who supply the service and the consumer who “purchases” the service. The demonstration projects have provided useful information on the impact of increased benefit coverage and other population or clinic-based efforts to improve preventive services. However, a considerable amount remains to be learned.

General Discussion

Physicians make decisions in an attempt to influence and control patient states. Patients, in turn, make decisions based on their personal values and life context, plus the actions of physicians and other aspects of the heath care environment they experience. Patient and provider decisions interact in the management of the patient's health/disease state over time.

Good decisions typically have high outcome benefits relative to the costs of achieving them. Some decisions are judged to be good because they are capable of achieving positive outcomes. Other decisions are driven by an attempt to avoid negative outcomes. Patient decisions reflect a process of self-regulation in which outcomes are pursued over time in the face of challenges, temptations, and frustrations associated with the experience of their heath-related condition and the health care system that is mobilized to address it.126

Patients' capacity to make decisions is enhanced when 1) patients are given specific information regarding their progress in achieving established health outcomes and 2) this information is discussed with their health care providers.127 Improved patient decision-making impacts patient care by modifying the process physicians use to make decisions. Provider decisions regarding appropriate treatment goals, expectations of patient compliance, as well as actions to ensure progress toward targeted states are altered by informed interaction with knowledgeable patients.

The success of patient decision-making efforts depends on feedback from the consequences of previous actions. Despite having the necessary information, patients frequently fail to act so as to achieve their goals. When individuals fail to act in their own best interests they are often considered to lack the necessary personal agency or self-efficacy.128 Examples of health behaviors related to self-efficacy recently reviewed include exercise, nutrition, weight control, dental health behavior, sexual risk-taking behavior, and addictive behaviors.129

One means of increasing belief in personal agency is to provide information designed to improve the ability to construct, regulate, and evaluate potential courses of action. In the environment of health care, such information can include knowledge of one's health state plus the nature of the health care system and its associated treatment regimens. Especially important is knowledge that enhances patients' capacity to participate in the process of setting goals and choosing means of achieving them.130

For feedback to be effective in altering behavior, it needs to be tailored to the conditions of the task on which performance is assessed.131 Simple outcome feedback is often only weakly related to improvements in performance for single judgments as well more complex problem solving and decision-making tasks.132, 133

In medicine, feedback has been shown to be most effective in bringing about change in physician behaviors when it is keyed to specific components in diagnostic and patient management tasks.134–136 More recent work in a variety of domains has shown that strategies based on customized/personalized information have widespread applicability (and success) in modifying individual decision-making and choice behavior.137, 138

Incentives affect behavior within a framework of patient and provider decisions. In one view, incentives may be thought of as forms of feedback that increase (or decrease) the likelihood of some specific behavior. Incentives in this sense are labeled as either positive or negative depending on the direction of change in behavior they produce.

Incentives are also associated with terms such as reward and punishment and are used by researchers to explain how attention is directed to features of the environment that comprise what is to be learned as well as the strength of the change in behavior they produce. Incentives are also treated as goal objects for decision making, in which case they are associated with the idea of motivation and treated as drivers of behavior.

An important aspect of research on incentives is that they are often linked to the variability of behavior. Thus when the events comprising an incentive are perceived as positive, the variability of an agent's behavior typically decreases as it progresses toward some goal state. However, when an event is perceived as punishment, the variability of responses typically increases, making goal attainment more difficult.

It is often unclear why the behavior of interest (the target of intervention) was not originally demonstrated by the individuals in question. Because patients often adapt to the conditions of the health states they experience, the problem confronting the researcher is to move individuals away from conditions and behaviors with which they are comfortable.139 Without understanding the basis for these adaptations, efforts to accomplish behavioral change (whether on the part of physicians or patients) can be fraught with unanticipated difficulties.140 Under these conditions it may not be surprising that 1) efforts to bring about change frequently meet with failure and 2) the behavioral changes that do occur, are seldom sustained over time.

Practical Implications

Concerns over the quality of care have prompted increasing attention to how to change providers' behaviors. Educational strategies such as guidelines and protocols alone have not proven particularly successful. Economic incentives seem a more direct approach, but this review raises several cautionary flags. The desired behaviors must be very specific and easy to track. Complex rules for success are less effective. The incentive must be of sufficient size to make it worthwhile for the provider to change practice behaviors. In general, offering a chance to win a large prize may be less attractive than the promise of a modest but substantial prize. Moreover, relying on incentives may prove dangerous because it may foster dependency on them. If the provider behaviors are not ingrained, they may disappear when the incentives end or when a new topic is selected to be incentivized.

Those planning to use incentives should be very clear about their goals. Is this intended as a temporary change in behavior or an inducement to make a permanent change? Practitioners feel under great stress and harried by many competing demands for their time. Incentives may buy a temporary priority from the provider, but sustained change in the operation of the practice will require an investment of energy to address the underlying mechanisms that can reinforce the desired behaviors. One might hope that a brief experience in delivering care in a new way, fostered by financial incentives, might lead to permanent changes in the modus operandi of the practice, but there is little empirical evidence to support this hope. Some incentives may be permanent, a direct reward to doing a defined task. Under those conditions, the necessary shifts in practice behavior may be incorporated, but it may be possible to catalyze this transition by studying the logistics of the practice. In many cases, the critical actions rely on simple changes to prompt actions and delegation of authority to support staff. In those cases, the resources earmarked for incentives may be put to more efficient use elsewhere.

The enthusiasm for consumer incentives may be driven by some of the same concerns. Pressures to improve preventive performance may motivate some health care organizations to induce their enrollees to become more active in their own care and health promotion activities. In some cases, it may be possible to simultaneously incent both consumers and providers towards synergistic ends. Consumers seem to be more susceptible to incentives, even modest ones. At least some patients may appreciate the attention that incentive programs represent. However, there is always a temptation to pick the low hanging fruit. The recalcitrant consumers may not be as easily swayed by incentives. The energy required to reach and persuade non-adherent patients may still be high.

Limitations

Although our literature search was thorough and rigorous, it cannot be described as wholly systematic. Our searches started with well-defined search strategies. However, the literature is sparse, crossing many areas, not necessarily tagged by the MeSH headings, and key word searches using “incent$” is not as discriminatory as we would prefer. As noted in Chapter 2, we asked many consultants and colleagues to review the reference list and note if it was missing important studies. No further references were generated through this effort.

As was noted earlier, the heterogeneity of the literature with regard to variety of populations, settings, the nature of the interventions, and outcome measures precluded the more common approaches to aggregating the data such as meta-analysis or even simple comparisons of odds ratios. The research studies were often far more complex or multi-faceted than typical RCTs or observational studies.

Future Research

Overall

As this review highlights, the current evidence is extremely limited in its ability to inform future health care efforts. The limited success of modest and “artificial” incentives to induce long-term change supports the current push for multi-component interventions based on the full environmental or social ecological perspectives such as the McKinley model. There is a need for further studies.

The current work on economic incentives is scattered across topics and approaches. Other work suggests that simple preventive approaches are more cost-effective than complex ones, and economic incentives seem to work best in simple cases. On the other hand, such incentives have not been compared with other strategies, especially in terms of cost-effectiveness. For providers, these alternative approaches usually involve some sort of infrastructure change, such as creating registries or other information systems. Because the goal of such interventions is to create sustained, rather than simply transient, change, perhaps the most desirable research should employ economic incentives to encourage providers to adopt these new systems; but the research should be continued (if the initial results are promising) long enough to assess whether the innovations persist after the incentives are removed.

Future researchers need to be clear about the causal chain of prevention or health promotion being investigated and the purpose of the incentive intervention being considered. More careful definitions of the process of care for a given preventive concern, careful matching of the nature of the economic incentive in terms of type, size, duration, frequency, and the use of other components such as education, social support or competition, are all needed. The black box approach, which leaves the economic and behavioral assumptions underlying the research project unexamined, should be replaced with more well-developed conceptual models.

The large literatures in the social and behavioral sciences on incentives should be brought to bear. Most of the studies reviewed here have not evidenced use of this literature. The research reviewed here generally takes an atheoretical approach to studying incentives. However without a theoretical underpinning it is difficult to understand exactly why the incentive worked or didn't work. Perhaps, more importantly, without a theoretical underpinning the right questions do not get asked.

The first question a study should ask is “What problem is the incentive trying to solve and how is the incentive going to solve this problem?” It is not inherently interesting to ask: “Can I change behavior using incentives?” The answer is certainly “yes” if the incentive is great enough. Rather, a better question is, “Given that a preventive service is underprovided, what is the best incentive mechanism to bring the provision of that service up to its optimal level?” A second important question is then “Given this new incentive is in place, are there other, unintended consequences of this incentive?” Of course, anticipating unintended consequences requires a theoretical framework.

On the surface, it would seem wise to approach economic incentive intervention as mimicking a dose-response curve. That is, start with a dose that should be “therapeutic” and test for the possibility of lower doses. However, as the review highlights with the differential effects of modest incentives for providers and consumers, different levels of economic incentives may trigger different modes of decision-making processes. What are the trigger points which determine whether psychological models or economic models of decision-making are used? When does a person view an economic incentive as input into a cost/benefit equation, a reward as goal object, a removal of a barrier? While not mutually exclusive, each model suggests different sets of hypotheses.

Another important question is how economic incentives compare to and complement other strategies to improve preventive care, particularly with regard to long-term effects. There may be joint effects of intervention components, including incentives, within multi-component research. Do explicit incentives improve, impede, or are they unnecessary when a larger ecological effort is made, especially for consumers?

Attention should be given to measuring the direct impact of the incentive itself. Health outcomes may be too high of a measurement standard for incentives that are designed to address only one behavior pattern within a continuum of preventive care. Many other factors, both controllable and uncontrollable, may come to bear on the achievement of a health outcome even when the consumer or provider adjusted behavior in the manner exactly desired for the incentive.

Natural settings for social science research are important. Randomized controlled trials lose the primacy of gold standard with behavioral change research because many factors remain uncontrollable in the normal busyness of every day life. Adaptation to the environment by the provider or consumer may be either good or bad, but once a person is adapted, it is difficult to get him/her to move. Randomized controlled trials should come only after we can answer why the intervention is needed from this perspective. The difference between controlled trials and “real world” efficacy was demonstrated in the series of studies on the effectiveness of incentives and intensive followup for women with abnormal pap smears. Even though both controlled trials showed positive effects of the economic incentives,60, 61 a planned evaluation of the same interventions using a quasi-experimental design100 was unable to replicate the positive effect. The potential cost-effectiveness of incentives would be erased if positive results of an incentive are fragile enough they only survive in controlled settings.

Mixed-method research projects would also seem an appropriate approach for understanding the effects of incentives within a health or health care setting. Qualitative components, particularly conducted retrospectively with a purposive sampling of participants that captures the range of outcome responses, would do much to advance our understanding and improve future research design. We know very little of the meaning and value of the incentives to the populations they are intended for or the attitudes and beliefs they hold. For example, Moran provided anecdotal evidence that some patients found a lottery inappropriate within health care.63 The bias this belief may create on the findings could be mixed; a feeling of indignation could as easily prompt a person to not receive a flu shot from the clinic in protest as receive the shot while not participating in the lottery.

Personality research and other ways to understand who the people are may provide a step toward understanding what the “problem” is and how to address it. A phenomenological orientation, that it is the world of the perceiver that determines what he will do and not the physical environment, except as the physical environment comes to be represented in the mind of the behaving individual, also requires an understanding of how people differ from one another in how the events come to be represented in the mind. Certainly Prochaska & DiClementi's stages of change meta-theory provides one ready-made conceptual framework with potential usefulness that has not been fully explored.140

Another question that remains unresolved is “What is the right metric for determining if preventive care is truly under-provided?” Possible perspectives are cost-effectiveness, effectiveness, consumer welfare, HMO welfare, or the opportunity cost of other types of care.

Providers. Physicians work in organizations and organizations matter. The dynamics of the organization affect the rules under which physicians work and they affect their financial incentives. Economic incentives do not live in a vacuum. They are often coupled with other incentives. Physicians can be paid a salary, which is viewed as a low-powered incentive, but face the prospect of being fired if they under perform. Physicians face many competing demands on their time and are under the influence of many different incentives (economic and otherwise). It may be difficult for outside actors (government, health plans) to affect the direct incentives of the physician.

Measurement also matters. You can base incentives only on things that you can measure. That means if incentives are paid on the basis of measurable performance there is the potential for slackening of effort in other unmeasurable but potentially important domains of care. The unintended consequences of an economic incentive may wipe out what appeared to be a cost-effective practice.

Paying incentives on health outcome measures for providers becomes a default choice when we cannot measure the process. We are often not able to determine with any sense of confidence what a unit of preventive care services is, such as providing health promotion counseling during both routine checks and provider visits for acute care. Furthermore, success in prevention is generally a non-event. It is much easier to count something that does occur than estimate the number of events that might have occurred but did not.

We need to tease out the differential effects of two major components of economic incentives for physicians: motivation and information content. Physicians often claim they are in a permanent state of stress. Given this stress, they can become resistant to change and incentives can shake up the patterns. When something changes, an incentive can redirect the physician's attention to the new “agenda concern,” often switching one behavior for another in the process. Using an incentive as an “attentional” device is most helpful when we understand what the initial barrier to change is: no desire to change; not enough knowledge; not enough time; overcoming heuristics that are a hindrance.

Future researchers should keep in mind scaleability matters. For an incentive system to be put to use widely, it has to be scaleable. There has to be a clean relationship between the size of the incentives and the behavior that is being encouraged. It must be large enough to make the task seem worthwhile. We know little about how large such incentives need to be.

Consumers. Questions such as who the people are and what motivates their actions are of great importance when designing an economic incentive. Personality research, with its focus on individual differences, offers a potentially useful approach to these questions. For example, some participants in a team competition for cash prizes reported disliking the inherent peer pressure.68 Lotteries engendered feelings of unfairness and created tension among participants in another study.91 Competition and the openness to experiencing gambling uncertainty have differential effects for different personality types.116

Cultural difference is another potential subgroup categorization scheme. Smith et al. found African Americans and Hispanics responded differently to the different economic incentives of infant formula versus a gift of jewelry. They suggested there may be cultural differences in the meaning of gifts.55

A major concern with economic incentives is the potential for the coercive effect of incentives on patient autonomy. No study has actually investigated this concern. As we saw, several studies cited interview or anecdotal evidence that the incentives themselves were not a factor in their decision to seek care. This may point to less concern regarding coercive effects for the likely value level of consumer incentives. On the other hand, the finding of positive effects for an incentive intervention, even when the incentive was not redeemed in several studies, could be interpreted as a psychological vulnerability to manipulation of social obligation through the social desirability response. In addition, Malotte et al. suggested paying people for preventive care behaviors may create an expectation for future payments that may result in even lower participation rates should the expectation be thwarted.54 Smith suggested many of the WIC population may be becoming desensitized to “gifts” from public programs competing for the attention of the beneficiary.55

The benefits from competitions, or tournaments, as an aspect of worksite economic incentive programs may be open to debate as well. Deci and Ryan state there are gender differences in responses to competition, and that competition against another person is less effective for women.116 Of the studies that included tournament-style competitions, 53 percent to 85 percent of the participants were male.

A potentially fruitful area is the possibility for cross-fertilization between health promotion activities and the extensive research conducted around disease management programs. Patient self-care for disease management requires sustained behaviors, also often without apparent immediate “gain” or improvement, and the similarities and differences in patient motivation and patient-provider relationships may be very informative.141

Doctor/Patient Interactions. The patient-provider relationship itself is also important. There is extensive literature in this area that would inform future research on the effects on incentives and how they might impact preventive services and the consumer's acceptance of the provider as a collaborator in health promotion activities. In turn, there may be the potential for differences in the provider's behavior when the provider is aware of lower costs to the patients. Future research should also investigate possible joint effects of coordinated incentives simultaneously applied to both providers and consumers for a particular preventive concern.

Conclusion

If we accept the value of preventive efforts, we must recognize the inadequacies of existing systems to encourage such practices. The literature reviewed here suggests that financial incentives have been used, in an uncoordinated fashion, at three levels in an attempt to increase prevention behaviors: 1) as motivators in the larger economic context at the health plan level, where savings associated with prevention is believed to be efficient, or where market interventions have instituted preventive care performance measures as quality indicators; 2) as provider incentives to induce discrete behavioral changes; and 3) as consumer incentives to remove barriers, improve health education, and reward healthy behavior. System-level economic incentives can help to change the larger health care environment, in turn prompting the individual providers and consumers to adapt to a new environment. Financial incentives, if they are big enough, can influence discrete behavior at the individual level in the short run. The benefits of such incentives may be magnified if they are coordinated with each other and with system level incentives, although this potential synergy remains untested. Whereas provider incentives do work, they may not provide a sustained behavior change. There is always a danger that they will be displaced by a new set targeted at a new topic. So questions remain regarding whether investing in office system changes, including information technology, which support long-term changes in practice, is a better choice than relying on incentives. More importantly, since various observers have noted that the business case for quality improvement is still weak, we must ask who is prepared to bear the cost of either strategy.

Appendix A. Technical Expert Panel Members and Reviewers

Technical Expert Panel Members

We are indebted to the Technical Expert Panel Members for providing both consultation during the development of this project and feedback on the initial draft.

  • Douglas Conrad, PhD, MBA, MHA

  • Director, Center for Health Management Research

  • University of Washington

  • Seattle, WA

  • James Fries, MD

  • Professor of Medicine

  • Stanford University School of Medicine

  • Palo Alto, CA

  • Nicole Lurie, MD, MSPH

  • Senior Natural Scientist and Alcoa Professor of Policy Analysis

  • RAND

  • Arlington, VA

  • Dave Meltzer, MD, PhD

  • Section of General Internal Medicine

  • Harris Graduate School of Public Policy Studies

  • University of Chicago, Department of Economics

  • Chicago, IL

  • Paul Shekelle, MD, PhD, MPH

  • Southern California Evidence Based Practice Center

  • RAND

  • Santa Monica, CA

Reviewers

We are grateful for the constructive feedback provided by the following individuals who reviewed the initial draft of this report. Acknowledgements are made with the explicit statement that this does not constitute endorsement of the report.

  • David Atkins, MD

  • Agency for Healthcare Research and Quality

  • Rockville, MD

  • Brian S. Armour, PhD

  • Centers for Disease Control and Prevention

  • Atlanta, GA

  • James Bare

  • American Academy of Family Physicians

  • Leawood, KS

  • Charles M. Cutler, MD, MS

  • American Association of Health Plans

  • Washington, DC

  • Peter Franks, MD

  • Family and Community Medicine

  • University of California - Davis

  • Davis, CA

  • Jonathan D. Klein, MD, MPH

  • Pediatric Adolescent Medicine

  • University of Rochester

  • Rochester, NY

  • Thomas G. McGuire, PhD

  • Department of Health Care Policy

  • Harvard Medical School

  • Boston, MA

  • C. Tracy Orleans, PhD

  • Robert Wood Johnson Foundation

  • Princeton, NJ

Appendix B. Exact Search Strings

Literature Search Strategy—MEDLINE®

NumberSearch HistoryResults
1Reimbursement, Incentive687
2Capitation Fee3628
3Physician Incentive Plans1096
4Physician's Practice Patterns12718
5incent$6243
6Income30787
7Reimbursement Mechanisms18969
8Fees, Medical4601
9Cost Sharing1684
10Choice Behavior14434
111 or 2 or 3 or 4 or 5 or 6 or 7 or 8 or 9 or 1086379
12Preventive Health Services149047
13Preventive Medicine12582
14Primary Prevention68204
15Health Promotion20460
16Health Behavior41883
17Patient Compliance23515
18Prenatal Care11371
1912 or 13 or 14 or 15 or 16 or 17 or 18323248
2011 and 194649
21Limit to English language4400
22Limit to year 1966-2002, human, non-dentistry3804

Appendix C. Screening Form

graphic element

Appendix D. Abstraction Forms

graphic element
graphic element
graphic element
graphic element
graphic element
graphic element
graphic element
graphic element

Appendix E. Algorithm

Domain ElementsScore (1–5 (poor -appropriate)Importance Category
Study Data Structure: ___ Cross-Section ___ Cross Section/Time Series
1. Is there an appropriate control group in the data?1
2. Can the treatment be viewed as independent of factors unobserved to the researcher or did the researcher employ appropriate methods to correct for selection/attrition/omitted variable bias in the treatment?1
3. Does the study's conclusions follow from the statistical estimates?1
4. Is the set of control variables appropriate?2
5. How closely does the study's objective(s) match the research issue of interest?2
6. How representative of the relevant population is the sample population?2
7. Are the outcome variables reliable measures of the outcome of interest?2
8. Are the treatment variables reliable measures of the intervention of interest?2
9. Are the statistical methods for estimating the effect of the treatment appropriate given the nature of the data?2
10. How precise are the coefficient estimates?2
11. Are the standard errors appropriately calculated given the estimation methodology and the structure of the data?2
Study Category

Study Category:

1. Very Informative (a score of at least 4 in all importance category 1 segments and a mean of 4 across the remaining segments)

2. Informative but questions remain on generalizablity of findings (mean score of 3.5 across all categories and at least a 3 in all categories)

3. Not Informative (all other)

Appendix F. Evidence Tables Continued

References and Included Studies
1.
Institute of Medicine. Crossing the quality chasm: a new health system for the 21st century. Washington, D.C.: National Academy Press; 2001.
2.
Casalino L, Gillies R R, Shortell S M. et al. External incentives, information technology, and organized processes to improve health care quality for patients with chronic diseases. JAMA. 2003 January 22/29;289(4): 43441. [PubMed]
3.
McGinnis J M, Foege W H. Actual causes of death in the United States. JAMA. 1993 Nov 10;270(18): 220712. [PubMed]
4.
Bowman M A, Dignan M, Crandall S. et al. Changes in functional status related to health maintenance visits to family physicians. Journal of Family Practice. 2000; 49(5): 42833. [PubMed]
5.
Philipson T. Economic Epidemiology and Infectious Diseases. In: Newhouse JP, ed. Handbook of health economics. Vol 1B. Handbooks in Economics, vol. 17. Amsterdam; New York and Oxford: Elsevier Science North-Holland; 2000:1761–99.
6.
Dowd B E. Financing preventive care in HMOs: a theoretical analysis. Inquiry. 1982; 19(1): 6878. [PubMed]
7.
Kenkel D S. The Demand for Preventative Medical Care. Applied Economics. 1994; 26(4): 31325.
8.
Mullahy J. It'll Only Hurt a Second? Microeconomic Determinants of Who Gets Flu Shots. Health Economics. 1999; 8(1): 924. [PubMed]
9.
Cherkin D C, Grothaus L, Wagner E H. The effect of office visit copayments on preventive care services in an HMO. Inquiry. 1990; 27(1): 2438. [PubMed]
10.
Lillard L, W. Manning, et al. Preventive Medical Care: Standards, Usage, and Efficacy. Santa Monica, CA: Rand Corporation; 1986.
11.
Gruber J, Koszegi B. Is Addiction “Rational”? Theory and Evidence. Quarterly Journal of Economics. 2001; 116(4): 1261303.
12.
Harris R P, Helfand M, Woolf S H. et al. Current methods of the U.S. Preventive Services Task Force. A review of the process. American Journal of Preventive Medicine. 2001; 20(3S): 2135. [PubMed]
13.
Kahneman D, Tversky A. Prospect Theory: An Analysis of Decision under Risk. Econometrica. 1979; 47(2): 26391.
14.
Kenkel DS. Prevention. Handbook of health economics. In: Culyer AJ & Newhouse JP, eds. Handbooks in Economics. Vol 17. Amsterdam; New York and Oxford: Elsevier Science North-Holland; 2000:1B: 1675–720.
15.
Ippolito P M, Mathios A D. Information, Advertising and Health Choices: A Study of the Cereal Market. Rand Journal of Economics. 1990; 21(3): 45980.
16.
Ippolito P M, Mathios A D. Information and Advertising: The Case of Fat Consumption in the United States. American Economic Review. 1995; 85(2): 915. [PubMed]
17.
Viscusi W K. Do Smokers Underestimate Risks? Journal of Political Economy. 1990; 98(6): 125369.
18.
Viscusi W K. Age Variations in Risk Perceptions and Smoking Decisions. Review of Economics and Statistics. 1991; 73(4): 57788.
19.
Viscusi WK. Smoking: Making the risky decision. New York; Oxford; Toronto and Melbourne: Oxford University Press: x, 170; 1992.
20.
Schoenbaum M. Do smokers understand the mortality effects of smoking? Evidence from the Health and Retirement Survey. American Journal of Public Health. 1997; 87(5): 7559. [PubMed] [Free Full Text in PMC icon.Free Full text in PMC]
21.
Hellinger F J. The impact of financial incentives on physician behavior in managed care plans: a review of the evidence. Medical Care Research and Review. 1996 September;53(3): 294314. [PubMed]
22.
Russell L. Is Prevention Better than Cure? Washington DC: Brookings Institution; 1986.
23.
Tengs T, Graham JD. The opportunity costs of haphazard social investments in life-saving. In: Hahn RW, ed. Risks, Costs, and Lives Saved: Getting Better Results from Regulation. New York: Oxford University Press; 1996:167–82.
24.
Hensrud D D. Clinical preventive medicine in primary care: background and practice: 1. Rationale and current preventive practices. Mayo Clinic Proceedings. 2000; 75(2): 16572. [PubMed]
25.
Adams E K. Factors affecting physician provision of preventive care to Medicaid children. Health Care Financing Review. 2001; 22(4): 926. [PubMed]
26.
Dudley RA, Miller RH, Korenbrot TY, et al. The impact of financial incentives on quality of health care. Milbank Quarterly. 1998;76(4):649–86, 511.
27.
Lohr K N, Schroeder S A. A strategy for quality assurance in Medicare. New England Journal of Medicine. 1990; 322(10): 70712. [PubMed]
28.
Achat H, McIntyre P, Burgess M. Health care incentives in immunisation. Australian & New Zealand Journal of Public Health. 1999; 23(3): 2858. [PubMed]
29.
Armour B S, Pitts M M, Maclean R. et al. The effect of explicit financial incentives on physician behavior. Archives of Internal Medicine. 2001; 161(10): 12616. [PubMed]
30.
Bains N, Pickett W, Hoey J. The use and impact of incentives in population-based smoking cessation programs: a review. American Journal of Health Promotion. 1998; 12(5): 30720. [PubMed]
31.
Briss P A, Rodewald L E, Hinman A R. et al. Reviews of evidence regarding interventions to improve vaccination coverage in children, adolescents, and adults. The Task Force on Community Preventive Services. American Journal of Preventive Medicine. 2000; 18(1 Suppl): 97140. [PubMed]
32.
Chaix-Couturier C, Durand-Zaleski I, Jolly D. et al. Effects of financial incentives on medical practice: results from a systematic review of the literature and methodological issues. International Journal for Quality in Health Care. 2000; 12(2): 13342. [PubMed]
33.
Giuffrida A, Gosden T, Forland F. et al. Target payments in primary care: effects on professional practice and health care outcomes. Cochrane Database of Systematic Reviews. 2000(3): CD000531.
34.
Giuffrida A, Torgerson D J. Should we pay the patient? Review of financial incentives to enhance patient compliance. BMJ. 1997; 315(7110): 7037. [PubMed] [Free Full Text in PMC icon.Free Full text in PMC]
35.
Gosden T, Forland F, Kristiansen I S. et al. Capitation, salary, fee-for-service and mixed systems of payment: effects on the behaviour of primary care physicians. Cochrane Database of Systematic Reviews. 2000(3): CD002215.
36.
Hulscher M E, Wensing M, Grol R P. et al. Interventions to improve the delivery of preventive services in primary care. American Journal of Public Health. 1999; 89(5): 73746. [PubMed] [Free Full Text in PMC icon.Free Full text in PMC]
37.
Stone E G, Morton S C, Hulscher M E. et al. Interventions that increase use of adult immunization and cancer screening services: a meta-analysis. Annals of Internal Medicine. 2002; 136(9): 64151. [PubMed]
38.
Bandura A. Social learning theory. Englewood Cliffs, N.J: Prentice-Hall; 1977.
39.
Rosenstock I. The health belief model: Explaining health behavior through expectancies. In: Glanz K Lewis FM, & Rimer BK, eds. Health Belief and Health Education. San Francisco: Jossey Bass Publishers; 1990.
40.
Frame P S. Health maintenance in clinical practices: strategies and barriers. American Family Physicia. 1992; 45: 1192200.
41.
Downs S H, Black N. The feasibility of creating a checklist for the assessment of the methodological quality both of randomised and non-randomised studies of health care interventions. Journal of Epidemiology & Community Health. 1998; 52(6): 37784. [PubMed]
42.
West S, King V, Carey T, et al. Systems to Rate the Strength of Scientific Evidence. Rockville, MD: Agency for Healthcare Research and Quality; 2002. 47.
43.
Fairbrother G, Hanson K L, Friedman S. et al. The impact of physician bonuses, enhanced fees, and feedback on childhood immunization coverage rates.[comment]. American Journal of Public Health. 1999; 89(2): 1715. [PubMed] [Free Full Text in PMC icon.Free Full text in PMC]
44.
Fairbrother G, Siegel M J, Friedman S. et al. Impact of financial incentives on documented immunization rates in the inner city: results of a randomized controlled trial. Ambulatory Pediatrics. 2001; 1(4): 20612. [PubMed]
45.
Hillman A L, Ripley K, Goldfarb N. et al. Physician financial incentives and feedback: failure to increase cancer screening in Medicaid managed care. American Journal of Public Health. 1998; 88(11): 1699701. [PubMed] [Free Full Text in PMC icon.Free Full text in PMC]
46.
Hillman A L, Ripley K, Goldfarb N. et al. The use of physician financial incentives and feedback to improve pediatric preventive care in Medicaid managed care. Pediatrics. 1999; 104(4 Pt 1): 9315. [PubMed]
47.
Morrow R W, Gooding A D, Clark C. Improving physicians' preventive health care behavior through peer review and financial incentives. Archives of Family Medicine. 1995; 4(2): 1659. [PubMed]
48.
Grady K E, Lemkau J P, Lee N R. et al. Enhancing mammography referral in primary care. Preventive Medicine. 1997; 26(6): 791800. [PubMed]
49.
Kouides R W, Bennett N M, Lewis B. et al. Performance-based physician reimbursement and influenza immunization rates in the elderly. The Primary-Care Physicians of Monroe County. American Journal of Preventive Medicine. 1998; 14(2): 8995. [PubMed]
50.
Fox M H, Phua K L. Do increases in payments for obstetrical deliveries affect prenatal care? Public Health Reports. 1995; 110(3): 31926. [PubMed] [Free Full Text in PMC icon.Free Full text in PMC]
51.
Ritchie L D, Bisset A F, Russell D. et al. Primary and preschool immunisation in Grampian: progress and the 1990 contract. BMJ. 1992; 304(6830): 8169. [PubMed] [Free Full Text in PMC icon.Free Full text in PMC]
52.
Deren S, Stephens R, Davis W R. et al. The impact of providing incentives for attendance at AIDS prevention sessions. Public Health Reports. 1994; 109(4): 54854. [PubMed] [Free Full Text in PMC icon.Free Full text in PMC]
53.
Malotte C K, Rhodes F, Mais K E. Tuberculosis screening and compliance with return for skin test reading among active drug users. American Journal of Public Health. 1998; 88(5): 7926. [PubMed] [Free Full Text in PMC icon.Free Full text in PMC]
54.
Malotte C K, Hollingshead J R, Rhodes F. Monetary versus nonmonetary incentives for TB skin test reading among drug users. American Journal of Preventive Medicine. 1999; 16(3): 1828. [PubMed]
55.
Smith P B, Weinman M L, Johnson T C. et al. Incentives and their influence on appointment compliance in a teenage family-planning clinic. Journal of Adolescent Health Care. 1990; 11(5): 4458. [PubMed]
56.
Stevens-Simon C, O'Connor P, Bassford K. Incentives enhance postpartum compliance among adolescent prenatal patients. Journal of Adolescent Health. 1994; 15(5): 3969. [PubMed]
57.
Birkhead G S, LeBaron C W, Parsons P. et al. The immunization of children enrolled in the Special Supplemental Food Program for Women, Infants, and Children (WIC). The impact of different strategies. JAMA. 1995; 274(4): 3126. [PubMed]
58.
Kerpelman L C, Connell D B, Gunn W J. Effect of a monetary sanction on immunization rates of recipients of aid to families with dependent children. JAMA. 2000; 284(1): 539. [PubMed]
59.
Freedman J D, Mitchell C K. A simple strategy to improve patient adherence to outpatient fecal occult blood testing. Journal of General Internal Medicine. 1994; 9(8): 4624. [PubMed]
60.
Marcus A C, Crane L A, Kaplan C P. et al. Improving adherence to screening follow-up among women with abnormal Pap smears: results from a large clinic-based trial of three intervention strategies. Medical Care. 1992; 30(3): 21630. [PubMed]
61.
Marcus A C, Kaplan C P, Crane L A. et al. Reducing loss-to-follow-up among women with abnormal Pap smears. Results from a randomized trial testing an intensive follow-up protocol and economic incentives. Medical Care. 1998; 36(3): 397410. [PubMed]
62.
Yokley J M, Glenwick D S. Increasing the immunization of preschool children; an evaluation of applied community interventions. Journal of Applied Behavior Analysis. 1984; 17(3): 31325. [PubMed] [Free Full Text in PMC icon.Free Full text in PMC]
63.
Moran W P, Nelson K, Wofford J L. et al. Increasing influenza immunization among high-risk patients: education or financial incentive? American Journal of Medicine. 1996; 101(6): 61220. [PubMed]
64.
Kamb M L, Rhodes F, Hoxworth T. et al. What about money? Effect of small monetary incentives on enrollment, retention, and motivation to change behaviour in an HIV/STD prevention counselling intervention. The Project RESPECT Study Group. Sexually Transmitted Infections. 1998; 74(4): 2535. [PubMed]
65.
Laken M P, Ager J. Using incentives to increase participation in prenatal care. Obstetrics & Gynecology. 1995; 85(3): 3269. [PubMed]
66.
Sciacca J P, Phipps B L, Dube D A. et al. Influences on breast-feeding by lower-income women: an incentive-based, partner-supported educational program. Journal of the American Dietetic Association. 1995; 95(3): 3238. [PubMed]
67.
Donatelle R J, Prows S L, Champeau D. et al. Randomised controlled trial using social support and financial incentives for high risk pregnant smokers: significant other supporter (SOS) program. Tobacco Control. 2000; 9(Suppl 3): III679. [PubMed]
68.
Koffman D M, Lee J W, Hopp J W. et al. The impact of including incentives and competition in a workplace smoking cessation program on quit rates. American Journal of Health Promotion. 1998; 13(2): 10511. [PubMed]
69.
Gomel M, Oldenburg B, Simpson J M. et al. Work-site cardiovascular risk reduction: a randomized trial of health risk assessment, education, counseling, and incentives. American Journal of Public Health. 1993; 83(9): 12318. [PubMed] [Free Full Text in PMC icon.Free Full text in PMC]
70.
Klesges R C, Glasgow R E, Klesges L M. et al. Competition and relapse prevention training in worksite smoking modification. Health Education Research. 1987; 2(1): 514.
71.
Gottlieb N H, Nelson A. A systematic effort to reduce smoking at the worksite. Health Education Quarterly. 1990; 17(1): 99118. [PubMed]
72.
Curry S J, Wagner E H, Grothaus L C. Evaluation of intrinsic and extrinsic motivation interventions with a self-help smoking cessation program. Journal of Consulting & Clinical Psychology. 1991; 59(2): 31824. [PubMed]
73.
Owen N, James R, Henrikson D. et al. Community cholesterol screenings: The impact of follow-up letters and incentives on retest rates and biometric changes in follow-up screenings. American Journal of Health Promotion. 1990; 5(1): 5861.
74.
Jeffery R W, French S A. Preventing weight gain in adults: the pound of prevention study. American Journal of Public Health. 1999; 89(5): 74751. [PubMed] [Free Full Text in PMC icon.Free Full text in PMC]
75.
Stitzer M L, Bigelow G E. Contingent payment for carbon monoxide reduction: Effects of pay amount. Behavior Therapy. 1983; 14(5): 64756.
76.
Hughes J R, Wadland W C, Fenwick J W. et al. Effect of cost on the self-administration and efficacy of nicotine gum: A preliminary study. Preventive Medicine. 1991; 20(4): 48696. [PubMed]
77.
Melnikow J, Paliescheskey M, Stewart G K. Effect of a transportation incentive on compliance with the first prenatal appointment: a randomized trial. Obstetrics & Gynecology. 1997; 89(6): 10237. [PubMed]
78.
Nexoe J, Kragstrup J, Ronne T. Impact of postal invitations and user fee on influenza vaccination rates among the elderly. A randomized controlled trial in general practice. Scandinavian Journal of Primary Health Care. 1997; 15(2): 10912. [PubMed]
79.
Gray B. Do Medicaid physician fees for prenatal services affect birth outcomes? Journal of Health Economics. 2001; 20(4): 57190. [PubMed]
80.
Oleske D M, Branca M L, Schmidt J B. et al. A comparison of capitated and fee-for-service Medicaid reimbursement methods on pregnancy outcomes. Health Services Research. 1998; 33(1): 5573. [PubMed] [Free Full Text in PMC icon.Free Full text in PMC]
81.
Lynch M L. The uptake of childhood immunization and financial incentives to general practitioners. Health Economics. 1994; 3(2): 11725. [PubMed]
82.
Hughes D, Yule B. The effect of per-item fees on the behaviour of general practitioners. Journal of Health Economics. 1992; 11(4): 41337. [PubMed]
83.
Balkrishnan R, Hall M A, Mehrabi D. et al. Capitation payment, length of visit, and preventive services: evidence from a national sample of outpatient physicians. American Journal of Managed Care. 2002; 8(4): 33240. [PubMed]
84.
Wee C C, Phillips R S, Burstin H R. et al. Influence of financial productivity incentives on the use of preventive care. American Journal of Medicine. 2001; 110(3): 1817. [PubMed]
85.
Carey T, Weis K, Homer C. Prepaid versus traditional Medicaid plans: effects on preventive health care. Journal of Clinical Epidemiology. 1990; 43(11): 121320. [PubMed]
86.
Lave J R, Ives D G, Traven N D. et al. Participation in health promotion programs by the rural elderly. American Journal of Preventive Medicine. 1995; 11(1): 4653. [PubMed]
87.
Lave J R, Ives D G, Traven N D. et al. Evaluation of a health promotion demonstration program for the rural elderly. Health Services Research. 1996; 31(3): 26181. [PubMed] [Free Full Text in PMC icon.Free Full text in PMC]
88.
Ives D G, Lave J R, Traven N D. et al. Impact of Medicare reimbursement on influenza vaccination rates in the elderly. Preventive Medicine. 1994; 23(2): 13441. [PubMed]
89.
Ohmit S E, Furumoto-Dawson A, Monto A S. et al. Influenza vaccine use among an elderly population in a community intervention. American Journal of Preventive Medicine. 1995; 11(4): 2716. [PubMed]
90.
Morrissey J P, Harris R P, Kincade-Norburn J. et al. Medicare reimbursement for preventive care. Changes in performance of services, quality of life, and health care costs. Medical Care. 1995; 33(4): 31531. [PubMed]
91.
Wing R R, Jeffery R W, Pronk N. et al. Effects of a personal trainer and financial incentives on exercise adherence in overweight women in a behavioral weight loss program. Obesity Research. 1996; 4(5): 45762. [PubMed]
92.
Emont S L, Cummings K M. Using a low-cost, prize-drawing incentive to improve recruitment rate at a work-site smoking cessation clinic. Journal of Occupational Medicine. 1992; 34(8): 7714. [PubMed]
93.
Francisco V T, Paine A L, Fawcett S B. et al. An experimental evaluation of an incentive program to reduce serum cholesterol levels among health fair participants. Archives of Family Medicine. 1994; 3(3): 24651. [PubMed]
94.
Mayer J A, Clapp E J, Bartholomew S. et al. Facility-based inreach strategies to promote annual mammograms. American Journal of Preventive Medicine. 1994; 10(6): 3536. [PubMed]
95.
Mayer J A, Kellogg M C. Promoting mammography appointment making. Journal of Behavioral Medicine. 1989; 12(6): 60511. [PubMed]
96.
Windsor R A, Lowe J B, Bartlett E E. The effectiveness of a worksite self-help smoking cessation program: a randomized trial. Journal of Behavioral Medicine. 1988; 11(4): 40721. [PubMed]
97.
Jeffery R W, Wing R R, Thorson C. et al. Use of personal trainers and financial incentives to increase exercise in a behavioral weight-loss program. Journal of Consulting & Clinical Psychology. 1998; 66(5): 77783. [PubMed]
98.
Jeffery R W, Forster J L, Baxter J E. et al. An empirical evaluation of the effectiveness of tangible incentives in increasing participation and behavior change in a worksite health promotion program. American Journal of Health Promotion. 1993; 8(2): 98100. [PubMed]
99.
Harland J, White M, Drinkwater C. et al. The Newcastle exercise project: a randomised controlled trial of methods to promote physical activity in primary care. BMJ. 1999; 319(7213): 82832. [PubMed] [Free Full Text in PMC icon.Free Full text in PMC]
100.
Kaplan C P, Bastani R, Belin T R. et al. Improving follow-up after an abnormal pap smear: results from a quasi-experimental intervention study. Journal of Womens Health & Gender-Based Medicine. 2000; 9(7): 77990.
101.
Dahl D W, Gorn G J, Weinberg C B. Encouraging use of coupons to stimulate condom purchase. American Journal of Public Health. 1999; 89(12): 18669. [PubMed] [Free Full Text in PMC icon.Free Full text in PMC]
102.
Anderson J V, Bybee D I, Brown R M. et al. 5 a day fruit and vegetable intervention improves consumption in a low income population. Journal of the American Dietetic Association. 2001; 101(2): 195202. [PubMed]
103.
Dey P, Foy R, Woodman M. et al. Should smoking cessation cost a packet? A pilot randomized controlled trial of the cost-effectiveness of distributing nicotine therapy free of charge. British Journal of General Practice. 1999; 49(439): 1278. [PubMed] [Free Full Text in PMC icon.Free Full text in PMC]
104.
Satterthwaite P. A randomised intervention study to examine the effect on immunisation coverage of making influenza vaccine available at no cost. New Zealand Medical Journal. 1997; 110(1038): 5860. [PubMed]
105.
Jeffery R W, Forster J L, French S A. et al. The Healthy Worker Project: a work-site intervention for weight control and smoking cessation. American Journal of Public Health. 1993; 83(3): 395401. [PubMed] [Free Full Text in PMC icon.Free Full text in PMC]
106.
Jeffery R W, Thompson P D, Wing R R. Effects on weight reduction of strong monetary contracts for calorie restriction or weight loss. Behaviour Research & Therapy. 1978; 16(5): 3639. [PubMed]
107.
Jeffery R W. et al. Effectiveness of monetary contracts with two repayment schedules of weight reduction in men and women from self-referred and population samples. Behavior Therapy. 1984; 15(3): 2739.
108.
Jeffery R W, Gerber W M, Rosenthal B S. et al. Monetary contracts in weight control: effectiveness of group and individual contracts of varying size. Journal of Consulting & Clinical Psychology. 1983; 51(2): 2428. [PubMed]
109.
Follick M J, Fowler J L, Brown R A. Attrition in worksite weight-loss interventions: the effects of an incentive procedure. Journal of Consulting & Clinical Psychology. 1984; 52(1): 13940. [PubMed]
110.
Hutchins S S, Rosenthal J, Eason P. et al. Effectiveness and cost-effectiveness of linking the special supplemental program for women, infants, and children (WIC) and immunization activities. Journal of Public Health Policy. 1999; 20(4): 40826. [PubMed]
111.
Debrock L, Arnould R J. Utilization control in HMOs. Quarterly Review of Economics and Finance. 1992; 32: 3153. [PubMed]
112.
Grumbach K, Osmond D, Vranizan K. et al. Primary care physicians' experience of financial incentives in managed-care systems. New England Journal of Medicine. 1998; 339(21): 151621. [PubMed]
113.
Bailit Health Purchasing. Provider Incentive Models for improving quality of care: National Health Care Purchasing Institute; March 2002.
114.
Bailit Health Purchasing, Sixth Man Consulting. The growing case for using physician incentives to improve health care quality: National Health Care Purchasing Institute; December 2001.
115.
Stachnik T, Brown B, Hinds W. et al. Goal setting, social support and financial incentives in stress management programs: A pilot study of their impact on adherence. American Journal of Health Promotion. 1990; 5(1): 249.
116.
Deci E, Ryan R. Intrinsic motivation and self-determination in human behavior. New York: Plenum Press; 1985.
117.
Glied S. Getting the incentives right for children. Health Services Research. 1998; 33(4 Pt 2): 114360. [PubMed] [Free Full Text in PMC icon.Free Full text in PMC]
118.
Davis M M, Lantos J D. Ethical Considerations in the Public Policy Laboratory. JAMA. 2000; 284(1): 857. [PubMed]
119.
LeBaron C W, Starnes D, Dini E F. et al. The impact of interventions by a community-based organization on inner-city vaccination coverage: Fulton County, Georgia, 1992-1993. Archives of Pediatrics & Adolescent Medicine. 1998; 152(4): 32732. [PubMed]
120.
Breen N, Feuer E J, Depuy S. et al. The effect of Medicare reimbursement for screening mammography on utilization and payment. National Cancer Institute Breast Cancer Screening Consortium. Public Health Reports. 1997; 112(5): 42332. [PubMed] [Free Full Text in PMC icon.Free Full text in PMC]
121.
Pegram v Heidrick: 530 US 211; 2000.
122.
Glasgow R E, Orleans C T, Wagner E H. et al. Does the Chronic Care Model Serve Also as a Template for Improving Prevention? The Milbank Quarterly. 2001; 79(4): 579612. [PubMed]
123.
Tengs T O, Adams M E, Pliskin J S. et al. Five-hundred life-saving interventions and their cost-effectiveness. Risk Anal. 1995 Jun;15(3): 36990. [PubMed]
124.
Coffield A B, Maciosek M V, McGinnis J M. et al. Priorities among recommended clinical preventive services. American Journal of Preventive Medicine. 2001; 21(1): 19. [PubMed]
125.
Fontanesi J, De Guire M, Holcomb K. et al. The cost to immunize during well-child visits. American Journal of Medical Quality. 2001; 16(6): 196201. [PubMed]
126.
Mischel W, Cantor N, Feldman S. Principles of self-regulation: The nature of willpower and self-control. In: Higgins ET & Kruglanski AW, eds. Social Psychology: Handbook of Basic Principles. New York: The Guilford Press; 1996.
127.
Gollwitzer PM, Moskowitz GB. Goal effects on action and cognition. In: Higgins ET & Kruglanski AW, eds. Social Psychology: Handbook of Basic Principles. New York: The Guilford Press; 1996.
128.
Bandura A. Social cognitive theory: An agentic perspective. Annual Review of Psychology. 2001; 52: 126. [PubMed]
129.
Scwarzer R, Fuchs R. Self-efficacy and health behavior. In: Connor M & Norman PO, eds. Predicting Health Behavior: Research and Practice with Social Cognition Models. Buckingham: Open University Press; 1995.
130.
Olson JM, Roese NJ, Zanna MP. Expectancies. In: Higgins ET & Kruglanski AW, eds. Social Psychology: Handbook of Basic Principles. New York: The Guilford Press; 1996.
131.
Hammond K R, Summers D A. Cognitive control. Psychological Review. 1972; 79(1): 5867.
132.
Balzer W K, Hammer L B, Sumner K E. et al. Effects of cognitive feedback on components, display format, and elaboration of performance. Organizational Behavior and Human Decision Processes. 1994; 58: 36985.
133.
Te'eni D. Direct manipulation as a source of cognitive feedback: a human-computer experiment with a judgment task. International Journal of Man-Machine Studies. 1990; 33: 45366.
134.
Poses R M, Cebul R D, Wigton R S. et al. Controlled trial using computerized feedback to improve physicians' diagnostic judgments. Academic Medicine. 1992; 67(5): 3457. [PubMed]
135.
Wigton R S, Poses, Roy M, Collins, Marjeanne, Cebul, Randall D. Teaching old dogs new tricks: Using cognitive feedback to improve physician's diagnostic judgments on simulated cases. Academic Medicine. 1990; 65(9): S5S6. [PubMed]
136.
Wigton RS. Applications of judgment analysis and cognitive feedback to medicine. In: Brehmer, A & Joyce CRB, eds. Human Judgment: The SJT View: Elsevier Science Publishers B.V.; 1988:227–45.
137.
Pine II BJ. Mass-customizing products and services. Mass Customization. Boston: Harvard Business School Press; 1999:171–212.
138.
Schafer JB, Konstan, J., and Reidl, J. Recommended systems in e-commerce. Paper presented at: Proceedings of the ACM on Electronic Conference; November, 1999.
139.
Johnson P E, Veazie P J, O'Connor P J. et al. Understanding Variation in Chronic Disease Outcomes. Health Care Management Science. 2002; 5(2): 17589. [PubMed]
140.
Prochaska JO, DiClemente CC. Toward a Comprehensive Model of Change. Treating Addictive Behaviors: Processes of Change. New York:: Plenum Press; 1986.
141.
Glasgow R E, Orleans C T, Wagner E H. et al. Does the Chronic Care Model Serve Also as a Template for Improving Prevention? The Milbank Quarterly. 2001; 79(4): 579612. [PubMed]
142.
Jeffery R W, Wing R R, Thorson C. et al. Strengthening behavioral interventions for weight loss: a randomized trial of food provision and monetary incentives. Journal of Consulting & Clinical Psychology. 1993; 61(6): 103845. [PubMed]
143.
Oldenburg B, Owen N, Parle M. et al. An economic evaluation of four work site based cardiovascular risk factor interventions. Health Education Quarterly. 1995; 22(1): 919. [PubMed]
Listing of Excluded Studies (reason for exclusion is provided in italics following each reference)
Baranowski T, Simons-Morton B, Hooks P, Henske J, Tiernan K, Dunn J K, Burkhalter H, Harper J, Palmer J. A center-based program for exercise change among black-American families. Health Education Quarterly. (1990); 17(2): 179196. [PubMed]
Multi-component intervention.
Bond L, Davie G, Carlin J B, Lester R, Nolan T. Increases in vaccination coverage for children in child care 1997 to 2000: an evaluation of the impact of government incentives and initiatives. Australian & New Zealand Journal of Public Health. (2002); 26(1): 5864. [PubMed]
Not randomized, controlled.
Bowers T G, Winett R A, Frederiksen L W. Nicotine fading behavioral contracting and extended treatment: effects on smoking cessation. Addictive Behaviors. (1987); 12(2): 181184. [PubMed]
Multi-component intervention.
Breen N, Feuer E J, Depuy S, Zapka J. The effect of Medicare reimbursement for screening mammography on utilization and payment. National Cancer Institute Breast Cancer Screening Consortium. Public Health Reports. (1997); 112(5): 423432. [PubMed] [Free Full Text in PMC icon.Free Full text in PMC]
Not randomized, controlled.
Cherkin D C, Grothaus L, Wagner E H. The effect of office visit copayments on preventive care services in an HMO. Inquiry. (1990); 27(1): 2438. [PubMed]
System incentives.
Coleman T, Wynn A T, Barrett S, Wilson A, Adams S. Intervention study to evaluate pilot health promotion payment aimed at increasing general practitioners' antismoking advice to smokers. BMJ. (2001); 323(7310): 435436. [PubMed] [Free Full Text in PMC icon.Free Full text in PMC]
Not randomized, controlled.
Cox, C. C., Hooper, J., & Telleen, K. (2000). Private sector worksite health promotion programs in Missouri: a comparison with national survey findings and Healthy People recommendations. American Journal of Health Promotion., 14(3), 174–178, iii.
Not randomized, controlled.
Fletcher S W, Harris R P, Gonzalez J J, Degnan D, Lannin D R, Strecher V J, Pilgrim C, Quade D, Earp J A, Clark R L. Increasing mammography utilization: a controlled study. Journal of the National Cancer Institute. (1993); 85(2): 112120. [PubMed]
Multi-component intervention.
Fries J F, Bloch D A, Harrington H, Richardson N, Beck R. Two-year results of a randomized controlled trial of a health promotion program in a retiree population: the Bank of America Study.[comment]. American Journal of Medicine. (1993); 94(5): 455462. [PubMed]
Not on target.
Glanz K, Lew R A, Song V, Murakami-Akatsuka L. Skin cancer prevention in outdoor recreation settings: effects of the Hawaii SunSmart Program. Effective Clinical Practice. (2000); 3(2): 5361. [PubMed]
Multi-component intervention.
Glasgow R E, Hollis J F, Pettigrew L, Foster L, Givi M J, Morrisette G. Implementing a year-long worksite-based incentive program for smoking cessation. American Journal of Health Promotion. (1991); 5(3): 192199. [PubMed]
Not randomized, controlled.
Hahn D L. The delivery of clinical preventive services: acute care intervention. Journal of Family Practice. (1999); 48(10): 785789. [PubMed]
Not randomized, controlled.
System incentive.
Hickson G B, Altemeier W A, Perrin J M. Physician reimbursement by salary or fee-for-service: effect on physician practice behavior in a randomized prospective study. Pediatrics. (1987); 80(3): 344350. [PubMed]
Not on target.
Hoekstra E J, LeBaron C W, Johnson-Partlow T. Does reminder-recall augment the impact of voucher incentives on immunization rates among inner-city infants enrolled in WIC? Special Supplemental Program for Women Infants and Children. Journal of Pediatrics. (1999); 135(2 Pt 1): 261263. [PubMed]
Not on target.
Hueston W J, Mainous A G 3rd, Farrell J B. Childhood immunization availability in primary care practices. Effects of programs providing free vaccines to physicians.[comment]. Archives of Family Medicine. (1994); 3(7): 605609. [PubMed]
Not on target.
Hughart N, Vivier P, Ross A, Strobino D, Holt E, Hou W, Guyer B. Are immunizations an incentive for well-child visits? Archives of Pediatrics & Adolescent Medicine. (1997); 151(7): 690695. [PubMed]
Not on target.
Jason L A, Jayaraj S, Blitz C C, Michaels M H, Klett L E. Incentives and competition in a worksite smoking cessation intervention. American Journal of Public Health. (1990); 80(2): 205206. [PubMed] [Free Full Text in PMC icon.Free Full text in PMC]
Multi-component intervention.
Jason L A, Lesowitz T, Michaels M, Blitz C, Victors L, Dean L, Yeager E, Kimball P. A worksite smoking cessation intervention involving the media and incentives. American Journal of Community Psychology. (1989); 17(6): 785799. [PubMed]
Multi-component intervention.
Jeffery R W, French S A. Preventing weight gain in adults: design methods and one year results from the Pound of Prevention study. International Journal of Obesity & Related Metabolic Disorders: Journal of the International Association for the Study of Obesity. (1997); 21(6): 457464. [PubMed]
Duplicate.
Jeffery R W, Pheley A M, Forster J L, Kramer F M, Snell M K. Payroll contracting for smoking cessation: a worksite pilot study. American Journal of Preventive Medicine. (1988); 4(2): 8386. [PubMed]
Multi-component intervention.
Jeffrey R W, Forster J L, Baxter J E, French S A, Kelder S H. An empirical evaluation of the effectiveness of tangible incentives in increasing participation and behavior change in a worksite health promotion program. American Journal of Health Promotion. (1993); 8(2): 98100. [PubMed]
Duplicate.
Katz K S, El-Mohandes P A, Johnson D M, Jarrett P M, Rose A, Cober M. Retention of low income mothers in a parenting intervention study. Journal of Community Health. (2001); 26(3): 203218. [PubMed]
Not on target.
Keeler E B, Sloss E M, Brook R H, Operskalski B H, Goldberg G A, Newhouse J P. Effects of cost sharing on physiological health health practices and worry. Health Services Research. (1987); 22(3): 279306. [PubMed] [Free Full Text in PMC icon.Free Full text in PMC]
System incentives.
Kouides R W, Lewis B, Bennett N M, Bell K M, Barker W H, Black E R, Cappuccio J D, Raubertas R F, LaForce F M. A performance-based incentive program for influenza immunization in the elderly. American Journal of Preventive Medicine. (1993); 9(4): 250255. [PubMed]
Not randomized, controlled.
Krieger J W, Connell F A, LoGerfo J P. Medicaid prenatal care: a comparison of use and outcomes in fee-for-service and managed care. American Journal of Public Health. (1992); 82(2): 185190. [PubMed] [Free Full Text in PMC icon.Free Full text in PMC]
System incentive.
LeBaron C W, Starnes D, Dini E F, Chambliss J W, Chaney M. The impact of interventions by a community-based organization on inner-city vaccination coverage: Fulton County Georgia 1992-1993.[comment]. Archives of Pediatrics & Adolescent Medicine. (1998); 152(4): 327332. [PubMed]
Multicomponent intervention.
Leibowitz A, Manning W G Jr, Keeler E B, Duan N, Lohr K N, Newhouse J P. Effect of cost-sharing on the use of medical services by children: interim results from a randomized controlled trial. Pediatrics. (1985); 75(5): 942951. [PubMed]
System incentive.
Ludwig-Beymer P, Hefferan C. Evaluation of Baby Advocate a childhood immunization reminder system. Journal of Nursing Care Quality. (2001); 16(1): 1523. [PubMed]
Not randomized, controlled.
Lurie N, Manning W G, Peterson C, Goldberg G A, Phelps C A, Lillard L. Preventive care: do we practice what we preach? American Journal of Public Health. (1987); 77(7): 801804. [PubMed] [Free Full Text in PMC icon.Free Full text in PMC]
System incentive.
Maheu M M, Gevirtz R N, Sallis J F, Schneider N G. Competition/cooperation in worksite smoking cessation using nicotine gum. Preventive Medicine. (1989); 18(6): 867876. [PubMed]
Multi-component intervention.
Manning W G, Leibowitz A, Goldberg G A, Rogers W H, Newhouse J P. A controlled trial of the effect of a prepaid group practice on use of services. New England Journal of Medicine. (1984); 310(23): 15051510. [PubMed]
System incentive.
Merkel P A, Caputo G C. Evaluation of a simple office-based strategy for increasing influenza vaccine administration and the effect of differing reimbursement plans on the patient acceptance rate. Journal of General Internal Medicine. (1994); 9(12): 679683. [PubMed]
Not randomized, controlled.
Oldenburg B, Owen N, Parle M, Gomel M. An economic evaluation of four work site based cardiovascular risk factor interventions. Health Education Quarterly. (1995); 22(1): 919. [PubMed]
Duplicate.
Pescatello L S, Murphy D, Vollono J, Lynch E, Bernene J, Costanzo D. The cardiovascular health impact of an incentive worksite health promotion program. American Journal of Health Promotion. (2001); 16(1): 1620. [PubMed]
Multi-component intervention.
Poole K, Kumpfer K, Pett M. The impact of an incentive-based worksite health promotion program on modifiable health risk factors. American Journal of Health Promotion. (2001); 16(1): 2126. [PubMed]
Multi-component intervention.
Reid G S, Robertson A J, Bissett C, Smith J, Waugh N, Halkerston R. Cervical screening in Perth and Kinross since introduction of the new contract.[comment]. BMJ. (1991); 303(6800): 447450. [PubMed] [Free Full Text in PMC icon.Free Full text in PMC]
Not randomized, controlled.
Schwab R A, Radakovich R, Tate K. Does payment improve follow-up of pelvic inflammatory disease? Missouri Medicine. (2002); 99(7): 286288. [PubMed]
Not on target.
Solanki G, Schauffler H H, Miller L S. The direct and indirect effects of cost-sharing on the use of preventive services. Health Services Research. (2000); 34(6): 13311350. [PubMed] [Free Full Text in PMC icon.Free Full text in PMC]
Not randomized, controlled.
Stachnik T, Brown B, Hinds W, Mavis B. et al. Goal setting social support and financial incentives in stress management programs: A pilot study of their impact on adherence. American Journal of Health Promotion. (1990); 5(1): 2429.
Not randomized, controlled.
Stein A D, Karel T, Zuidema R. Carrots and sticks: Impact of an incentive/disincentive employee flexible credit benefit plan on health status and medical costs. American Journal of Health Promotion. (1999); 13(5): 260267. [PubMed]
System incentive.
Stevens M M, Paine-Andrews A, Francisco V T. Improving employee health and wellness: A pilot study of the employee-driven Perfect Health Program. American Journal of Health Promotion. (1996); 11(1): 1214. [PubMed]
Not randomized, controlled.
Strecher V J, Becker M H, Kirscht J P, Eraker S A, Graham-Tomasi R P. Evaluation of a minimal-contact smoking cessation program in a health care setting. Patient Education & Counseling. (1985); 7(4): 395407. [PubMed]
Multi-component intervention.
Taylor V, Thompson B, Lessler D, Yasui Y, Montano D, Johnson K M, Mahloch J, Mullen M, Li S, Bassett G, Goldberg H I. A clinic-based mammography intervention targeting inner-city women. Journal of General Internal Medicine. (1999); 14(2): 104111. [PubMed]
Multi-component intervention.
Unti L M, Coyle K K, Woodruff B A, Boyer-Chuanroong L. Incentives and motivators in school-based hepatitis B vaccination programs. Journal of School Health. (1997); 67(7): 265268. [PubMed]
Not on target.
Footnotes
a

Some economists prefer to reserve “economic incentives” for situations that involve the analysis of opportunity costs, and use “financial incentives” for the kinds of questions posed in this review. Because the request for proposal for this review used the term “economic incentive” and the more general readership finds the term useful, we chose to retain the original wording.

b

In our experience, it is rare that a so-called randomized clinical trial is truly randomized. While subjects may be successfully randomized into different treatment arms, subject attrition often unravels the efficacy of the initial randomization.

1

See Ackerberg and Botticini (2002) “Endogenous Matching and the Empirical Determinants of Contract Form,” Journal of Political Economy 110(3): 564–591, for a description of importance of selection into compensation contracts and potential corrections for the problems.

Help ǀ Contact Bookshelf
AHRQ Evidence Reports
(navigation arrows) Go to previous chapter Go to next chapter Go to top of this page Go to bottom of this page Go to Table of Contents