• We are sorry, but NCBI web applications do not support your browser and may not function properly. More information
Logo of bmchsrBioMed Centralsearchsubmit a manuscriptregisterthis articleBMC Health Services Research
BMC Health Serv Res. 2008; 8: 9.
Published online Jan 14, 2008. doi:  10.1186/1472-6963-8-9
PMCID: PMC2267187

Improving patient adherence to lifestyle advice (IMPALA): a cluster-randomised controlled trial on the implementation of a nurse-led intervention for cardiovascular risk management in primary care (protocol)

Abstract

Background

Many patients at high risk of cardiovascular diseases are managed and monitored in general practice. Recommendations for cardiovascular risk management, including lifestyle change, are clearly described in the Dutch national guideline. Although lifestyle interventions, such as advice on diet, physical exercise, smoking and alcohol, have moderate, but potentially relevant effects in these patients, adherence to lifestyle advice in general practice is not optimal. The IMPALA study intends to improve adherence to lifestyle advice by involving patients in decision making on cardiovascular prevention by nurse-led clinics. The aim of this paper is to describe the design and methods of a study to evaluate an intervention aimed at involving patients in cardiovascular risk management.

Methods

A cluster-randomised controlled trial in 20 general practices, 10 practices in the intervention arm and 10 in the control arm, starting on October 2005. A total of 720 patients without existing cardiovascular diseases but eligible for cardiovascular risk assessment will be recruited.

In both arms, the general practitioners and nurses will be trained to apply the national guideline for cardiovascular risk management. Nurses in the intervention arm will receive an extended training in risk assessment, risk communication, the use of a decision aid and adapted motivational interviewing. This communication technique will be used to support the shared decision-making process about risk reduction. The intervention comprises 2 consultations and 1 follow-up telephone call. The nurses in the control arm will give usual care after the risk estimation, according to the national guideline.

Primary outcome measures are self-reported adherence to lifestyle advice and drug treatment. Secondary outcome measures are the patients' perception of risk and their motivation to change their behaviour. The measurements will take place at baseline and after 12 and 52 weeks. Clinical endpoints will not be measured, but the absolute 10-year risk of cardiovascular events will be estimated for each patient from medical records at baseline and after 1 year.

Discussion

The combined use of risk communication, a decision aid and motivational interviewing to enhance patient involvement in decision making is an innovative aspect of the intervention.

Trial registration

Current Controlled Trials ISRCTN51556722

Background

Despite a decreasing trend in mortality from cardiovascular diseases, these diseases are still the main cause of mortality in the Western world, and cardiovascular diseases cause 33% of all deaths in the Netherlands [1,2].

Unhealthy lifestyles, rather than medical conditions or genetic predisposition, are thought to be the most important and modifiable causes of the majority of deaths from CVD [3,4]. It is estimated that 30% of all new cases of coronary heart disease and 19% of all strokes are caused by smoking, while other lifestyle factors, such as diet, also play an important role in the development of CVD [5].

Preventive guidelines on CVD and diabetes recommend medical treatment for patients at high risk. In addition, they recommend patient education and counselling on smoking, diet, physical exercise and alcohol consumption for large groups of patients with moderately increased risk. The Dutch multi-disciplinary guidelines for cardiovascular risk management (CVRM) also underline the importance of a healthy lifestyle for the prevention of CVD. The core of the guideline consists of a risk table for the assessment of the 10-year risk of CVD, showing the various risk factors which can be reduced [6].

Lifestyle changing programmes for the prevention of CVD have shown moderate but significant effects and have proved to be cost-effective [7-12]. However, changing lifestyle is very difficult for people. The public's adherence to lifestyle advice and medication varies between 20 and 90%, with most estimates converging around 50% [13,14]. Improving this adherence requires effective interventions, comprising educational and behavioural components [15]. Adherence seems to be influenced by health beliefs such as risk perception, perceived benefits and disadvantages of treatment and self-efficacy, as well as stage of change and communication problems with physicians [16-18]. Each high-risk individual can usually choose between several options for risk reduction. Since patients seek treatment approaches which are manageable and in their view effective, their preferences can differ considerably from those of the professionals. Many people prefer lifestyle change to drug treatment, but beliefs about treatments differ between physicians and patients, making it difficult to achieve consensus about the best treatment. True dialogue is required if patients' preferences are to be used to make decisions effectively [19,20].

The IMPALA (IMproving Patient Adherence to Lifestyle Advice) project builds on earlier work at our department. Van der Weijden evaluated the effect of implementation of the Dutch cholesterol guideline for cholesterol among 6 GPs [21]. This resulted in negative findings, without improvement in underuse or overuse of statins. It appeared that the mismatch between the guideline and the patients' expectations or preferences was one of the main barriers to change. Van Steenkiste tried to involve patients in the decision-making process for cardiovascular risk reduction by implementing a decision support tool and using a risk table. He found no effect on the GPs' performance and a minimal effect in terms of the patients' cardiovascular risk reduction. From process evaluation it appeared that the patients had not been optimally exposed to the decision support tool. It was recommended delegating CVRM to a practice nurse and extending the implementation for involving the patient in CVRM [22]. For the IMPALA study, an innovative nurse-led implementation strategy was developed, comprising key elements of risk assessment, risk communication, a decision aid, and adapted motivational interviewing. The IMPALA study investigates whether patients' adherence to medication and lifestyle advice can be increased through patient involvement and shared decision making [20].

Many of the patients with moderate to high CVD risk, but without existing CVD, are monitored in primary care. According to the guideline for CVRM, prevention of CVD, especially patient education and support in lifestyle change, seems to be a good task to delegate to a practice nurse in primary care [6]. The number of general practices employing a qualified practice nurse is increasing. These practice nurses mainly perform standardised tasks for patients with chronic diseases like asthma, hypertension or diabetes. The nurse works under the supervision of a general practitioner.

Most patients have difficulty understanding CVD risks [22,23]. Perception of risks tends to be inaccurate and people find it difficult to interpret and act upon risk information. The format (framing) in which risk information is presented affects people's perception of risks and their decisions. For instance, information framed in terms of relative risk or loss framing is more persuasive than framing in terms of absolute risk or gain framing. This has been reported for both doctors and patients [24-29]. Risk communication should include weighing up the risks and benefits of a treatment choice, and should address the patient's perception of the probability of an event as well as the importance of the event for that individual [26].

Increasing people's competence to understand their actual cardiovascular risk, the pros and cons of possible treatments and their options for modifying the risk, as well as the competence to clarify their own values and to become involved in the decisions, seems to lead to better-informed decisions [18,30-32]. Information on treatment options and their advantages and disadvantages is ideally integrated in a well-designed and validated decision aid [33], which can help both physicians or practice nurses and patients in the process of making the best choice for the management of CVD risk. It may help the unaware high-risk person to agree with risk-reducing strategies and the 'worried-well' low-risk person to agree with non-indication for risk-reducing drugs. There is increasing evidence that decision aids increase patients' active involvement in decision making [32]. However, assessing the 10-year risk of CVD and informing the patient about different options for risk reduction is only one step in a process of lifestyle change. Additional components are needed to reach a shared decision which the patient is motivated to adhere to. Professionals will have to facilitate the process, and to communicate in a patient-oriented way.

The motivational interviewing method seems a good tool, in addition to the use of the risk chart and the decision aid, to achieve shared decision making [32]. Adapted motivational interviewing has been used [34] to set the agenda of consultations together with patients, to assess patients' motivations for behaviour change and build motivation for healthy behaviours, and to achieve goal setting and specific action plans. Motivational interviewing is an approach that can be described by its four basic principles: expressing empathy, developing discrepancy, rolling with resistance and supporting self-efficacy [34-36]. The consultations for the IMPALA intervention will be held in the spirit of these basic principles, and an adapted form of motivational interviewing will be used. Since it is possible that the two consultations will only be the first step in a long process of preventive support, a telephone consultation is added to the intervention as the initial step towards follow-up. Telephone counselling by practice nurses seems a valuable approach for adequate follow-up support [37,38].

The impact of the IMPALA intervention will be assessed by means of various evaluations. First, the effect of the nurse-led intervention on the adherence to lifestyle advice will be examined and compared with that of nurse-led usual care.

A more detailed understanding of the components of the intervention which are successful while others fail to change behaviour requires gaining insight into the 'black box' of the intervention. Prospective recording is a method to evaluate the intervention process in terms of materials used, themes of communication, and time needed. Studying interactions by means of audiotaped recordings can assess the use of motivational interviewing and the principles of shared decision making. This information will be used to examine factors that moderate or mediate intervention effects. Since attitudes play an important role in adapting to a new way of working [39], it is important to evaluate the experiences of the general practitioners and practice nurses with the intervention, to determine the feasibility of a wider implementation of the intervention.

The patients in the intervention arm will probably notice the attempts to promote patient involvement and the changes in the relationship between health professional and patient and in the communication during the consultations. In an earlier community-oriented and individual-oriented prevention project for cardiovascular diseases in the Dutch province of Limburg, frictions and irritations were found among both health advisors and patients in the consultations [40]. In this project, the research agenda had determined a large part of the agenda setting of the prevention activities, and the options for risk reduction were limited to certain themes. In the context of CVD prevention, a deliberative model of the relationship between physician or practice nurse and patient is preferable to other models of the physician-patient relationship [41]. In this model, the aim of physician-patient interaction is to help the patient determine and choose the best health-related values that can be achieved in the clinical situation. The role of the physician is that of a teacher or a friend, engaging the patient in a dialogue on the best course of action. The IMPALA project will involve interviews in which patients will be asked about their experiences with and opinions about the IMPALA intervention, so that this can be evaluated from an ethical perspective.

We hypothesise that the intervention will modify patients' adherence to lifestyle advice, but the intervention may also improve the healthcare process implemented by GPs and practice nurses and hence the amount of time and effort required from the professionals [42]. Since this study will determine both the effects and the costs of the implementation of the nurse-led intervention an economic evaluation of the intervention is planned to compare the cost-effectiveness ratio in the intervention group with that in the control group.

Research questions

1. What is the effect of our nurse-led intervention for CVRM, including risk communication, a decision aid and adapted motivational interviewing, on patients' adherence to lifestyle advice? [Effect evaluation]

2. To what extent do the nurses adhere to the intervention for CVRM and decision support, and what are the experiences and opinions of GPs and practice nurses about this strategy? [Process evaluation]

3. How do patients experience the nurse-led intervention for CVRM, and what is the ethical value of the intervention? [Ethical evaluation]

4. What is the incremental cost-effectiveness ratio of the nurse-led intervention for CVRM and decision support compared to usual care by a practice nurse? [Economic evaluation]

Methods

Design

The IMPALA study is a cluster-randomised controlled trial involving 20 general practices and 720 patients in the Netherlands. An independent statistician will perform a central block randomisation. Practices will be randomly allocated, 10 practices to the intervention group and 10 practices to the control group, after stratification into 4 geographical regions. Assessments will be made at the inclusion of the patients in the study, at 12 weeks and at 52 weeks. A flowchart of the study is shown in Figure Figure11.

Figure 1
Flowchart of the IMPALA study.

Ethical approval and informed consent

The Medical Ethical Committee of the University of Maastricht has granted ethical approval. The trial is registered as ISRCTN51556722 [43].

An information sheet will be given to all eligible patients. Patients will be informed on all aspects of the project by means of written information and personally at the inclusion. The privacy of the participating patients is protected, and all data will be coded and processed anonymously. It will be made clear in the informed consent form that each patient can terminate his or her participation the study at any moment. Patients will be asked to sign the informed consent form, and return this to Maastricht University to allow further contact regarding the research.

General practices

Inclusion criteria for the general practices are that they have to employ a practice nurse and work with electronic patient records. Practices will be invited by letter to participate in the trial. Addresses will be obtained from the NIVEL (Netherlands Institute for Health Services Research) database. If a practice expresses interest, it will be visited by members of the project team for further information and explanation about the study. Non-responding GPs will be reminded after 1 month, by renewed postal invitation. The general practices will be located in the central and southern parts of the Netherlands. In the Netherlands, all patients are obliged to be registered with a general practice.

Participants

The inclusion criteria for participants are based on the Dutch guideline for CVRM. According to the guideline, the following patients are eligible for a cardiovascular risk assessment:

Especially patients

• who have high blood pressure (≥ 140 mmHg) or are already being treated for it; and/or

• who have high total cholesterol (≥ 6.5 mmol/l) or already being treated for it; and/or

• who are smokers (men ≥ 50 years, women ≥ 55 years); and/or

• who have diabetes.

In addition, patients:

• who have positive family history of CVD; and/or

• who have visible obesity.

Patients with existing cardiovascular diseases, patients at high risk based on familial hypercholesterolaemia only and patients who are primarily managed in secondary care (e.g. by cardiologists or internists or in rehabilitation programmes) will be excluded from the study. This is a clinical approach to primary prevention. We will not manipulate the process of identifying potential high-risk patients other than by informing the GPs about the inclusion criteria, to stimulate usual strategies for case finding, either by the GPs during consultation hours or by the nurses inviting high-risk patients from available patient records. To facilitate the inclusion process, the GPs and practice nurses will receive a chart stand, with the inclusion criteria which they can place on their desk.

Sample size calculation and feasibility of recruitment

The study will be powered on outcomes on patient behaviour to detect an absolute 52-week, post-intervention, between-group difference of 15% (50 – 65%) in patients' self reported adherence to life-style advice on smoking, diet, alcohol and physical exercise (alpha = 0.05, power = 0.80). The figure of 50% represents the average adherence by patients with chronic diseases [13]. The power calculation for clustered data analysis assumes an intra-class correlation coefficient (ICC) of 0.04. ICC values in earlier trials among general practitioners were 0.06 [44] and 0.03 [45]. Since we expect that the nurses will perform well in terms of adhering to the working protocol, we expect a lower ICC, with a maximum of 0.04. Thus, the within-cluster variance will be almost equal to the between-cluster variance. This implies that 600 patients are needed (300 per group) at 52 weeks. It is our intention that a total of 720 patients will be recruited by the GPs or practice nurses, to compensate for an expected 15% loss to follow-up (in an earlier trial by van Steenkiste, 87% of the included patients responded at the 6-month follow-up [45]). It should be possible to prospectively recruit 720 patients (36 per practice) in 6 months, as Dutch general practices each have 100–150 of these patients, who visit the practice at least once a year for regular monitoring.

Intervention

The GPs will delegate to the practice nurses the tasks of risk assessment, patient education and counselling. The practice nurses will be equipped to roll out an intervention comprising (1) risk assessment, (2) risk communication, (3) distribution of a decision aid and (4) motivational interviewing. These strategies will be distributed over two consultations and a follow-up telephone call (see Figure Figure2).2). Each consultation will take about 15 minutes, with a maximum of 30 minutes. The duration of the phone call will vary, but is not meant to last over 10 minutes.

Figure 2
Graphical depiction of intervention and measurements. Graphical depiction of intervention and measurements (above), with legend (below). Squares represent fixed elements, e.g. objects and calculations. Circles represent activities that are flexible. Randomisation ...

(1) Risk assessment

The assessment of the 10-year risk of CVD will be done with the help of the risk table from the Dutch guideline on CVRM, published and produced in 2006 by the Dutch Institute for Health Care Improvement (CBO), in close collaboration with the Dutch College of General Practitioners (NHG), and has also been approved by the relevant clinical specialist groups, such as cardiologists [6,46]. The risk table is derived form the European Score risk table [46], adapted to the Dutch situation. The cardiovascular risk of patients with diabetes will be estimated with a table derived from the UKPDS risk engine [47].

(2) Graphical risk communication tool

The risk communication tool is a sheet showing graphical information that the nurse can use to communicate the risk more explicitly to the patient. It has been suggested that risks can be more understood by patients if different ways are used to present them, such as natural frequencies, positive and negative framing and a population chart. It has also been recommended to explain the uncertainty to the patient [48]. The practice nurse can visualise the total risk, as well as the relative contributions of modifiable risk factors to the total risk. Both absolute and relative risks will be framed and depicted in numbers (by natural frequencies) and in graphs (by population diagram). The risk communication tool was developed in a pilot study. A practice nurse from a general practice that will not be included in the main study administered the tool to 8 patients, who were interviewed about the different graphical risk presentations, clarity, language and layout of the tool. The tool was then adapted on the basis of the outcomes of these interviews.

(3) Decision aid

An earlier version of the decision aid was tested in an RCT by Van Steenkiste [45]. The 16-page decision aid (in brochure form) informs patients about their absolute 10-year CVD risk, both verbally and numerically, and presents options for risk reduction, such as use of medication or lifestyle changes. The risk table from the guideline on CVRM is also made available to the patients. The brochure will be handed over by the nurse to the patient at the end of the first consultation. The patient is expected to read the decision aid at home and return to the nurse to discuss what should or should not be done.

(4) Adapted Motivational Interviewing

In the second consultation, the nurse will apply adapted motivational interviewing to support the patient in the process of decision making about CVRM. The first step is to set the agenda for the consultation, together with the patient [36]. The patient will chose one or more key items in CVRM (smoking, physical exercise, dietary behaviour, alcohol consumption and adherence to medical treatment) in this agenda setting. After this, the nurse will assess the patient's current behaviour and motivation for change, by rating and exploring importance and confidence with respect to the chosen key items. If there is a need and sufficient motivation for change regarding one or more items, the nurse will consult with the patient to select one item as the goal for behaviour change. The nurse will inform the patient about local opportunities for individual or group support in lifestyle change that tie in with the patient's goal, if appropriate.

Follow-up

Little is known about the number of consultations featuring motivational interviewing that is needed to optimise the effect in terms of behaviour change, as regards intensity and frequency but the assumption is that a second motivational interviewing consultation will probably increase the effect of the intervention [49]. Therefore, the nurse will apply the same adapted motivational interviewing in the follow-up telephone call (lasting a maximum of 10 minutes). The nurse will assess the patient's actual motivations for change, ask for their experiences with specific actions (if applicable) and continue to work on importance and confidence.

The intervention can be embedded in a long-term treatment approach. After the telephone consultation, the nurse and the patient decide whether and what continuation is needed, for example some extra consultations to support the lifestyle change or regular monitoring of weight or blood pressure.

Training

The nurses will receive a two-day training, outside the practice. The GPs will only be invited for the part of the training that concerns the new guideline on CVRM. Homework about risk assessment and motivational interviewing will be sent to the nurses with the request to study the materials, which should take them about 4 hours. The two-day training consists of the following elements:

- Introduction 1: hour

- Outlining the multifaceted strategy and various aspects of the study: 1 hour

- Information on the new guidelines for CVRM, on the assessment of the individual 10-year risk of CVD by means of vignettes, on the recommendations for lifestyle counselling and risk reduction by medication such as blood pressure or cholesterol lowering drugs: 1.5 hours.

- Communicating the risk to patients using a risk communication tool, and disseminating the decision aid to patients: 2 hours.

- Specific training in the adapted motivational interviewing technique that is to be used to discuss the decision aid with patients after it has been studied by them at home; involving patients in decision making and goal setting: 7 hours.

Afterwards:

- After completing the training course, the nurses will audiotape 3 consultations and will receive written feedback from the researchers on their communication techniques.

Usual care

The practice nurses for the control group will receive only a short training on the new guideline for CVRM and will be instructed to administer usual care consistent with current guidelines. Usual care depends on patients' risk profile and their preferences for risk reduction. In normal situations, when blood pressure and cholesterol levels are sufficiently controlled, the guidelines recommend one follow-up consultation a year. In order to keep the nurses in the control arm motivated, the extended training in risk communication and motivational interviewing will be offered after the inclusion period of the trial and after the short-term measurement at 12 weeks. To protect the contrast between the intervention group and the control group, the nurses for the control group have to 'promise' not to administer the intervention to the included patients before their last measurement (52 weeks). The nurses will receive a list of the included patients in their practice, specifying the exact moment of the last measurement for each patient.

Effect evaluation

The aim of the effect evaluation is to examine the patients' adherence to lifestyle advice. The research question is: What is the effect of a nurse-led intervention for CVRM, including risk communication, a decision aid and adapted motivational interviewing, on patients' adherence to lifestyle advice?

Variables and measurements

Primary outcome measures are the patients' adherence to lifestyle advice and drug treatment. The current state-of-the-art in measurement of adherence behaviour is a multi-method approach that combines feasible self-reporting and reasonably objective measures [50,13]. Specific behaviours relating to smoking, saturated fat intake, fruit and vegetable consumption, physical exercise, alcohol use and use of cardiovascular medication will be reported by patients, using validated self-reported questionnaires. For a detailed overview of the outcome measures, questionnaires and types of variables, see Tables Tables11 and and2.2. We will use pedometers at 12 weeks to measure physical exercise [51], although we recognise that this measurement may itself increase activity levels. Pedometers are reasonably accurate for walking activities [50]. Patients will be instructed to measure during 3 days in one week [52]. Body mass index will be measured as a proxy measure of healthy diet and exercise.

Table 1
Primary outcome measures
Table 2
Secondary outcome measures

Clinical endpoints will not be assessed, but the absolute risk of cardiovascular events in 10 years will be calculated using the risk table from the Dutch guideline for CVRM [6]. For patients with diabetes, the UK PDS risk engine will be used. Calculation of the patients' absolute risk of cardiovascular events in 10 years, which is a proxy measure of actual health gain, will be based on known and available determinants: diabetes, age, sex, smoking, blood cholesterol level and systolic blood pressure. After one year, the risk of CVD will also be estimated, by deriving data on the risk factors from medical records in general practice. Since there is (according to the CVRM guidelines) no need to assess someone's cholesterol level annually if this level is acceptable, it is possible that some of the data used for the estimation will not be recent (with a maximum of one year).

Secondary outcome measures are the perception of the patients' own health behaviour, risk perception, anxiety, self-efficacy, importance of behaviour change, satisfaction with communication and confidence in the decision that has been made. Other factors that will be recorded include patient demographic factors (age, sex, education) and medical characteristics. See Table Table22 for secondary outcomes.

Timing of measurements

Measurements will take place at three moments (see Figures Figures11 and and22):

- T0 (baseline): The patients will receive the first questionnaire from their GP or practice nurse at the time they are invited to enrol in the study. The nurse will send a postage-paid postcard with the patient number to the researchers at Maastricht University (UM). Before a patient visits the practice for the first consultation, he/she will complete the first questionnaire and an informed consent form. After each consultation, the nurse will record on a standardised form some patient characteristics like age, sex, blood pressure, cholesterol level, glucose level, height, weight and the occurrence of CVD in the family (yes or no).

- T1 (12 weeks): A second questionnaire and the pedometer will be sent to the patient's home address.

- T2 (52 weeks): The final questionnaire will be sent to the patient's home address. The nurses will be asked to record data regarding the biological parameters (cholesterol level, blood pressure, glucose, diabetes yes/no) from the most recent patient contact.

All the questionnaires, the informed consent form and a form to record the number of steps that were made are to be sent to the researchers in a postage-paid envelope after completion. Materials (questionnaires, informed consent form, recording forms for nurses, initial postcard) will carry a unique patient number.

Data analysis

Since it is not possible to restrict our study to one primary outcome for all patients beforehand, the study will examine 6 different lifestyle changes: smoking, physical exercise, fat intake, fruit, vegetables and alcohol.

To assess the difference in primary outcomes between the arms, the arms will first be compared in terms of changes in the specific lifestyle issues, independent of the targets chosen by the intervention patients. We will use a T test for continuing variables and a χ2 test for dichotomous variables.

A second analysis of primary outcomes is a multilevel regression analysis (using SPSS and MLwin), which uses adherence to the primary outcomes of lifestyle change as the dependent variables and group allocation and pre-intervention scores as independent variables. Additional independent variables will be included in the model, such as patient characteristics (age, sex, anxiety and risk of CVD). Additional regression analyses will focus on the effect at T2.

The third analysis involves constructing a simple standardised overall adherence score for the six lifestyle items, which expresses to what extent, on average, patients achieved the behaviour change goals of the national recommendations for a healthy lifestyle. The score of the intervention group will be compared with that of the control group.

Finally, the reduction in the 10-year risk of CVD will be analysed for differences between the two arms. The risk of CVD will be analysed with a multilevel regression analysis, which uses the risk at 52 weeks as the dependent variable and group allocation and pre-intervention risk as independent variables.

The secondary outcomes will also be analysed for the differences between the arms, using a T test for continuing variables and a χ2 test for dichotomous variables. We also intend to use a multilevel regression analysis (using MLwin) which uses e.g. self-efficacy and attitudes at T1 as the dependent variables and group allocation and pre-intervention scores as independent variables. Additional independent variables, such as patient characteristics (age, gender, risk of CVD and socio-economic status), will also be included in the model. Additional regression analyses will focus on the effect at T2. Further analyses for subgroups of patients are also possible.

In addition, we will describe the personal targets of the patients in the intervention arm, which will be recorded by the nurses.

Process evaluation

The purpose of the process evaluation is to establish actual exposure to the intervention as it was intended, and to examine which components of the intervention were successful and which ones were not. The research question is: To what extent do the nurses adhere to the intervention for CVRM and decision support, and what are the experiences and opinions of the GPs and nurses with regard to this intervention?

Variables and measurements

Data on the nurses' actual adherence to the components of the strategy will be gathered by the nurses themselves by means of prospective self-reports. Nurses will use a short standardised questionnaire after each consultation to record which components of the intervention have been applied. Each item will be scored as a done/not done binary variable (see Table Table33 for the key intervention features that will be scored). On top of this, each nurse will be instructed to audiotape 3 consultations, namely one of the initial ones and two later on in the trial. In addition to this quantitative approach to process evaluation, we will also use a qualitative approach, in that the nurses will be invited to a focus group interview to discuss their perception of determinants of success and failure. The variation in the effects at the patient and nurse levels will also be discussed. Finally, a subgroup of GPs will be invited for face-to-face interviews about their opinion on the intervention. The sample will include practices with successful as well as less successful patient inclusion. The focus group and the interviews will be moderated by an experienced GP, who is not a member of the research group.

Table 3
Key features of the intervention for quantitative process evaluation

Data analyses

The self-reported done/not done components of the intervention will be presented as the proportion of the consultations in which the component has been applied. The audiotaped consultations in the intervention group will be scored with the IMPALA Practice nurses Scoring list (IPS), a scoring list based on the IMPALA training programme and on other existing scoring lists [53,54], to determine the extent to which the motivational interviewing technique was implemented. The consultations will be scored with the OPTION instrument to measure to what extent practice nurses have involved patients in the decision-making process [55,56]. The interviews with the nurses and the GPs will be transcribed and coded by three persons, using a coding list. Differences of opinion will be discussed until agreement is reached.

Ethical evaluation

The ethical evaluation will use interviews with individual patients regarding their opinions about and experiences with the consultations of the intervention, to evaluate the intervention in the light of the models of physician-patient relationship by Emanuel and Emanuel [41].

The research question is: How do patients experience the nurse-led intervention for CVRM, and what is the ethical value of the intervention?

Variables and measurements

At least 16 patients of 4 practices will be invited by the nurses to participate in an interview. The 4 nurses implementing the intervention most satisfactorily (judging from the audiotaped consultations), will be asked to invite a variety of patients in terms of sex, 10-year risk of CVD and the course of the consultations.

The interviews will be 'open', in that the interviewer will try to access the patient's personal story. The interviews will be held in the diagnostic style, and will characterised by an interested and personal approach [57]. The interviews will be based on a list of themes to ensure that all relevant items are brought up during the discussion (see Table Table4).4). All interviews will be audiotaped, with the patients' permission, and transcribed later. The interviews will be done by an experienced junior social scientist, who is not a member of the research group.

Table 4
Interview themes for ethical evaluation

Data analysis

The interviews will be analysed by the constant comparative method as described in grounded theory [58]. Interviews will be coded and the codes will be grouped, compared and categorised.

Economic evaluation

The aim of the economic evaluation is to assess the costs of the IMPALA intervention. The research question is: What is the incremental cost-effectiveness ratio of a nurse-led intervention for CVRM and decision support compared to usual care by a practice nurse?

Measurements and variables

The use of CVD-related health care resources will be measured by means of questions about health care use (prescribed medication, tests, referrals, numbers of contacts) over a 3-month period before completion. Costs of CVD events will be estimated from the literature and/or analyses of aggregate data sources (hospital information systems). Cost calculation will be based on real prices or on unit prices from the Dutch guideline for cost calculation [59]. Quality of life will be measured with the SF-36, a validated questionnaire [60]. The costs of implementing the intervention will be recorded by the researchers.

Timing of measurements

The questions for the economic evaluation will be incorporated in the questionnaires of the effect evaluation at T0, T1 and T2.

Data analyses

The economic evaluation will be a cost-effectiveness study. We expect no differences in short-term societal costs because the improvements in lifestyle will mainly have effects in the long term. Therefore, the analyses will use a health care sector perspective, and will thus also show the expected costs and consequences per general practice. The base case involves calculation of an incremental cost-effectiveness ratio (ICER) of patient involvement as regards the estimated reduction of CVD events in 10 years on the basis of T2 data [61]. Quality improvement cost-effectiveness will be combined with treatment cost-effectiveness according to the Mason model [62,63]. Cost differences between the intervention and control groups will be statistically tested by calculating the 2.5 – 97.5 percentile intervals of the bootstrapped resamples.

In addition, we will use a long-term economic evaluation to explicitly reveal the relationship between the CVD risk reduction achieved and the required investment for the implementation strategy. For this purpose, a Markov health state transition model will be developed, with a first-order Monte Carlo simulation in which each patient goes through the model individually. The cycle length will be one year. The time horizon of the analysis is the full lifetime of the population. Costs and benefits will be discounted according to national guidelines (4%). A one-way sensitivity analysis will be used to establish the individual effects of model parameters on the results of the analysis. The model parameters will be varied across a plausible range. Parameter uncertainty will be further tested using probabilistic sensitivity analysis, which takes into account the fact that some combinations of factors are more likely than others [64].

Discussion

The intervention that will be evaluated in this trial is characterised by some innovative aspects. Firstly, not much is known yet on the effect of the combined use of risk communication, a decision aid and motivational interviewing to enhance patient involvement in decision making. Secondly, delegation of such tasks to a practice nurse is a new approach in the Netherlands, and is in line with current changes in general practice care processes in this country (increasing practice sizes and multidisciplinary health centres employing nurses).

A factorial or multiple-arm RCT design would have been optimal from the methodological perspective, and could shed light on the effectiveness of the individual ingredients of this multifaceted intervention in terms of the primary outcomes. However, this would have blown up the design to include multiple trial arms and large numbers of practices and patients, and turn it into an unfeasible experiment. The analyses of our secondary outcomes will probably shed light on the effectiveness of individual ingredients of the intervention. In some of the secondary outcomes, such as risk perception, the relation with individual ingredients, such as risk communication, seems one-dimensional. The way in which risk communication, the decision aid and motivational interviewing are applied during the trial will be documented in a process evaluation, which will give further information on the impact of intervention components on the main outcomes.

The pilot version of the risk communication tool included a Paling scale, a scale to compare the risk of cardiovascular risk with other risks of life. After the pilot test, we decided to remove the Paling scale because it was too difficult according to the patients who received the risk communication tool in this pilot test.

When we developed the decision aid, the IPDAS criteria for decision aids had not yet been published [65], but the decision aid does comply with most of the these criteria, namely using a systematic development process, providing information about options, presenting probabilities, disclosing conflicts of interests and using plain language. On the other hand, our decision aid does not fully meet the criteria on balancing the presentation of options, clarifying and expressing values, and guiding/coaching in deliberation and communication, although patients will be invited to deliberate about the decision making, and the motivational interviewing in our strategy is meant to help patients clarify and express values.

Cardiovascular risk is not the primary outcome of the effect evaluation because this is a pragmatic trial about the implementation of the Dutch national guideline for CVRM. To reduce the burden of data collection for the health care professionals, we will ask them to collect only the data they need for the risk estimations. There is no budget for additional data collection outside routine practice by the researchers.

Although we intended to use more objective measures for the primary outcomes of the effect evaluation, this was precluded by logistic and financial reasons. The relatively inexpensive breath carbon monoxide test is not very sensitive, and the more reliable urine cotinine marker is expensive and difficult from a logistic point of view. A biomarker for fruit and vegetables, such as carotene measurement, is expensive, and no simple biomarker for alcohol is available. The influence of information bias resulting from subjective self-reports is reduced in the data analysis, which takes the pre-intervention scores (which have the same information bias) into account. Although self-reported smoking status is known to be biased, measurement of a biological marker has various disadvantages.

Abbreviations

CVRM: cardiovascular risk management

CVD: cardiovascular diseases

GP: general practitioner

NIVEL: the Netherlands Institute for Health Services Research. Nivel contributes to the body of scientific knowledge about the provision and use of health care services. One of Nivel's responsibilities is to register all general practitioners in the Netherlands.

UK PDS risk engine: a digital calculation tool for the estimation of CVD in patients with diabetes mellitus, based on the UK Prospective Diabetes Study.

Competing interests

The author(s) declare that they have no competing interests.

Authors' contributions

MK is a health scientist, main investigator and PhD student. She is involved in developing the intervention and the instruments, as well as in the implementation, analysis and reporting aspects of the trial. TvdW is an epidemiologist. She is the project leader and is involved in all aspects of the study. BvS is a health scientist and is involved in all aspects of the study, especially as regards the decision aid, instruments, analyses and economic evaluation. GR is a health scientist and senior researcher, involved in all aspects of the effect and process evaluation, especially motivational interviewing and instruments to measure lifestyle. RG is PhD supervisor and psychologist and involved in the design of the study, the analyses and reporting. GE is PhD supervisor; he is a GP and advises the project team on shared decision making. MW is a medical sociologist and advises the project team on intervention, measurement instruments, design and economic evaluation. HS is a GP and is involved in the design of the study. All authors have read and approved the final version of the manuscript.

Pre-publication history

The pre-publication history for this paper can be accessed here:

http://www.biomedcentral.com/1472-6963/8/9/prepub

Acknowledgements

We wish to thank Prof. Hans Severens (health scientist) for his contributions and advice on the economic analyses, Prof. Guy Widdershoven (ethicist) for his supervision of the ethical evaluation, Dr. Daniëlle Timmermans (decisional psychologist) for her advice on risk communication, the secondary outcomes and effect evaluation measurements, and Dr. Bjorn Winkens (statistician) for his advice on the analyses of the effect evaluation.

References

  • WHO . The World Health Report: conquering suffering, enriching humanity. Report of the Director-General. In: Organisation WH, editor. The World Health Report. Geneva , World Health Organisation; 1997.
  • Koek HL, Engelfriet-Rijk CJM, Bots ML. Hart- en vaatziekten in Nederland. In: Jager-Geurts MH, Peters RJG, van Dis SJ, Bots ML, editor. Hart- en vaatziekten in Nederland 2006, cijfers over ziekte en sterfte. Den Haag , Nederlandse Hartstichting; 2006. pp. 9–21.
  • Mokdad AH, Marks JS, Stroup DF, Gerberding JL. Actual causes of death in the United States, 2000. JAMA. 2004;291:1238–1245. doi: 10.1001/jama.291.10.1238. [PubMed] [Cross Ref]
  • WHO . The World Health Report: Reducing risks, promoting healthy lifestyle. . In: Organisation WH, editor. The World Health Report. Geneva , World Health Organisation; 2002.
  • van Leest LATM, Verschuren WMM. Leeftstijl- en risicofactoren voor hart- en vaatziekten in de Nederlandse bevolking: prevalenties en trends. In: Jager-Geurts MH, Peters RJG, van Dis SJ, Bots ML, editor. Hart- en vaatziekten in Nederland 2006, cijfers over ziekte en sterfte. Den Haag , Nederlandse Hartstichting; 2006. pp. 89–107.
  • NHG . NHG-Standaarden. M84. Houten , Bohn Stafleu van Loghum; 2006. M84 Cardiovasculair Risicomanagement. p. 54.
  • WHO . Obesity: Preventing and Managing the Global Epidemic. Report. In: WHO , editor. Technical Report Series, No 894. Geneva , WHO; 1998.
  • Ades PA, Pashkow FJ, Nestor JR. Cost-effectiveness of cardiac rehabilitation after myocardial infarction. J Cardiopulm Rehabil. 1997;17:222–231. doi: 10.1097/00008483-199707000-00002. [PubMed] [Cross Ref]
  • van Berkel TFM, Boersma H, Roos-Hesselink JW, Erdman RAM, Simoons ML. Impact of smoking cessation and smoking interventions in patients with coronary heart disease. European Heart Journal. 1999;20:1773–1782. doi: 10.1053/euhj.1999.1658. [PubMed] [Cross Ref]
  • Jolliffe JA, Rees K, Taylor RS, Thompson D, Oldridge N, Ebrahim S. Exercise-based rehabilitation for coronary heart disease. The Cochrane Database of Systematic Reviews. 2001;1:CD001800. doi: 10.1002/14651858.CD001800. [PubMed] [Cross Ref]
  • Hooper LS., C. D; Higgins, J. P. T; Thompson, R. L; Clements, G; Capps, N; Davey Smith, G; Riemersma, R. A; Ebrahim, S. Reduced or modified dietary fat for preventing cardiovascular diseases. The Cochrane Database of Systematic Reviews. 2001;3:CD002137. [PubMed] [PubMed]
  • Ashenden R, Silagy C, Weller D. A systematic review of the effectiveness of promoting lifestyle change in general practice. Fam Pract. 1997;14:160–176. doi: 10.1093/fampra/14.2.160. [PubMed] [Cross Ref]
  • WHO. Sabate E. In: Adherence to long-term therapies. Evidence for action. WHO , editor. Geneva , WHO; 2003.
  • Burke LE, Dunbar-Jacob JM, Hill MN. Compliance with cardiovascular disease prevention strategies: a review of the research. Ann Behav Med. 1997;19:239–263. [PubMed]
  • Roter DL, Hall JA, Merisca R, Nordstrom B, Cretin D, Svarstad B. Effectiveness of interventions to improve patient compliance. A meta-analysis. Med Care. 1998;36:1138–1161. doi: 10.1097/00005650-199808000-00004. [PubMed] [Cross Ref]
  • Bellg AJ. Maintenance of health behavior change in preventive cardiology. Behaviour modification. 2003;27:103–131. doi: 10.1177/0145445502238696. [PubMed] [Cross Ref]
  • Lutfey KE, Wishner WJ. Beyond "compliance" is "adherence". Improving the prospect of diabetes care. Diabetes Care. 1999;22:635–639. doi: 10.2337/diacare.22.4.635. [PubMed] [Cross Ref]
  • Avis NE, Smith KW, McKinlay JB. Accuracy of perceptions of heart attack risk: what influences perceptions and can they be changed? Am J Public Health. 1989;79:1608–1612. [PMC free article] [PubMed]
  • Lewis DK, Robinson J, Wilkinson E. Factors involved in deciding to start preventive treatment: qualitative study of clinicians' and lay people's attitudes. BMJ. 2003;327:841. doi: 10.1136/bmj.327.7419.841. [PMC free article] [PubMed] [Cross Ref]
  • Elwyn G, Edwards A, Britten N. What information do patients need about medicines? "Doing prescribing": how doctors can be more effective. BMJ. 2003;327:864–867. doi: 10.1136/bmj.327.7419.864. [PMC free article] [PubMed] [Cross Ref]
  • van der Weijden T, Grol RP, Knottnerus JA. Feasibility of a national cholesterol guideline in daily practice. A randomized controlled trial in 20 general practices. Int J Qual Health Care. 1999;11:131–137. doi: 10.1093/intqhc/11.2.131. [PubMed] [Cross Ref]
  • van Steenkiste B, van der Weijden T, Stoffers HE, Grol R. Barriers to implementing cardiovascular risk tables in routine general practice. Scand J Prim Health Care. 2004;22:32–37. doi: 10.1080/02813430310004489. [PubMed] [Cross Ref]
  • Erhardt L, Hobbs FD. Public perceptions of cardiovascular risk in five European countries: the react survey. Int J Clin Pract. 2002;56:638–644. [PubMed]
  • Feldman Stewart D, Kocovski N, McConnell BA, Brundage MD, Mackillop WJ. Perception of quantitative information for treatment decisions. Med Decis Making. 2000;20:228–238. doi: 10.1177/0272989X0002000208. [PubMed] [Cross Ref]
  • Lipkus IM, Hollands JG. The visual communication of risk. J Natl Cancer Inst Monogr. 1999:149–163. [PubMed]
  • Edwards A, Elwyn G, Covey J, Matthews E, Pill R. Presenting risk information--a review of the effects of "framing" and other manipulations on patient outcomes. J Health Commun. 2001;6:61–82. doi: 10.1080/10810730150501413. [PubMed] [Cross Ref]
  • Timmermans D, Molewijk B, Stiggelbout A, Kievit J. Different formats for communicating surgical risks to patients and the effect on choice of treatment. Patient Educ Couns. 2004;54:255–263. doi: 10.1016/S0738-3991(03)00238-6. [PubMed] [Cross Ref]
  • Rakow T. Differences in belief about likely outcomes account for differences in doctors' treatment preferences: but what accounts for the differences in belief? Qual Health Care. 2001;10 Suppl 1:i44–9. [PMC free article] [PubMed]
  • Edwards AG, Evans R, Dundon J, Haigh S, Hood K, Elwyn GJ. Personalised risk communication for informed decision making about taking screening tests. Cochrane Database Syst Rev. 2006:CD001865. [PubMed]
  • Hack TF, Degner LF, Watson P, Sinha L. Do patients benefit from participating in medical decision making? Longitudinal follow-up of women with breast cancer. Psycho-Oncology. 2006;15:9–19. doi: 10.1002/pon.907. [PubMed] [Cross Ref]
  • Elwyn G, Edwards A, Eccles M, Rovner D. Decision analysis in patient care. Lancet. 2001;358:571–574. doi: 10.1016/S0140-6736(01)05709-9. [PubMed] [Cross Ref]
  • O'Connor AM, Legare F, Stacey D. Risk communication in practice: the contribution of decision aids. BMJ. 2003;327:736–740. doi: 10.1136/bmj.327.7417.736. [PMC free article] [PubMed] [Cross Ref]
  • O'Connor AM, Stacey D, Entwistle V, Llewellyn Thomas H, Rovner D, Holmes Rovner M, Tait V, Tetroe J, Fiset V, Barry M, Jones J. Decision aids for people facing health treatment or screening decisions. Cochrane Database Syst Rev. 2003;2:CD001431. [PubMed] [PubMed]
  • Burke BL, Arkowitz H, Menchola M. The efficacy of motivational interviewing: a meta-analysis of controlled clinical trials. J Consult Clin Psychol. 2003;71:843–861. doi: 10.1037/0022-006X.71.5.843. [PubMed] [Cross Ref]
  • Miller WR, Rollnick S. Motivational Interviewing. Preparing People for Change. 2. New York , The Guilford Press; 2002.
  • Rollnick S, Mason P, Butler C. Health Behavior Change. A guide for Practitioners. 1. London , Churchill Livingstone; 1999. p. 225.
  • Car J, Sheikh A. Telephone consultations. BMJ. 2003;326:966–969. doi: 10.1136/bmj.326.7396.966. [PMC free article] [PubMed] [Cross Ref]
  • Macharia WM, Leon G, Rowe BH, Stephenson BJ, Haynes RB. An overview of interventions to improve compliance with appointment keeping for medical services. JAMA. 1992;267:1813–1817. doi: 10.1001/jama.267.13.1813. [PubMed] [Cross Ref]
  • Grol R, Wensing M, Hulscher ME, Eccles M. Theories on implementation of change in healthcare. In: Grol R, Wensing M, Eccles M, editor. Improving Patient Care. Vol. 1. Edinburgh , Elsevier Butterworth Heinemann; 2005. pp. 15–40.
  • Horstman K, Houtepen R. Worstelen met gezond leven. Ethiek in de preventie van hart- en vaatziekten. Amsterdam , Het Spinhuis; 2005.
  • Emanuel EJ, Emanuel LL. Four Models of the Physician-Patient Relationship . JAMA. 1992;267:2221–2226. doi: 10.1001/jama.267.16.2221. [PubMed] [Cross Ref]
  • Severens JL, Martens JD, Wensing M. Economic evaluation of implementation strategies. In: Grol R, Wensing M, Eccles M, editor. Improving Patient Care The Implementation of Change in Clinical Practice. 1. London , Elsevier; 2005. pp. 273–284.
  • De Angelis C, Drazen JM, Frizelle FA, Haug C, Hoey J, Horton R, Kotzin S, Laine C, Marusic A, Overbeke AJ, Schroeder TV, Sox HC, Van Der Weyden MB. Clinical trial registration: a statement from the International Committee of Medical Journal Editors. CMAJ. 2004;171:606–607. [PMC free article] [PubMed]
  • van der Weijden T, Knottnerus JA, Grol RPTM. Feasibility of a national cholesterol guideline in daily practice. A randomized controlled trial in 20 general practices. Int J Qual Health Care. 1999;11:131–137. doi: 10.1093/intqhc/11.2.131. [PubMed] [Cross Ref]
  • van Steenkiste B, van der Weijden T, Stoffers HE, Kester AD, Timmermans DR, Grol R. Improving cardiovascular risk management: a randomized, controlled trial on the effect of a decision support tool for patients and physicians. Eur J Cardiovasc Prev Rehabil. 2007;14:44–50. doi: 10.1097/01.hjr.0000239475.71805.1e. [PubMed] [Cross Ref]
  • Backer GD, Ambrosioni E, borch-Johnsen K, Brotons C, Cifkova R, Dallongeville J, Ebrahim S, Faergeman O, graham I, Mancia G, cats VM, Orth-Gomer K, Perk J, Pyorala K, Rodicio JL, Sans S, Sansoy V, Sechtem U, Silber S, Thomsen T, Wood D. European guidelines on cardiovascular diseases prevention in clinical practice. Third Joint Task Force of European and other Societies on Cardiovascular Disease Prevention in Clinical Practice (constituted by representatives of eight societies and by invited experts) Eur Heart J. 2003;24:1601–1610. doi: 10.1016/S0195-668X(03)00347-6. [PubMed] [Cross Ref]
  • Stevens RJ, Kothari V, Adler AI, Stratton IM. The UKPDS risk engine: a model for the risk of coronary heart disease in Type II diabetes (UKPDS 56) Clin Sci (Lond) 2001;101:671–679. [PubMed]
  • van der Weijden T, Timmermans D, Wensing M. 'Dus alles is goed dokter?' Hoe informeer ik mijn patienten over grote en kleine risico's? Huisarts en Wetenschap. 2006;49:550–553.
  • Rubak S, Sandbaek A, Lauritzen T, Christensen B. Motivational interviewing: a systematic review and meta-analysis. Br J Gen Pract. 2005;55:305–312. [PMC free article] [PubMed]
  • Vitolins MZ, Rand CS, Rapp SR, Ribisl PM, Sevick MA. Measuring Adherence to Behavioral and Medical Interventions. Contr Clin Trials. 2000;21:188S–194S. doi: 10.1016/S0197-2456(00)00077-5. [PubMed] [Cross Ref]
  • Tudor-Locke C, Williams JE, Reis JP, Pluto D. Utility of Pedometers for Assessing Physical Activity. Convergent Validity. Sports Med. 2002;32:795–808. doi: 10.2165/00007256-200232120-00004. [PubMed] [Cross Ref]
  • Tudor-Locke C, Burkett L, Reis JP, Ainsworth BE, Macera CA, Wilson DK. How many days of pedometer monitoring predict weekly physical activity in adults? Prev Med. 2005;40:293–298. doi: 10.1016/j.ypmed.2004.06.003. [PubMed] [Cross Ref]
  • Lane C, Huw-Thomas M, Hood K, Rollnick S, Edwards K, Robling M. Measuring adaptations of motivational interviewing: the development and validation of the behavior change counseling index (BECCI) Patient Educ Couns. 2005;56:166–173. doi: 10.1016/j.pec.2004.01.003. [PubMed] [Cross Ref]
  • Resnicow K, Campbell MJ, Carr D, McCarty F, Wang T, Periasamy S, Rahotep S, Doyle C, Williams A, Stables G. Body and Soul. A Dietary Intervention Conducted Through African-American Churches. Am J Prev Med. 2004;27:97–105. doi: 10.1016/j.amepre.2004.04.009. [PubMed] [Cross Ref]
  • Elwyn G, Edwards A, Wensing M, Hood K, Atwell C, Grol R. Shared decision making: developing the OPTION scale for measuring patient involvement. Qual Saf Health Care. 2003;12:93–99. doi: 10.1136/qhc.12.2.93. [PMC free article] [PubMed] [Cross Ref]
  • Elwyn G, Hutchings H, Edwards A, Rapport F, Wensing M, Cheung WY, Grol R. The OPTION scale: measuring the extent that clinicians involve patients in decision-making tasks. Health Expect. 2005;8:34–42. doi: 10.1111/j.1369-7625.2004.00311.x. [PubMed] [Cross Ref]
  • Widdershoven GAM, Weijts LBM. Diagnostic styles in clinical interaction. In: Fulford KWM, Dickenson D, Murray T, editor. Blackwell Reader in Healthcare Ethics and Human Values. Oxford , Blackwells; 2002. pp. 171–176.
  • Strauss A, Corbin J. Basics of Qulitative Research. Grounded Theory Procedures and Techniques. Newbury Park , SAGE publications; 1990. p. 270.
  • Oostenbrink JB, Bouwmans CAM, Koopmanschap MA, Rutten FFH. Handleiding voor kostenonderzoek, Methoden en standaard kostprijzen voor economische evaluaties in de gezondheidszorg. College voor zorgverzekeringen; 2004.
  • Aaronson NK, Muller M, Cohen PD, Essink-Bot ML, Fekkes M, Sanderman R, Sprangers MA, te Velde A, Verrips E. Translation, validation, and norming of the Dutch language version of the SF-36 Health Survey in community and chronic disease populations. J Clin Epidemiol. 1998;51:1055–1068. doi: 10.1016/S0895-4356(98)00097-3. [PubMed] [Cross Ref]
  • Drummond MF, O'Brien B, Stoddart GL, Torrance GW. Oxford Medical Publications. 2nd. Norfolk , Biddles Ltd. King's Lynn; 2004. Methods for the Economic Evaluation of Health Care Programmes; p. 305.
  • Mason J, Freemantle N, Nazareth I, Eccles M, Haines A, Drummond M. When Is It Cost-effective to Change the Behavior of Health Professionals? JAMA. 2001;286:2988–2992. doi: 10.1001/jama.286.23.2988. [PubMed] [Cross Ref]
  • Severens JL. Value for money of changing healthcare services? Economic evaluation of quality improvement. Quality & Safety in Health Care. 2003;12:366–371. doi: 10.1136/qhc.12.5.366. [PMC free article] [PubMed] [Cross Ref]
  • Briggs AH. Handling uncertainty in cost-effectiveness models. Pharmacoeconomics. 2000;17:479–500. doi: 10.2165/00019053-200017050-00006. [PubMed] [Cross Ref]
  • Elwyn G, O'Connor A, Stacey D, Volk R, Edwards A, Coulter A, Thomson R, Barratt A, Barry M, Bernstein S, Butow P, Clarke A, Entwistle V, Feldman-Stewart D, Holmes-Rovner M, Llewellyn-Thomas H, Moumjid N, Mulley A, Ruland C, Sepucha K, Sykes A, Whelan T, The International Patient Decision Aids Standards C. Developing a quality criteria framework for patient decision aids: online international Delphi consensus process. BMJ. 2006;333:417. doi: 10.1136/bmj.38926.629329.AE. [PMC free article] [PubMed] [Cross Ref]
  • Bogers RP, Van Assema P, Kester AD, Westerterp KR, Dagnelie PC. Reproducibility, validity, and responsiveness to change of a short questionnaire for measuring fruit and vegetable intake. Am J Epidemiol. 2004;159:900–909. doi: 10.1093/aje/kwh123. [PubMed] [Cross Ref]
  • Van Assema P, Brug J, Ronda G, Steenhuis I, Oenema A. A short dutch questionnaire to measure fruit and vegetable intake: relative validity among adults and adolescents. Nutr Health. 2002;16:85–106. [PubMed]
  • Harada ND, Chiu V, King AC, Stewart AL. An evaluation of three self-report physical activity instruments for older adults. Med Sci Sports Exerc. 2001;33:962–970. doi: 10.1097/00005768-200106000-00016. [PubMed] [Cross Ref]
  • Stewart AL, Mills KM, King AC, Haskell WL, Gillis D, Ritter PL. CHAMPS physical activity questionnaire for older adults: outcomes for interventions. Med Sci Sports Exerc. 2001;33:1126–1141. [PubMed]
  • Mudde AN. Meetinstrumenten voor onderzoek naar roken en stoppen met roken. Den Haag , Stivoro; 2000.
  • Lemmens P, Tan ES, Knibbe RA. Measuring quantity and frequency of drinking in a general population survey: a comparison of five indices. J Stud Alcohol. 1992;53:476–486. [PubMed]
  • Horne R, Hankins M, Jenkins R. The Satisfaction with Information about Medicines Scale (SIMS): a new measurement tool for audit and research. Qual Health Care. 2001;10:135–140. doi: 10.1136/qhc.0100135... [PMC free article] [PubMed] [Cross Ref]
  • Conroy RM, Pyorala K, Fitzgerald AP, Sans S, Menotti A, De Backer G, De Bacquer D, Ducimetiere P, Jousilahti P, Keil U, Njolstad I, Oganov RG, Thomsen T, Tunstall Pedoe H, Tverdal A, Wedel H, Whincup P, Wilhelmsen L, Graham IM. Estimation of ten-year risk of fatal cardiovascular disease in Europe: the SCORE project. Eur Heart J. 2003;24:987–1003. doi: 10.1016/S0195-668X(03)00114-3. [PubMed] [Cross Ref]
  • Lipkus IM, Kuchibhatla M, McBride CM, Bosworth HB, Pollak KI, Siegler IC, Rimer BK. Relationships among breast cancer perceived absolute risk, comparative risk, and worries. Cancer Epidemiol Biomarkers Prev. 2000;9:973–975. [PubMed]
  • Edwards A, Elwyn G, Hood K, Robling M, Atwell C, Holmes Rovner M, Kinnersley P, Houston H, Russell I. The development of COMRADE - a patient-based outcome measure to evaluate the effectiveness of risk communication and treatment decision making in consultations. Patient Educ Couns. 2003;50:311–322. doi: 10.1016/S0738-3991(03)00055-7. [PubMed] [Cross Ref]
  • Perera R, Heneghan C, Yudkin P. Graphical method for depicting randomised trials of complex interventions. BMJ. 2007;334:127–129. doi: 10.1136/bmj.39045.396817.68. [PMC free article] [PubMed] [Cross Ref]

Articles from BMC Health Services Research are provided here courtesy of BioMed Central
PubReader format: click here to try

Formats:

Related citations in PubMed

See reviews...See all...

Cited by other articles in PMC

See all...

Links

  • PubMed
    PubMed
    PubMed citations for these articles

Recent Activity

Your browsing activity is empty.

Activity recording is turned off.

Turn recording back on

See more...