• We are sorry, but NCBI web applications do not support your browser and may not function properly. More information
Logo of jmirEditorial BoardMembershipSubmitCurrent IssueArchiveReviewSearchAboutJMIR PublicationsJMIR
J Med Internet Res. 2012 Mar-Apr; 14(2): e40.
Published online Mar 1, 2012. doi:  10.2196/jmir.1939
PMCID: PMC3376522

The Influence of User Characteristics and a Periodic Email Prompt on Exposure to an Internet-Delivered Computer-Tailored Lifestyle Program

Monitoring Editor: Bridgette Bewick
Reviewed by Zarnie Khadjesari and Nanhua Zhang

Abstract

Background

The Internet is a promising medium in the field of health promotion for offering tailored and targeted lifestyle interventions applying computer-tailored (CT) techniques to the general public. Actual exposure to CT interventions is not living up to its high expectations, as only a (limited) proportion of the target group is actually using these programs.

Objective

To investigate exposure to an Internet-delivered, CT lifestyle intervention, targeting physical activity, fruit and vegetable intake, smoking behavior, and alcohol intake, we focused on three processes: first use, prolonged use, and sustained use. The first objectives were to identify user characteristics that predict initiation of an online CT lifestyle program (first use) and completion of this program (prolonged use). Furthermore, we studied the effect of using a proactive strategy, consisting of periodic email prompts, on program revisits (sustained use).

Methods

The research population for this study consisted of Dutch adults participating in the Adult Health Monitor, offered by the regional public health services. We used a randomized controlled trial design to assess predictors of first use, prolonged use, and sustained use. Demographics and behavioral characteristics, as well as the strategy used for revisiting, were included as predictors in the model.

Results

A total of 9169 participants indicated their interest in the new program and 5168 actually logged in to the program. Participants significantly more likely to initiate one of the CT modules were male, older, and employed, and had a lower income, higher body mass index, and relatively unhealthy lifestyle. Participants significantly more likely to complete one of the CT modules were older and had a higher income and a relatively healthier lifestyle. Finally, using a proactive strategy influenced sustained use, with people from the prompting condition being more likely to revisit the program (odds ratio 28.92, 95% confidence interval 10.65–78.52; P < .001).

Conclusions

Older, male, and employed participants, and those with a lower income, higher body mass index, and a relatively unhealthy lifestyle were more likely to initiate a CT module. Module completers predominantly had a higher income and age. The current program therefore succeeded in reaching those people who benefit most from online lifestyle interventions. However, these people tended to disengage from the program. This underlines the importance of additional research into program adjustments and strategies that can be used to stimulate prolonged program use. Furthermore, sending periodic email prompts significantly increased revisits to the program. Though promising, this effect was modest and needs to be further examined, in order to maximize the potential of periodic email prompting.

Trial Registration

Nederlands Trial Register (NTR: 1786) and Medical Ethics Committee of Maastricht University and the University Hospital Maastricht (NL2723506809/MEC0903016); http://www.trialregister.nl/trialreg/admin/rctview.asp?TC=1786 (Archived by WebCite at http://www.webcitation.org/65hBXA6V7)

Keywords: Internet interventions, computer tailoring, lifestyle, behavior change, program use, user characteristics, diffusion, proactive strategy, prompts

Introduction

With a substantial number of people accessing the Internet in search of health-related information [1,2], the Internet has developed into a popular medium for offering a broad range of specific health information, such as information on health and illness, details on treatment-related issues, and information on health promotion practices, such as programs that offer information and advice on lifestyle behaviors [3]. Since Internet penetration rates are still expanding, with almost two billion people having access to the Internet [4], the number of health-related searches is also expected to increase. The Internet is therefore considered to be a promising medium in the field of health promotion for offering tailored and targeted promotion programs to the general public [4-7]. As online health-promoting applications provide many opportunities for interactivity, they are particularly suited for implementing interventions that offer immediate feedback and advice to users. In particular, lifestyle interventions applying computer-tailored (CT) techniques [5,6,8], addressing health behaviors such as physical activity [9,10], fruit and vegetable intake [11,12], smoking cessation [13-16], and alcohol consumption [17,18] have been shown to have positive effects on health behavior.

Despite these promising prospects, actual exposure to CT interventions is not living up to the high expectations [19-23], as only a (limited) proportion of the target group actually uses these programs [21]. Earlier studies defined exposure as pertaining to three different aspects: accessing the intervention (first use), engaging in the intervention content for a substantial period of time (prolonged use), and revisiting the intervention (sustained use) [19]. The level of first-time use of online interventions is generally low, with only small proportions of the potential target population actually accessing the intervention [19,24,25]. Levels of actual engagement in the intervention and of revisits to the intervention are even lower [26]. Since health behavior change is a complex process, actual change requires prolonged and sustained commitment to the program to enable optimal support during the change process. Intensive engagement in an intervention session allows processing of the intervention content and involvement in its effective components and is therefore essential [22,27,28]. Furthermore, a specific number of repeated visits to an intervention may be imperative, as, due to a high dose–response relation [29,30], sustained use of the program is essential to further maximize its effect on subsequent health behavior change [31,32].

To increase adoption rates of online interventions, it is imperative to obtain detailed profiles of those who successfully adopt an intervention [24,25]. By closely studying characteristics of these first-time users and mapping how they use and reuse the intervention, detailed knowledge can be acquired on intervention adopters. It is important to reach those people most in need of online lifestyle interventions—that is, the people who engage in risky behaviors such as smoking, excessive alcohol use, lack of physical activity, or unhealthy eating patterns. Even though unhealthy lifestyle behaviors are prevalent among the whole population [33,34], studies have shown that those who have a lower income and educational level (ie, a low socioeconomic status) are generally more inclined to have an unhealthy lifestyle [34,35]. Furthermore, even though Internet access rates are increasing among people with a lower socioeconomic status [35], their actual exposure to Internet interventions is lagging [36-39]. Besides socioeconomic status, other user characteristics are reported to have an influence on adoption of online interventions. Previous studies have pointed out that Internet interventions tend to reach women [40-43] and older people [44]. It is important to gain more insight into characteristics of people who are being reached by the program, but also of people who are left unexposed to the program. These insights can be used to acquire knowledge on the development of further steps to improve exposure to the program.

Besides focusing on first use of the program, it is also imperative to optimize prolonged use of the program and to study related determinants. Previous studies indicated that tailoring in itself is a strategy to prevent early disengagement from online behavior change programs [28,45,46]. Furthermore, specific user characteristics such as age, gender, and level of education are related to level of program engagement [28,30,40], with women, older people, and those who are more highly educated displaying higher levels of program engagement. Since engagement in the program is an important predictor of revisits to the program [46], it is important to map how the program is used and to study determinants of prolonged program use. This obtained knowledge can be used to make specific program adjustments, or to develop specific strategies that can be used to enhance prolonged use of the program.

Online interventions are often offered reactively to the public, implying that a passive approach is used, in which users themselves must act in order to repeatedly benefit from the intervention [47]. However, since attaining visitors’ loyalty to an intervention over an extended period of time is a very strenuous process [22,23,30], efforts should be put into ensuring sustained use by employing more proactive strategies [27]. The use of periodic email prompts has been proposed as an effective proactive strategy to boost revisits to interventions aimed at stimulating a healthy lifestyle [48]. However, most studies merely explored the effectiveness and efficacy of the whole intervention, instead of focusing on the added value of periodic prompting as a separate intervention component. As a consequence, there is too little evidence on the absolute effectiveness of sending periodic prompts.

In the present study, we aimed at answering three questions. First, which user characteristics predict initiation of an online CT program (first use)? Second, which user characteristics predict completion of the online CT program (prolonged use)? Third, what is the effect of using a proactive strategy, consisting of periodic email prompts, on program revisits (sustained use)? We addressed these questions among participants in an online CT intervention aimed at multiple health behaviors: physical activity, fruit and vegetable intake, smoking cessation, and alcohol consumption.

Methods

In this randomized controlled trial (RCT) we compared the effect on program revisit of a proactive technique applying a periodic email prompt versus the use of a reactive approach. Levels of use and reuse of the program within a 4-month period were studied and linked to specific user characteristics. The current RCT was part of a larger RCT testing the effect of the CT program compared with a control group [49]. Only people allocated to the study arm receiving computer tailoring of the larger RCT were included in the current RCT. This study was approved by the Medical Ethics Committee of Maastricht University and the University Hospital Maastricht (NL27235.068.09/MEC 09-3-016) and is described in more detail elsewhere [49,50].

The research population for this study consisted of Dutch adults of the provinces of Zeeland and North-Brabant, which participated in the Adult Health Monitor 2009 [51]. This Monitor is used by all regional public health services and takes place every 4 years. It serves as a monitoring tool to assess the overall level of health in the Dutch population by approaching a representative sample of the population to fill out a questionnaire assessing different aspects of general health (eg, physical and mental health) and health-related topics (eg, social and physical environment). Participants had the opportunity to complete a written or an online version of this monitoring questionnaire. The CT program was embedded in the online version and was offered as an additional service to online respondents. Data for the present study were collected from November 2009 to August 2010.

Procedure and Respondents

After completing the online version of the Adult Health Monitor, all participants were introduced to the program and were offered the opportunity to receive, free of charge, CT feedback about their current health behaviors, such as physical activity, fruit and vegetable intake, alcohol consumption, and smoking. This program consisted of several modules, one per behavior, which incorporated questionnaire items and provided feedback on several sociocognitive determinants of each health behavior. The content of the program modules was based on programs that have been proven to be effective in RCTs for increasing smoking cessation, promoting the intake of fruit and vegetables, increasing the level of physical activity, and reducing the consumption of alcohol [17,51-54].

Participants who were interested in the new program were asked to leave their email addresses. They received an email including an invitation to log in to the CT program with a personal log-in code and password, approximately 3 weeks after completion of the Monitor. By logging in to the program, participants received detailed information on the content and purpose of the study. Subsequently, data on demographics and the five health behaviors obtained through the Monitor were transported to the CT program, resulting in a personal overview of individuals’ current health behavior status. If respondents were not adhering to the Dutch public health guidelines set for these behaviors, a module generating CT health advice for changing behavior was available for each health behavior.

During a 4-month period after the baseline visit, we monitored use of the intervention. People in the prompting condition were prompted proactively via email 3 months after their baseline visit to revisit the CT program. Revisits to the program were stimulated to provide participants with the opportunity to monitor their own behavior. During a revisit participants could log in to the program and complete the health risk appraisal questionnaire. Based on their answers, a new personal health overview was composed entailing information on their current health behavior status, as well as on their status during all previous visits. Improvements, deteriorations, or stability of health behaviors were graphically presented. People in the no-prompting condition did not receive any additional prompts and were encouraged only at baseline to revisit the program. Reactions to this email prompt were monitored during a 1-month period.

Randomization

All included participants were randomly allocated to a prompting condition (receiving additional email prompts) or a no-prompting condition (receiving no additional email prompts). We used a computer software randomization device to determine random allocations at the respondent level.

Content

CT Program

The CT program used a dual approach to guide people toward behavior change. The first part consisted of a health risk appraisal and was aimed at increasing participants’ awareness of their health behavior status, by comparing their status to the Dutch public health guidelines set for these health behaviors (ie, being moderately physically active for 30 minutes at least 5 days a week, eating two pieces of fruit per day, eating 200 g of vegetables per day, not drinking more than one [women] or two [men] glasses of alcohol a day, and not smoking). In this health risk appraisal, feedback messages were used to inform people of their status for each health behavior and to provide them with additional information on the content of the separate guidelines. These feedback messages were complemented by using graphic representations of traffic lights [55], with a green light corresponding to adherence to the guidelines and a red light corresponding to nonadherence. An amber light was used for people who were close to adherence to these guidelines. In case of discrepancies between current behavior and the guidelines, people were alerted and directed to the CT modules.

Second, assistance was provided in changing participants’ health behavior by offering five separate CT modules. The content of these modules was based on the Integrated Model for exploring motivational and behavioral change (I-Change Model) [56]. The modules used a fixed, gradual approach consisting of four steps, guiding people toward behavior change. The first step addressed the pros and cons of engaging in the desired behavior under consideration. The second step focused on the role of significant persons in the direct environment and strategies on how to deal with lack of support and bad role models. The final two steps used planning strategies and were aimed at helping people form preparatory plans to start changing their behavior (step 3) and coping plans to help them overcome difficult situations and prevent relapse (step 4) after changing their behavior. Within the modules, all health advice was adapted to individuals’ characteristics by considering demographic, behavioral, and cognitive characteristics [57-59]. Demographic and behavioral characteristics, such as participants’ gender and health behavior status, were directly obtained through the Adult Health Monitor. Cognitive variables, such as attitude, perceived social influence, self-efficacy, intention, and planning strategies (action plans and coping plans), were assessed by using an additional tailoring questionnaire.

The CT modules were embedded in a website (http://www.mijngezondgedrag.nl/) that was especially designed for the current project. This website contained general information considering a healthy lifestyle and the selected health behaviors. Furthermore, the website provided specific information regarding the project, a direct link to the CT program, and information on frequently asked questions. During the study, new information (eg, advice-supporting messages, recipes, and facts) was structurally added to the website.

Email Prompt

Participants in the prompting condition received an email 3 months after their baseline visit, prompting them to revisit the program. This email opened with a personalized greeting and reminded people about their first visit to the program. Subsequently, people were invited to revisit the program to obtain information on their health status and to monitor their progress. Participants were also informed of the opportunity to receive additional, iterative health advice on the health behavior(s) selected at baseline or on a new behavior. Finally, to facilitate logging in to the program, the email also contained details on personal log-in information (user name and password). The email concluded with greetings from the research team and contact information.

Measures

We collected user characteristics to produce a detailed user profile including information on personal characteristics, health behavior status, and intention to change their health behaviors.

Personal Characteristics

Questions pertaining to personal characteristics included questions on age, gender, educational level, personal net monthly income, work situation, marital status, and native country (Table 1).

Table 1
Characteristics of visitors to an online computer-tailored lifestyle program (n = 3448).

Health Behavior Status

Health behavior status consisted of information regarding the five key behaviors. Physical activity was measured by the Short Questionnaire to Assess Health-Enhancing Physical Activity [60], and guideline adherence was calculated following procedures used by Ainsworth et al [61]. Fruit consumption was measured by using a 4-item food frequency questionnaire assessing weekly fruit and fruit juice intake [62], and vegetable consumption was measured using a 4-item food frequency questionnaire assessing the weekly amount of consumed boiled or baked vegetables as well as salad or raw vegetables [62]. The consumption of alcohol was measured by the Dutch Quantity-Frequency-Variability Questionnaire [63]. And finally, smoking status was assessed by asking participants whether they smoked, what they smoked (cigarettes, cigars, packets of pipe tobacco) and how much they smoked per day (cigarettes) and per week (cigars or packets pipe tobacco).

Body Mass Index

Data on participants’ height (in centimeters) and weight (in kilograms) were used to calculate their body mass index (BMI). BMI is a heuristic used to estimate the level of body fat, and it is defined by dividing a participant’s body weight by the square of the participant’s height.

Intention to Change

Intention to change a health behavior was measured by means of 1 item using an algorithm consisting of 10 stages varying from unawareness to action. This variable was recoded in accordance with an adjusted version of the stages of change concept: immotivation (1), precontemplation (2), contemplation (3), preparation (4), and action (5) [64].

Program Evaluation

After completion of each single module, visitors were asked to evaluate the module by providing an overall grade (1 to 10).

Outcomes

To measure first use of the program, we created a dichotomous variable based on program monitoring data, indicating whether participants initiated a module. Initiating a module was labeled as yes when people filled out the first question of this module. To measure prolonged use, we created a new dichotomous variable to indicate whether participants finished a module. Completion of a module was labeled as yes when people also filled out the final question of the module.

To establish sustained use of the program, we created another dichotomous variable, indicating whether participants logged in to the program after baseline. Revisiting of the program was measured by comparing the dates of log-in with the baseline date.

Statistical Analysis

First, we used general descriptive statistics to describe personal characteristics of the participants, as well as the main findings concerning current health behavior adherence to the public health guidelines. Second, logistic regression analyses were conducted. Initiation of a module and completion of a module (0 = no/1 = yes) were the dependent variables. Demographics (age, gender, marital status, native country, educational level, work status, and income), BMI, and health behavior status were included in the model as predictors of initiation. We included the same variables, with addition of intention (measured at the beginning of each CT module), in the model as predictors of completion. Logistic regression analysis was conducted with revisiting of the program (0 = no/1 = yes) as the dependent variable. The same demographics, as well as study condition, program evaluation, and initiation and completion of a module, were included in the model as predictors of revisiting of the program. All statistical analyses were done in SPSS version 7.0 (IBM Corporation, Somers, NY, USA).

Results

Site Visitors’ Baseline Characteristics

In total, 3448 people were allocated to the study arm receiving computer tailoring of the larger RCT and were included in the current RCT. Of all participants, with a mean age of 44 (SD 12.60) years, a little more than half were men, and most had a medium to high education level and an average to high monthly income (Table 1). Three-quarters of all participants were employed and more than half were married. Approximately 2% (57/3448) of all visitors were underweight, whereas more than half had a normal weight. One-third of visitors were slightly overweight and 10.3% (356/3448) were obese. A randomization check revealed no significant differences between respondents in the prompting and no-prompting condition.

Regarding the five health behaviors included in the program, 14.8% (509/3448) did not comply with the Dutch guidelines of at least 30 minutes of moderately intensive physical activity at least 5 days a week. With regard to fruit and vegetable intake, respectively 54.99% (1896/3448) and 67.49% (2327/3448) were not adhering to the Dutch guidelines of at least two pieces of fruit and at least 200 g of vegetables each day. About one in five visitors indicated to smoke 19.1% (658/3448), and a little more than a quarter (981/3448, 28.5%) did not comply with the Dutch guidelines for alcohol intake.

First Use of the Program

CT Module Initiation

A total of 1338 participants (38.81%) did not participate in the second part of the program, leaving after receiving their personal health overview. The remaining 2110 visitors (61.19%) decided to obtain CT lifestyle advice by initiating one of the five behavioral modules. Of all the visitors who decided to obtain personalized health advice, 13.0% (n = 275) initiated the physical activity module, 35.4% (n = 747) and 29.4% (n = 621) initiated the vegetable and fruit modules, respectively, 9.1% (n = 191) initiated the smoking module, and 13.1% (n = 276) initiated the alcohol module (Figure 1).

Figure 1
Flowchart exposure to CT program: first use, prolonged use and sustained use.

Predictors of CT Module Initiation

Results of multiple logistic regression analyses indicated that male, older, and employed participants, and those with a lower income and a higher BMI were more likely to initiate one of the CT modules (Table 2). Initiation of a CT module was related to the total number of guidelines people adhered to: those with a relatively unhealthy lifestyle (fewer guidelines complied with) were more likely to initiate one of the CT modules (odds ratio [OR] 0.84, 95% confidence interval [CI] 0.77–0.90; P < .001).

Table 2
Results of multivariate logistic regression analyses of demographic characteristics, behavioral characteristic, and intention, with initiating a behavioral computer-tailored module as dependent variable (n = 3448).

*Significant association (P < .05).

Prolonged Use of the CT Program

CT Module Completion

Of all the visitors who initiated one of the CT modules to obtain personalized health advice (n = 2110), 62.37% completed a module (n = 1316). A total of 153 of 275 visitors completed the physical activity module (55.6%), 462/747 (61.9%) and 403/621 (64.9%) completed the vegetable and fruit modules, respectively, 130/191 (68.1%) completed the smoking module, and 168/276 (60.9%) completed the alcohol module (Figure 1). All modules were evaluated by visitors upon completion. The physical activity module was graded 7.09 (SD 1.41), vegetable consumption 7.45 (SD 1.02), fruit consumption 7.33 (SD 1.29), smoking 7.35 (SD 1.11), and alcohol consumption 7.39 (SD 1.11).

Predictors of CT Module Completion

Results of multiple logistic regression analyses indicated that older participants and participants with a higher income were more likely to complete one of the CT modules (Table 3). Participants with a relatively healthy lifestyle (complying with more guidelines) were also more likely to complete one of the CT modules.

Table 3
Results of multivariate logistic regression analyses of demographic characteristics, behavioral characteristic, and intention, with completion of a behavioral computer-tailored module as dependent variable (n = 2110).

*Significant association (P < .05).

Sustained Use of the CT Program

Additional emails prompting a revisit to the program were sent to 51.91% of all participants (n = 1790), while 48.09% (n = 1658) did not receive an additional reminder. In total, 3.5% (n =  120) of all visitors decided to revisit the program within a 4-month period after baseline. Among those in the prompting condition, 0.2% (n = 3) revisited the program within the first 3 months (before receiving an additional reminder). A total of 113 participants (6.3%) reacted to the email prompt after 3 months and revisited the program. This number was significantly higher than in the no-prompting condition that received no additional reminder (n = 0, 0.0%; OR 28.92, CI 10.65–78.52; P < .001).

Since the number of people from the control condition who revisited the program was extremely low (n = 4), we conducted additional analyses on predictors of revisiting solely within the experimental condition. Univariate logistic regression analyses revealed that completion of a behavior change module significantly predicted revisiting the program (OR 2.58, CI 1.57–4.26; P < .001). However, after multivariate analyses, including all predictors, this effect became nonsignificant.

Discussion

The current study aimed at investigating the level of exposure to a CT online lifestyle program integrated into the Dutch Adult Health Monitor. We addressed user characteristics that predicted initiation (first use) and completion (prolonged use) of the CT program and tested a proactive strategy using periodic email prompts to enhance revisits to the program (sustained use).

First Use

Since people with a lower income and educational level are generally more inclined to have an unhealthy lifestyle [36,65], the current program aimed at reaching especially those people in need of lifestyle improvement. However, in line with previous studies, the majority of participants in our sample had a medium to high educational level, an average income, and a relatively healthy lifestyle [36-39]. Even though integrating the CT program into the Monitor environment provided an access point for reaching a substantial proportion of the research population through tailored lifestyle advice, it did not succeed in predominantly reaching the people who benefit most from CT interventions.

However, taking a closer look at CT module initiation reveals that initiators were significantly older, and likelier to be male, employed, and to have a lower income. Furthermore, participants with a higher BMI and an unhealthier lifestyle were more likely to start with one of the CT modules. Whereas the findings concerning age and gender are largely comparable with those of earlier studies [28,30,38,40], the present results are in contrast to previous findings that online health promotion programs tend to be used predominantly by people with a high socioeconomic status and healthy lifestyle [28,30,38,40].

The results imply that the current program succeeded in stimulating those people who are expected to benefit most from lifestyle interventions (ie, the people who engage in risky behaviors, but also people from specific risk groups such as older people and obese people) to initiate one of the CT modules. Embedding the CT program in an existing context, the Adult Health Monitor, may account for these findings. The main objective of the Monitor is to assess different aspects of general health and health-related topics, such as curative care, environment and everyday surroundings, social environment, social safety and violence and nursing and care. Due to this simple focus on assessment and not on health behavior change, participation may have been appealing to participants who are not primarily interested in behavior change. However, direct transportation of data from the Monitor to the CT program database allowed for the immediate and effortless composition of a personal health overview. Subsequently, this overview may have increased awareness of people’s lifestyle status and might have served as a cue to action to change their lifestyle, explaining the increased interest in the CT modules, among the unhealthy and low-socioeconomic status participants.

Prolonged Use

Even though the CT program succeeded in attracting people with a relatively unhealthy lifestyle and low-socioeconomic status people to initiate one of the CT modules, it fell short in actually engaging these visitors, since module completers predominantly had a higher income, which is in line with previous studies [28,30,38,40]. The suboptimal level of interactivity within the CT program might account for these findings. Interactivity has been defined as the degree of 2-way interaction that is provided in the program [66,67], providing options for either immediate feedback or reciprocal interaction. Even though the program provided immediate feedback consisting of personalized health information, it did not provide communication features such as email contact and a discussion board, or features such as videos and games [68].

Effort should therefore be put into adjusting program components and content to the needs and wishes of this target group and into developing strategies to keep low-socioeconomic status participants engaged in the program.

Sustained Use

Our results from the current study indicate that prompting visitors to revisit the CT program is an effective strategy to enhance sustained use. However, the effect was limited, with only small percentages of people actually responding to the prompt. Replicating this study is therefore desirable. A possible explanation for these results might be the level of tailoring in the prompt. Although the content of the prompt was tailored to user characteristics, the level of personalization may have been too low, making the prompt less appealing and relevant. Furthermore, since the first prompt was sent after 3 months, people may have forgotten about the program and their participation in it.

The added value of the email prompts used in the present study could be further augmented. Several studies have suggested that the effect of email prompts increases if they alert people to new content that is provided on the program website [69] and if they provide information that is perceived as personally relevant [48,70]. Furthermore, the time of week when prompts are sent influences their effect, with prompts being sent at the beginning of the week being more effective [70].

Since email is a very popular online function used by substantial number of Internet users [71], it is a promising tool to attract people to health-promoting interventions. However, a potential downside of its popularity is the frequent use of email for marketing purposes. Due to the increase in email advertisements, or spam, dissatisfaction among email users is increasing [71] and emails are often neglected or deleted before being read. Future studies should therefore aim at developing prompt content that attracts receivers’ attention amidst a plethora of emails sent for marketing purposes. Furthermore, the optimal frequency at which prompts are delivered should be studied to yield further knowledge on future refinements and to maximize their potential.

Strengths and Limitations

This study focused on exposure to an online CT lifestyle program by mapping characteristics of first-time users, examining predictors of first, prolonged and sustained use and by testing the efficacy of a proactive strategy to increase sustained use of the program. Even though several studies have highlighted the added value of periodic email prompts [48], this study is one of the few to focus on the added value of periodic prompting by testing its effect in a randomized control trial.

However, this study is liable to several limitations that need to be accounted for when interpreting the results. First, we used one generic email to prompt revisits to the CT program. Future research should thoroughly study the optimal content of prompts, in order to make them stand out amidst advertisement emails and spam, and to make them more personally relevant and persuasive. Principles used in the field of e-marketing and e-commerce might provide essential information on specific strategies to increase the attractiveness of email prompts.

Finally, even though this study provides evidence for the effectiveness of prompts in enhancing program revisits, additional research is needed to study their effect on subsequent behavior change because, due to a high dose–response relation, multiple visits to the program are necessary to maximize its effect on health behavior.

Conclusion

We found that the CT modules were significantly more often initiated by older, male, employed, low-income participants with a relatively unhealthy lifestyle, which implies that the program succeeded in reaching and engaging those people who benefit most from online lifestyle interventions. However, people with a lower income tended to disengage from the CT program before finishing the modules. This underlines the importance of additional research into specific program adjustment and strategies that can be used to stimulate prolonged program use by low-socioeconomic status visitors. Furthermore, sending periodic email prompts significantly increased revisits to the program. Though promising, this effect was modest and needs to be further examined, in order to maximize the potential of periodic email prompting.

Acknowledgments

This study was funded by ZonMw, the Netherlands Organization for Health Research and Development (grant number: 120710004). Publication of the manuscript was supported by NWO, the Netherlands Organization for Scientific Research.

Abbreviations

BMI
body mass index
CT
computer tailored

Footnotes

Conflicts of Interest:

Hein de Vries is scientific director of Vision2Health, a company that licenses evidence-based innovative computer-tailored health communication tools.

References

1. Eysenbach G, Köhler C. How do consumers search for and appraise health information on the world wide web? Qualitative study using focus groups, usability tests, and in-depth interviews. BMJ. 2002 Mar 9;324(7337):573–7. http://bmj.com/cgi/pmidlookup?view=long&pmid=11884321. [PMC free article] [PubMed]
2. Fox S. Health topics: 80% of Internet users look for health information online. Washington, DC: Pew Internet & American Life Project; 2011. Feb 01, [2012-02-24]. webcite http://www.pewinternet.org/~/media/Files/Reports/2011/PIP_HealthTopics.pdf.
3. Bansil P, Keenan NL, Zlot AI, Gilliland JC. Health-related information on the Web: results from the HealthStyles Survey, 2002-2003. Prev Chronic Dis. 2006 Apr;3(2):A36. http://www.cdc.gov/pcd/issues/2006/apr/05_0155.htm.A36 [PMC free article] [PubMed]
4. Internet World Stats . Internet World Stats. Internet World Stats; 2011. Dec 31, [2012-02-27]. webcite Internet Usage Statistics: The Internet Big Picture http://www.internetworldstats.com/stats.htm.
5. Brug J, Oenema A, Kroeze W, Raat H. The internet and nutrition education: challenges and opportunities. Eur J Clin Nutr. 2005 Aug;59 Suppl 1:S130–7; discussion S138. doi: 10.1038/sj.ejcn.1602186.1602186 [PubMed] [Cross Ref]
6. Ritterband LM, Gonder-Frederick LA, Cox DJ, Clifton AD, West RW, Borowitz S. Internet interventions: in review, in use and into the future. Prof Psychol Res Pr. 2003;34:527–34. doi: 10.1037/0735-7028.34.5.527. [Cross Ref]
7. Lustria ML, Cortese J, Noar SM, Glueckauf RL. Computer-tailored health interventions delivered over the Web: review and analysis of key components. Patient Educ Couns. 2009 Feb;74(2):156–73. doi: 10.1016/j.pec.2008.08.023.S0738-3991(08)00469-2 [PubMed] [Cross Ref]
8. Krebs P, Prochaska JO, Rossi JS. A meta-analysis of computer-tailored interventions for health behavior change. Prev Med. 2010;51(3-4):214–21. doi: 10.1016/j.ypmed.2010.06.004.S0091-7435(10)00231-8 [PMC free article] [PubMed] [Cross Ref]
9. van den Berg MH, Schoones JW, Vliet Vlieland TP. Internet-based physical activity interventions: a systematic review of the literature. J Med Internet Res. 2007;9(3):e26. doi: 10.2196/jmir.9.3.e26. http://www.jmir.org/2007/3/e26/v9i3e26 [PMC free article] [PubMed] [Cross Ref]
10. Vandelanotte C, Spathonis KM, Eakin EG, Owen N. Website-delivered physical activity interventions a review of the literature. Am J Prev Med. 2007 Jul;33(1):54–64. doi: 10.1016/j.amepre.2007.02.041.S0749-3797(07)00164-X [PubMed] [Cross Ref]
11. Neville LM, O'Hara B, Milat AJ. Computer-tailored dietary behaviour change interventions: a systematic review. Health Educ Res. 2009 Aug;24(4):699–720. doi: 10.1093/her/cyp006. http://her.oxfordjournals.org/cgi/pmidlookup?view=long&pmid=19286893.cyp006 [PMC free article] [PubMed] [Cross Ref]
12. Brug J, Glanz K, Van Assema P, Kok G, van Breukelen GJ. The impact of computer-tailored feedback and iterative feedback on fat, fruit, and vegetable intake. Health Educ Behav. 1998 Aug;25(4):517–31. [PubMed]
13. Borland R, Balmford J, Hunt D. The effectiveness of personally tailored computer-generated advice letters for smoking cessation. Addiction. 2004 Mar;99(3):369–77. doi: 10.1111/j.1360-0443.2003.00623.x.ADD623 [PubMed] [Cross Ref]
14. Strecher VJ. Computer-tailored smoking cessation materials: a review and discussion. Patient Educ Couns. 1999 Feb;36(2):107–17.S0738-3991(98)00128-1 [PubMed]
15. Myung SK, McDonnell DD, Kazinets G, Seo HG, Moskowitz JM. Effects of Web- and computer-based smoking cessation programs: meta-analysis of randomized controlled trials. Arch Intern Med. 2009 May 25;169(10):929–37. doi: 10.1001/archinternmed.2009.109. http://archinte.ama-assn.org/cgi/pmidlookup?view=long&pmid=19468084.169/10/929 [PubMed] [Cross Ref]
16. Dijkstra A, De Vries H, Roijackers J. Long-term effectiveness of computer-generated tailored feedback in smoking cessation. Health Educ Res. 1998 Jun;13(2):207–14. http://her.oxfordjournals.org/cgi/pmidlookup?view=long&pmid=10181019. [PubMed]
17. Riper H, Kramer J, Smit F, Conijn B, Schippers G, Cuijpers P. Web-based self-help for problem drinkers: a pragmatic randomized trial. Addiction. 2008 Feb;103(2):218–27. doi: 10.1111/j.1360-0443.2007.02063.x.ADD2063 [PubMed] [Cross Ref]
18. White A, Kavanagh D, Stallman H, Klein B, Kay-Lambkin F, Proudfoot J, Drennan J, Connor J, Baker A, Hines E, Young R. Online alcohol interventions: a systematic review. J Med Internet Res. 2010;12(5):e62. doi: 10.2196/jmir.1479. http://www.jmir.org/2010/5/e62/v12i5e62 [PMC free article] [PubMed] [Cross Ref]
19. Crutzen R. Hard to Get, Hard to Keep: Dissemination of and Exposure to Internet-Delivered Health Behavior Change Interventions Aimed at Adolescents [doctoral thesis] Maastricht, Netherlands: Maastricht University; 2009.
20. De Nooijer JOA, Kloek G, Brug J, De Vries H, De Vries NK. Bevordering van gezondheidsgedrag via internet: nu en in de toekomst [Promotion of Healthy Behavior Through the Internet: Now and in the Future] Maastricht: Maastricht University; 2005.
21. Evers KE, Cummins CO, Prochaska JO, Prochaska JM. Online health behavior and disease management programs: are we ready for them? Are they ready for us? J Med Internet Res. 2005 Jul 1;7(3):e27. doi: 10.2196/jmir.7.3.e27. http://www.jmir.org/2005/3/e27/v7i3e27 [PMC free article] [PubMed] [Cross Ref]
22. Eysenbach G. The law of attrition. J Med Internet Res. 2005;7(1):e11. doi: 10.2196/jmir.7.1.e11. http://www.jmir.org/2005/1/e11/v7e11 [PMC free article] [PubMed] [Cross Ref]
23. Glasgow RE, Nelson CC, Kearney KA, Reid R, Ritzwoller DP, Strecher VJ, Couper MP, Green B, Wildenhaus K. Reach, engagement, and retention in an Internet-based weight loss program in a multi-site randomized controlled trial. J Med Internet Res. 2007;9(2):e11. doi: 10.2196/jmir.9.2.e11. http://www.jmir.org/2007/2/e11/v9i2e11 [PMC free article] [PubMed] [Cross Ref]
24. Glasgow RE, Vogt TM, Boles SM. Evaluating the public health impact of health promotion interventions: the RE-AIM framework. Am J Public Health. 1999 Sep;89(9):1322–7. [PMC free article] [PubMed]
25. Rogers EM. Diffusion of Innovations. New York, NY: Free Press; 1995.
26. Brouwer W, Kroeze W, Crutzen R, de Nooijer J, de Vries NK, Brug J, Oenema A. Which intervention characteristics are related to more exposure to internet-delivered healthy lifestyle promotion interventions? A systematic review. J Med Internet Res. 2011;13(1):e2. doi: 10.2196/jmir.1639. http://www.jmir.org/2011/1/e2/v13i1e2 [PMC free article] [PubMed] [Cross Ref]
27. Danaher BG, Boles SM, Akers L, Gordon JS, Severson HH. Defining participant exposure measures in Web-based health behavior change programs. J Med Internet Res. 2006;8(3):e15. doi: 10.2196/jmir.8.3.e15. http://www.jmir.org/2006/3/e15/v8i3e15 [PMC free article] [PubMed] [Cross Ref]
28. Strecher VJ, McClure J, Alexander G, Chakraborty B, Nair V, Konkel J, Greene S, Couper M, Carlier C, Wiese C, Little R, Pomerleau C, Pomerleau O. The role of engagement in a tailored web-based smoking cessation program: randomized controlled trial. J Med Internet Res. 2008;10(5):e36. doi: 10.2196/jmir.1002. http://www.jmir.org/2008/5/e36/v10i5e36 [PMC free article] [PubMed] [Cross Ref]
29. Crutzen R, de Nooijer J, Candel MJ, de Vries NK. Adolescents who intend to change multiple health behaviours choose greater exposure to an internet-delivered intervention. J Health Psychol. 2008 Oct;13(7):906–11. doi: 10.1177/1359105308095064.13/7/906 [PubMed] [Cross Ref]
30. Verheijden MW, Jans MP, Hildebrandt VH, Hopman-Rock M. Rates and determinants of repeated participation in a web-based behavior change program for healthy body weight and healthy lifestyle. J Med Internet Res. 2007;9(1):e1. doi: 10.2196/jmir.9.1.e1. http://www.jmir.org/2007/1/e1/v9i1e1 [PMC free article] [PubMed] [Cross Ref]
31. Christensen H, Griffiths KM, Farrer L. Adherence in internet interventions for anxiety and depression. J Med Internet Res. 2009;11(2):e13. doi: 10.2196/jmir.1194. http://www.jmir.org/2009/2/e13/v11i2e13 [PMC free article] [PubMed] [Cross Ref]
32. Norman GJ, Zabinski MF, Adams MA, Rosenberg DE, Yaroch AL, Atienza AA. A review of eHealth interventions for physical activity and dietary behavior change. Am J Prev Med. 2007 Oct;33(4):336–45. doi: 10.1016/j.amepre.2007.05.007.S0749-3797(07)00363-7 [PMC free article] [PubMed] [Cross Ref]
33. World Health Organization World Health Organization. 2007. Feb, [2012-02-27]. webcite The Top Ten Causes of Death: Fact Sheet No 310 http://www.who.int/mediacentre/factsheets/fs310.pdf.
34. Rijksinstituut voor Volksgezondheid en Milieu Rijksinstituut voor Volksgezondheid en Milieu. 2012. Jan 31, [2012-02-27]. webcite Volksgezondheid Toekomst Verkenning: Nationaal Kompas Volksgezondheid http://www.nationaalkompas.nl/
35. Tu HT, Cohen GR. Striking jump in consumers seeking health care information. Track Rep. 2008 Aug;(20):1–8. [PubMed]
36. Yang S, Lynch J, Schulenberg J, Roux AV, Raghunathan T. Emergence of socioeconomic inequalities in smoking and overweight and obesity in early adulthood: the national longitudinal study of adolescent health. Am J Public Health. 2008 Mar;98(3):468–77. doi: 10.2105/AJPH.2007.111609.AJPH.2007.111609 [PMC free article] [PubMed] [Cross Ref]
37. Lorence D, Park H. Group disparities and health information: a study of online access for the underserved. Health Informatics J. 2008 Mar;14(1):29–38. doi: 10.1177/1460458207086332.14/1/29 [PubMed] [Cross Ref]
38. Spittaels H, De Bourdeaudhuij I, Brug J, Vandelanotte C. Effectiveness of an online computer-tailored physical activity intervention in a real-life setting. Health Educ Res. 2007 Jun;22(3):385–96. doi: 10.1093/her/cyl096. http://her.oxfordjournals.org/cgi/pmidlookup?view=long&pmid=16971674.cyl096 [PubMed] [Cross Ref]
39. Vandelanotte C, De Bourdeaudhuij I, Sallis JF, Spittaels H, Brug J. Efficacy of sequential or simultaneous interactive computer-tailored interventions for increasing physical activity and decreasing fat intake. Ann Behav Med. 2005 Apr;29(2):138–46. doi: 10.1207/s15324796abm2902_8. [PubMed] [Cross Ref]
40. Brouwer W, Oenema A, Raat H, Crutzen R, de Nooijer J, de Vries NK, Brug J. Characteristics of visitors and revisitors to an Internet-delivered computer-tailored lifestyle intervention implemented for use by the general public. Health Educ Res. 2010 Aug;25(4):585–95. doi: 10.1093/her/cyp063. http://her.oxfordjournals.org/cgi/pmidlookup?view=long&pmid=19897515.cyp063 [PubMed] [Cross Ref]
41. Etter JF. Comparing the efficacy of two Internet-based, computer-tailored smoking cessation programs: a randomized trial. J Med Internet Res. 2005;7(1):e2. doi: 10.2196/jmir.7.1.e2. http://www.jmir.org/2005/1/e2/v7e2 [PMC free article] [PubMed] [Cross Ref]
42. Harvey-Berino J, Pintauro S, Buzzell P, DiGiulio M, Casey Gold B, Moldovan C, Ramirez E. Does using the Internet facilitate the maintenance of weight loss? Int J Obes Relat Metab Disord. 2002 Sep;26(9):1254–60. doi: 10.1038/sj.ijo.0802051. http://dx.doi.org/10.1038/sj.ijo.0802051. [PubMed] [Cross Ref]
43. Spittaels H, De Bourdeaudhuij I. Who participates in a computer-tailored physical activity program delivered through the Internet? A comparison of participants' and non-participants' characteristics. Int J Behav Nutr Phys Act. 2007;4:39. doi: 10.1186/1479-5868-4-39. http://www.ijbnpa.org/content/4//39.1479-5868-4-39 [PMC free article] [PubMed] [Cross Ref]
44. Steyaert J, de Haan J. Jaarboek ICT en samenleving 2007: Gewoon digitaal [Yearbook ICT and Society 2007: Simply Digital] Amsterdam: Boom; 2007.
45. Brouwer W, Oenema A, Crutzen R, de Nooijer J, de Vries NK, Brug J. An exploration of factors related to dissemination of and exposure to internet-delivered behavior change interventions aimed at adults: a Delphi study approach. J Med Internet Res. 2008;10(2):e10. doi: 10.2196/jmir.956. http://www.jmir.org/2008/2/e10/v10i2e10 [PMC free article] [PubMed] [Cross Ref]
46. Couper MP, Alexander GL, Zhang N, Little RJ, Maddy N, Nowak MA, McClure JB, Calvi JJ, Rolnick SJ, Stopponi MA, Cole Johnson C. Engagement and retention: measuring breadth and depth of participant use of an online intervention. J Med Internet Res. 2010;12(4):e52. doi: 10.2196/jmir.1430. http://www.jmir.org/2010/4/e52/v12i4e52 [PMC free article] [PubMed] [Cross Ref]
47. Prochaska JO, Velicer WF, Fava JL, Rossi JS, Tsoh JY. Evaluating a population-based recruitment approach and a stage-based expert system intervention for smoking cessation. Addict Behav. 2001;26(4):583–602.S0306-4603(00)00151-9 [PubMed]
48. Fry JP, Neff RA. Periodic prompts and reminders in health promotion and health behavior interventions: systematic review. J Med Internet Res. 2009;11(2):e16. doi: 10.2196/jmir.1138. http://www.jmir.org/2009/2/e16/v11i2e16 [PMC free article] [PubMed] [Cross Ref]
49. Schulz DN, Kremers SP, van Osch LA, Schneider F, van Adrichem MJ, de Vries H. Testing a Dutch web-based tailored lifestyle programme among adults: a study protocol. BMC Public Health. 2011;11:108. doi: 10.1186/1471-2458-11-108. http://www.biomedcentral.com/1471-2458/11/108.1471-2458-11-108 [PMC free article] [PubMed] [Cross Ref]
50. Schneider F, van Osch LA, Kremers SP, Schulz DN, van Adrichem MJ, de Vries H. Optimizing diffusion of an online computer tailored lifestyle program: a study protocol. BMC Public Health. 2011;11:480. doi: 10.1186/1471-2458-11-480. http://www.biomedcentral.com/1471-2458/11/480.1471-2458-11-480 [PMC free article] [PubMed] [Cross Ref]
51. Brug J, Steenhuis I, van Assema P, Glanz K, De Vries H. Computer-tailored nutrition education: differences between two interventions. Health Educ Res. 1999 Apr;14(2):249–56. http://her.oxfordjournals.org/cgi/pmidlookup?view=long&pmid=10387504. [PubMed]
52. Te Poel F, Bolman C, Reubsaet A, de Vries H. Efficacy of a single computer-tailored e-mail for smoking cessation: results after 6 months. Health Educ Res. 2009 Dec;24(6):930–40. doi: 10.1093/her/cyp036. http://her.oxfordjournals.org/cgi/pmidlookup?view=long&pmid=19574405.cyp036 [PubMed] [Cross Ref]
53. Smeets T, Brug J, de Vries H. Effects of tailoring health messages on physical activity. Health Educ Res. 2008 Jun;23(3):402–13. doi: 10.1093/her/cyl101. http://her.oxfordjournals.org/cgi/pmidlookup?view=long&pmid=17032705.cyl101 [PubMed] [Cross Ref]
54. van Keulen HM, Mesters I, Brug J, Ausems M, Campbell M, Resnicow K, Zwietering PJ, van Breukelen G, van Mechelen W, Severens JL, de Vries H. Vitalum study design: RCT evaluating the efficacy of tailored print communication and telephone motivational interviewing on multiple health behaviors. BMC Public Health. 2008;8:216. doi: 10.1186/1471-2458-8-216. http://www.biomedcentral.com/1471-2458/8/216.1471-2458-8-216 [PMC free article] [PubMed] [Cross Ref]
55. Bergström G, Björklund C, Fried I, Lisspers J, Nathell L, Hermansson U, Helander A, Bodin L, Jensen IB. A comprehensive workplace intervention and its outcome with regard to lifestyle, health and sick leave: the AHA study. Work. 2008;31(2):167–80. [PubMed]
56. de Vries H, Mudde A, Leijs I, Charlton A, Vartiainen E, Buijs G, Clemente MP, Storm H, González Navarro A, Nebot M, Prins T, Kremers S. The European Smoking Prevention Framework Approach (EFSA): an example of integral prevention. Health Educ Res. 2003 Oct;18(5):611–26. http://her.oxfordjournals.org/cgi/pmidlookup?view=long&pmid=14572020. [PubMed]
57. de Vries H, Brug J. Computer-tailored interventions motivating people to adopt health promoting behaviours: introduction to a new approach. Patient Educ Couns. 1999 Feb;36(2):99–105.S073839919800127X [PubMed]
58. Dijkstra A, De Vries H. The development of computer-generated tailored interventions. Patient Educ Couns. 1999 Feb;36(2):193–203.S0738-3991(98)00135-9 [PubMed]
59. Kreuter M, Farrell D, Olevitch L, Brennan L. Tailoring Health Messages: Customizing Communication With Computer Technology. Mahwah, NJ: Lawrence Erlbaum Associates; 2000.
60. Wendel-Vos GC, Schuit AJ, Saris WH, Kromhout D. Reproducibility and relative validity of the short questionnaire to assess health-enhancing physical activity. J Clin Epidemiol. 2003 Dec;56(12):1163–9.S0895435603002208 [PubMed]
61. Ainsworth BE, Haskell WL, Whitt MC, Irwin ML, Swartz AM, Strath SJ, O'Brien WL, Bassett DR, Schmitz KH, Emplaincourt PO, Jacobs DR, Leon AS. Compendium of physical activities: an update of activity codes and MET intensities. Med Sci Sports Exerc. 2000 Sep;32(9 Suppl):S498–504. [PubMed]
62. Anonymous . Lokale en nationale Monitor gezondheid: indicatoren voor de Monitor Volksgezondheid [Local and National Health Monitor: Indicators of the Public Health Monitor] Bilthoven: Rijksinstituut voor Volksgezondheid en Milieu; 2005.
63. Lemmens P, Tan ES, Knibbe RA. Measuring quantity and frequency of drinking in a general population survey: a comparison of five indices. J Stud Alcohol. 1992 Sep;53(5):476–86. [PubMed]
64. Dijkstra A, Roijackers J, De Vries H. Smokers in four stages of readiness to change. Addict Behav. 1998;23(3):339–50.S0306-4603(97)00070-1 [PubMed]
65. Roos G, Johansson L, Kasmel A, Klumbiené J, Prättälä R. Disparities in vegetable and fruit consumption: European cases from the north to the south. Public Health Nutr. 2001 Feb;4(1):35–43.S1368980001000064 [PubMed]
66. Kiousis S. Interactivity: a concept explication. New Media Soc. 2002;4:355–83. doi: 10.1177/146144480200400303. [Cross Ref]
67. Noar SM, Clark A, Cole C, Lustria ML. Review of interactive safer sex Web sites: practice and potential. Health Commun. 2006;20(3):233–41. doi: 10.1207/s15327027hc2003_3. [PubMed] [Cross Ref]
68. Lustria MLA. Can interactivity make a difference? Effects of interactivity on the comprehension of and attitudes toward online health content. J Am Soc Inf Sci Technol. 2007;58:766–76. doi: 10.1002/asi.20557. [Cross Ref]
69. Woodall WG, Buller DB, Saba L, Zimmerman D, Waters E, Hines JM, Cutter GR, Starling R. Effect of emailed messages on return use of a nutrition education website and subsequent changes in dietary behavior. J Med Internet Res. 2007;9(3):e27. doi: 10.2196/jmir.9.3.e27. http://www.jmir.org/2007/3/e27/v9i3e27 [PMC free article] [PubMed] [Cross Ref]
70. Houston TK, Coley HL, Sadasivam RS, Ray MN, Williams JH, Allison JJ, Gilbert GH, Kiefe CI, Kohler C, DPBRN Collaborative Group Impact of content-specific email reminders on provider participation in an online intervention: a dental PBRN study. Stud Health Technol Inform. 2010;160(Pt 2):801–5. [PMC free article] [PubMed]
71. Radicati S, Hoang Q. The Radicati Group, Inc. 2011. May, [2012-02-27]. webcite E-mail Statistics Report, 2011-2015 http://www.radicati.com/wp/wp-content/uploads/2011/05/Email-Statistics-Report-2011-2015-Executive-Summary.pdf.

Articles from Journal of Medical Internet Research are provided here courtesy of Gunther Eysenbach
PubReader format: click here to try

Formats:

Related citations in PubMed

See reviews...See all...

Cited by other articles in PMC

See all...

Links

  • MedGen
    MedGen
    Related information in MedGen
  • PubMed
    PubMed
    PubMed citations for these articles

Recent Activity

Your browsing activity is empty.

Activity recording is turned off.

Turn recording back on

See more...