• We are sorry, but NCBI web applications do not support your browser and may not function properly. More information
Logo of nihpaAbout Author manuscriptsSubmit a manuscriptNIH Public Access; Author Manuscript; Accepted for publication in peer reviewed journal;
Contraception. Author manuscript; available in PMC Apr 1, 2014.
Published in final edited form as:
PMCID: PMC3548974
NIHMSID: NIHMS407192

The impact of an educational text message intervention on young urban women’s knowledge of oral contraception

Abstract

Background

Oral contraceptive (OC) knowledge deficits may contribute to OC discontinuation. We examined the effect of an innovative educational intervention on young women’s OC knowledge.

Study Design

As part of a randomized trial evaluating the impact of text message reminders on OC continuation, we assessed OC knowledge in 659 women ages 13-25 years. Women received routine care or routine care plus six months of daily educational text messages. We administered a comprehensive 41-item OC knowledge survey at baseline and six months.

Results

Mean OC knowledge scores improved over time for all women (baseline 22.8, 56% correct versus 24.7, 60% at six months), including knowledge of OC’s mechanisms of action (p=0.004), effectiveness (p<0.001), side effects (p=0.03), and benefits (p<0.001). Mean six-month scores were greater in the intervention (25.5) than the control group (23.7)(p<0.001). In multivariable linear regression models, the text message intervention most strongly predicted OC knowledge (β=1.6, 95% CI 0.9, 2.2).

Conclusion

Daily educational text messages can modestly improve knowledge of OCs, which may promote successful contraceptive outcomes.

Keywords: oral contraception, contraceptive knowledge, educational intervention, text message

1. Introduction

Nearly half of the 3.1 million annual unintended pregnancies among women in the United States are attributed to misuse and discontinuation of effective and popular contraceptive methods [1]. Of the 45 million U.S. women who have ever used oral contraceptives (OC), over 30% have discontinued them [2]. More than 50% of all unintended pregnancies are estimated to result from OC discontinuation alone [3].

Cognitive, behavioral and social factors influence OC use and help explain why young women misuse and discontinue OCs [1-11]. A woman’s understanding of information related to OCs may play a critical role, either directly or indirectly, in facilitating or inhibiting successful OC use [4]. Unfortunately, comprehensive knowledge of OCs is limited among young women across diverse settings and populations [10-30]. In a recent review of studies measuring OC knowledge, nine of the 15 studies reported overall poor knowledge [31].

Studies testing strategies to address poor OC knowledge, including educational counseling interventions, have shown some improvements in knowledge but results have been inconsistent [21,23-26]. Interventions have relied upon information sources such as written handouts [21,23,26], audio tapes [26], health provider counseling [25], and provider question/answer sessions [21]. Few studies have capitalized on technological advances such as text messaging [32,33], which can deliver sensitive, educational preventive health information, like reproductive and contraceptive information, in an efficient, cost-effective and youth-centered way [34,35].

Limited measures and designs in OC knowledge research may have contributed to inconsistent findings and the lack of clarity on relationships between OC knowledge and behavior [31,36]. Previous studies have failed to capture the multidimensional nature of OC knowledge [36]. Most research, both descriptive and interventional, has focused on evaluating and improving knowledge of OC risks, side effects and, less commonly, use [31,36]. Strategies to address all dimensions of OC including efficacy, benefits, and mechanism of action are needed to fill knowledge gaps and ultimately improve behavior [36].

As part of a larger randomized controlled trial to evaluate the impact of daily educational text message reminders on OC continuation rates among young urban women, we also investigated whether comprehensive educational text messages could improve young women’s knowledge of OC.

2. Methods

Results and methods of the larger study of OC continuation have been described elsewhere [37]. In the main study, we found that the use of daily educational text messages improves OC continuation at 6 months over routine care alone [37]. Here we report on the impact of the text message intervention on OC knowledge at 6 months. The Institutional Review Board of Columbia University Medical Center and Planned Parenthood Federation of American Research Department approved the study.

Participants were recruited from a family planning health center in New York City. Women eligible for inclusion were: 1) aged 25 years or younger, 2) currently sexually active, 3) owners of a cell phone with text messaging capabilities, and 4) requesting OCs. Research assistants screened participants, obtained written consent, conducted a baseline interview and documented contact information for a six-month exit interview. Of the 962 participants randomized to either the text message intervention or the routine clinical care control group at baseline, we obtained follow-up information on 659 young women at six months including OC knowledge assessment. These participants provided the data analyzed here.

The baseline interview collected information on demographic characteristics and sexual, contraceptive and reproductive histories. We also administered a 41-item OC knowledge questionnaire we designed for this study to measure six major dimensions of OC knowledge including mechanism of action (4 items), effectiveness (2), use (9), side effects (4), risks (9) and benefits (13). Knowledge questions were developed from information within comprehensive standardized handouts from the clinical site. The questionnaire employed multiple question formats including true-false (10 items), multiple choice (15 items) and alternate choice (16 items). Examples of questions included, “The pill works partly by thickening the cervical mucus so sperm cannot get into the womb, true or false” (mechanism of action); “Please select whether you think the pill makes menstrual cramps better, worse, or has no effect” (benefits); “Select whether you think the pill increases, decreases or has no effect on the risk of getting ovarian cancer” (benefits); “For the health problem of leg pain or swelling, please select whether you would continue or stop taking the pill, and whether you would call your doctor immediately or discuss at the next visit” (risks, use). Questions were coded “1” for a correct response and “0” for an incorrect response, with possible scores ranging from 0 to 41 points. The questionnaire, which was pilot tested, was available in both English and Spanish and had a Flesch-Kincaid readability score [38] of 4.6 (corresponding to a 4th to 5th grade reading level).

Following baseline assessment, participants were randomly assigned in a 1:1 fixed allocation ratio to the intervention (routine care with six months of daily text messages) or control (routine clinical care only) groups. The random assignments were generated by blinded study staff using a random number table and placed into sequentially numbered, sealed, opaque envelopes, which were later opened by study recruiting staff at the enrollment site. Routine care following clinical protocols included contraceptive counseling by staff and provision of the standard written educational handout. The intervention group received this care in addition to 180 daily text messages, including 47 individual messages (which were repeated up to four times over the study). The educational text messages and OC knowledge questionnaire were developed in tandem using educational content from the handout; 32 questions (78%) had direct overlap in wording with the text messages and the remaining 9 questions indirectly reflected text content. We tested both 41-item and 32-item questionnaires and knowledge results were similar for the two versions; thus, we present results from the 41-item questionnaire.

The text messages also addressed the six major dimensions of OC knowledge noted above: mechanism of action (4 messages), effectiveness (6), use (17), side effects (5), risks (13), benefits (14). Examples of text messages included: “The pill may work by keeping the ovaries from releasing eggs” (mechanism of action) and “U should not use the pill if u have uncontrolled hi blood pressure” (risks, use). All participants elected to receive the messages in English and message length was less than 160 characters for all texts.

Six months after enrollment, participants underwent a telephone interview to assess OC use. We also re-administered the OC knowledge questionnaire orally during this interview.

We used descriptive statistics and bivariate tests (Student’s independent t-tests and ANOVA, where appropriate) to describe our sample and compare OC knowledge scores across sociodemographic groups. We present mean scores as well as mean percentage of items scored correctly (score divided by 41 points). Paired t-tests were used to compare baseline and six-month OC knowledge scores (overall and for all groups) and Student’s t-tests further compared OC knowledge scores (baseline, six-month, and change in scores) between participants in the intervention versus control groups. Finally, we conducted multivariable linear regression to further examine relationships between sociodemographic factors, the text message intervention and OC knowledge. Our primary outcome variable was continuous, six-month OC knowledge scores, but we also examined baseline knowledge scores and percentage point change in scores. We examined models for all women as well as stratified models by education level (≤ high school education versus > high school). Potential covariates were considered for inclusion in regression models if they were associated with OC knowledge scores in bivariate analyses. Variables retained in final models were those associated with knowledge (p<0.05). We present linear regression model results as beta coefficients with standard errors and confidence intervals and interpret estimates as the relative adjusted change in OC knowledge score (going from control group to text message intervention group) while keeping all other variables constant.

3. Results

The average age of the 659 participants was 21 years. The majority were born in the U.S. (84%). African American was the most commonly identified race/ethnicity (41%), followed by Caucasian (29%), Hispanic (25%), and Asian and other (5%). The average participant had completed 14 years of education, with 63% having at least some college education. Many reported a student status (60%), while just over half were employed (55%). The majority of participants were uninsured (34%) or had Medicaid (41%). Three-quarters had used OCs in the past and 20% were OC users at the time of enrollment. Sexual activity within the past six months was nearly universal (96%) and half reported recent sexual activity in the last week. The average age at coitarche 17 years, with 46% having experienced a pregnancy and 39% an abortion. Of those who had a primary sexual partner (80%), the majority of partners were aware of participants’ plans for OC use (95%).

Baseline and six-month mean OC knowledge scores were 22.8 and 24.7 (56% and 60% correct), respectively (p<0.001). Scores varied by nearly all sociodemographic characteristics (Table 1). Younger, less educated, racial/ethnic minority and unemployed women had lower OC knowledge scores than their counterparts at baseline and six months (all p <0.001). Participants with histories of OC use and pregnancy (but not abortion) had higher knowledge scores at baseline and six months than their counterparts (all p<0.001). Improvements in knowledge were similar across all sociodemographic and reproductive characteristics.

Table 1
Selected sociodemographic and reproductive characteristics associated with baseline

Mean baseline scores were similar between the text message intervention and routine care control groups (22.8 and 22.7, respectively, p=0.75), while mean six-month scores were higher in the intervention than control group (25.5 versus 23.7, p<0.001); this corresponds to a 7% versus 3% increase for the intervention versus control group (p<0.001).

In multivariable linear regression models, factors positively associated with six-month OC knowledge scores included Caucasian race/ethnicity (versus non-Caucasian) (ß=1.4), increasing years of education (ß=0.2), history of OC use (ß=0.7) and baseline OC knowledge (ß=0.5) (Table 2). Pregnancy history was negatively associated with six-month scores (ß= −0.7). These same factors were associated with baseline OC knowledge scores.

Table 2
Predictors of oral contraceptive knowledge at six months: results from multivariable linear regression models

Receipt of the text message intervention was the strongest predictor of mean six-month knowledge scores in regression models. Participants who received the text message intervention scored on average 1.6 points higher than those in the control group (ß=1.6, CI 0.9-2.2). This positive intervention effect was stable when modeling the percentage point change in knowledge score outcome (ß=1.7, CI 1.0-2.3) (data not shown). Results were also stable when stratified by education level (Table 2).

We further examined scores by OC knowledge dimension and by question format (Table 3). Mean scores for specific knowledge dimensions improved over time for both the intervention and control groups (data not shown, all p<0.05), except for knowledge of OC risks (for the intervention group) and OC use (for either group). The intervention group had higher mean six-month scores on knowledge of OC mechanisms of action (p=0.004), effectiveness (p<0.001), side effects (p=0.03), and benefits (p<0.001) than the control group. When comparing the percentage point change in mean baseline and six-month scores, the intervention group experienced a higher increase in knowledge of OC benefits (p<0.001), with trends also noted towards greater improvements in mechanism of action (p=0.07) and effectiveness (p=0.05).

Table 3
Oral contraceptive knowledge scores among the text message intervention and routine care control groups, by knowledge dimension and question format

OC knowledge also varied by question format (Table 3). At baseline, participants from both the intervention and control groups scored similarly high on true-false questions (mean 76-77%) and low on multiple choice questions (mean 34-35%). At six months, the text message intervention group scored higher on true-false and multiple choice questions than did the control group (p<0.001), with a mean 10% versus 6% improvement in true-false scores (p=0.002), and mean 12% versus 2% improvement in multiple choice scores (p<0.001) for the intervention and control groups, respectively.

4. Discussion

OC knowledge in our young, diverse, inner-city sample was low, with women responding correctly to just over half of the questions on our comprehensive knowledge questionnaire at baseline and at the six-month follow-up. Scores were low even among those who received the educational text message intervention. Our intervention group experienced a higher increase in mean scores compared to women who did not receive the educational text messages, with the largest improvements in knowledge of OCs benefits, mechanism of action and effectiveness. While the 2.7-point mean score increase overall and smaller increases by dimension were statistically significant, they may not be clinically significant.

Other researchers have noted poor OC knowledge and limited effects from educational and counseling interventions [21,23,26,31], though few have tested innovative education strategies for most widely-used reversible contraception [32,33]. In our review of 21 studies assessing OC knowledge [31], three of the four trials that tested knowledge-based interventions found improvements in at least one dimension of OC knowledge; none used modern technologies [21,23,26,31]. Improvements were noted in knowledge of OC use [21,23,26] but less commonly in efficacy [21] and benefits [26]. However, we were unable to draw any conclusions on the extent and clinical relevance of knowledge improvements in any of the reviewed studies, and reliability, validity and comprehensiveness of OC knowledge measures were limited [31].

OC knowledge varied by question type, a finding noted by others reporting on question design in preventive reproductive health surveys [27,28]. For instance, our participants performed well on true-false questions, a format with an inherent 50% chance of a correct response. Merchant et al. [28] tested the effect of question wording in a preventive health survey (including three OC questions) of 570 emergency department patients and found that women had higher percentages of correct answers on “agree-disagree” format questions than on multiple choice questions. The authors suggest that “agree-disagree” wording and alternate response question formats may contribute to acquiescence bias [28]. Given that “true” was the correct response for 7 out of 10 true-false items in our survey, the usefulness of these OC knowledge questions is unclear.

Furthermore, the 10-12% improvement in scores for true-false and multiple choice questions among participants receiving the educational text message intervention may reflect properties of both our survey and intervention. While 78% of our survey items were derived directly or indirectly from content in the text messages and although we used rigorous instrument design processes, the influence of text message and question content and wording requires further investigation. Measures that precisely reflect comprehension of OC knowledge are needed.

Beyond the positive but modest effect of our text message intervention, our study highlights important sociodemographic and reproductive factors associated with OC knowledge. Disparities in knowledge exist, with younger, minority and less educated women having the poorest knowledge of OCs. Other researchers have reported similar social differentials, noting lower knowledge among Hispanics compared to non-Hispanics [16], younger college students versus older students [13], and among those with less education [22]. Previous OC use was positively associated with OC knowledge in our study but opposite trends were noted for history of pregnancy, which others have also found [7,22,29]. Both of these associations may reflect an unmet need for contraceptive information. Further evaluation of reproductive history, previous experiences with contraception and broader socioeconomic differentials in reproductive health knowledge is needed to understand the myriad of factors contributing to OC knowledge and ultimately behavior.

5. Conclusion

Daily, comprehensive, educational text messages for six months modestly improved OC knowledge among multi-ethnic, inner-city young women. Our intervention capitalized on a ubiquitous device and information technology to communicate sexual health information and adapt health services delivery to meet reproductive-aged women where they live. Greater understanding of OC knowledge and the benefits of receiving comprehensive information about OCs via text messages is needed. Yet, innovative, patient-friendly, and comprehensive approaches to health information and care delivery may have the most potential to improve family planning outcomes and promote sexual and reproductive health and well-being.

Acknowledgements

This study was sponsored by Affinity Health Plan Making a World of Difference Grant Program.

KSH was also supported in part by a pre-doctoral training fellowship from the NIH NINR (#1 F31 NR011119-01A1) while at Columbia University, by a postdoctoral training fellowship from the Office of Population Research (NIH #2R24HD047879) while at Princeton University and by an NICHD Building Interdisciplinary Careers in Women’s Health K-12 Career Development grant (#K12HD001438) at the University of Michigan.

The authors thank Planned Parenthood of New York City for providing the clinical site (Planned Parenthood Boro Hall), ConnectUS and MIR3 for sending the text messages, research assistants and study participants. The opinions expressed in this paper do not necessarily reflect those of Planned Parenthood Federation of America, Inc.

Footnotes

Publisher's Disclaimer: This is a PDF file of an unedited manuscript that has been accepted for publication. As a service to our customers we are providing this early version of the manuscript. The manuscript will undergo copyediting, typesetting, and review of the resulting proof before it is published in its final citable form. Please note that during the production process errors may be discovered which could affect the content, and all legal disclaimers that apply to the journal pertain.

Disclosures: We have no financial interests relevant to this manuscript to disclose.

References

[1] Frost JJ, Darroch JE, Remez L. Improving contraceptive use in the United States. Guttmacher Institute In Brief. 2008;1:1–8. [PubMed]
[2] Mosher WD, Jones J. Use of contraception in the United States: 1982-2008. Vital Health Stat. 2010;23:1–44. [PubMed]
[3] Rosenberg MJ, Waugh MS, Long S. Unintended pregnancies and use, misuse and discontinuation of oral contraceptives. J Reproduc Med. 1995;40:355–60. [PubMed]
[4] Lopez LM, Tolley EE, Grimes DA, Mario CM. Theory-based strategies for improving contraceptive use: a systematic review. Contraception. 2009;79:411–7. [PubMed]
[5] Rosenberg MJ, Waugh MS, Meehan TE. Use and misuse of oral contraceptives: risk indicators for poor pill-taking and discontinuation. Contraception. 1995;51:283–8. [PubMed]
[6] Kaunitz AM. Oral contraceptive health benefits: perceptive versus reality. Contraception. 1999;59:29S–33S. [PubMed]
[7] Tessler SL, Peipert JF. Perceptions of contraceptive effectiveness and health effects of oral contraception. Women’s Health Issues. 1997;7:400–6. [PubMed]
[8] Jones KP. Oral contraception: Current use and attitudes. Contraception. 1999;59:17–20S. [PubMed]
[9] Davis AJ. The role of hormonal contraceptives: the role of hormonal contraception in adolescents. Am J Obstet Gynecol. 1994;170:1581–5. [PubMed]
[10] Rickert VI, Berenson AB, Williamson AJ, Wiemann CM. Immediate recall of oral contraceptive instructions: Implications for providers. Am J Obstet Gynecol. 1999;180:1399–406. [PubMed]
[11] Tountas Y, Creatsas G, Dimitrakaki C, Antoniou A, Boulamatsis D. Information sources and level of knowledge of contraception issues among Greek women and men in reproductive age: A country-wide survey. Eur J Contracept Reproduc Health Care. 2004;9:1–10. [PubMed]
[12] Fletcher PC, Bryden PJ, Bonin E. Preliminary examination of oral contraceptive use among university-aged females. Contraception. 2001;63:229–33. [PubMed]
[13] Bryden PJ, Fletcher P. Knowledge of the risks and benefits associated with oral contraception in a university-aged sample of users and non-users. Contraception. 2001;63:223–7. [PubMed]
[14] Moore PJ, Adler NE, Kegeles SM. Adolescents and the contraceptive pill: Impact of beliefs on intentions and use. Obstet Gynecol. 1996;88:48–56S. [PubMed]
[15] Peremans L, Herman I, Avonts D, et al. Contraceptive knowledge and expectations by adolescents: explanation by focus groups. Pat Educ Couns. 2000;40:133–41. [PubMed]
[16] Sangi-Haghpeykar H, Ali N, Posner S, Poindexter AN. Disparities in contraceptive knowledge, attitudes, and use in Hispanic versus non-Hispanic whites. Contraception. 2006;74:125–32. [PubMed]
[17] Gilliam ML, Warden MM, Goldstein C, Tapia B. Concerns about contraceptive side effects among young Latinas: A focus-group approach. Contraception. 2004;70:299–305. [PubMed]
[18] Davis TC, Frederickson DD, Potter L, et al. Patient understanding and use of oral contraceptive pills in a southern public health family planning clinic. Southern Med J. 2006;99:713–8. [PubMed]
[19] Kaskowitz AP, Carlson N, Nichols M, et al. Online availability of hormonal contraception without a health care examination: effect of knowledge and health care screening. Contraception. 2007;76:273–7. [PMC free article] [PubMed]
[20] Little P, Glew C, Kelly J, Griffin S, Dickson N, Sadler C. Contraceptive knowledge: Development of a valid measure and survey of pill users and general practitioners. Brit J Fam Plann. 1998;24:98–100. [PubMed]
[21] Little P, Griffin S, Kelly J, Dickson N, Sadler C. Effect of educational leaflets and questions on knowledge of contraception in women taking the combined contraceptive pill: Randomised controlled trial. Brit Med J. 1998;316:1948–52. [PMC free article] [PubMed]
[22] Little P, Griffin S, Dickson N, Sadler C, Kelly J. Unwanted pregnancy and contraceptive knowledge: Identifying vulnerable groups from a randomized controlled trial of educational interventions. Fam Prac. 2001;18:449–53. [PubMed]
[23] Smith LFP, Whitfield MJ. Women’s knowledge of taking oral contraceptive pills correctly and of emergency contraception: Effect of providing educational leaflets in general practice. Brit J Gen Prac. 1995;45:409–14. [PMC free article] [PubMed]
[24] Gilliam M, Knight S, McCarthy M. Success with oral contraceptives: A pilot study. Contraception. 2004;69:413–8. [PubMed]
[25] Gilliam M, Knight S, McCarthy M. Importance and knowledge of oral contraceptives in antepartum, low-income, African American adolescents. J Ped Adolesc Gynecol. 2003;16:355–60. [PubMed]
[26] Deijen JB, Kornaat H. The influence of type of information, somatization, and locus of control on attitudes, knowledge, and compliance with respect to the triphasic oral contraceptive Tri-Minulet. Contraception. 1997;56:31–41. [PubMed]
[27] Merchant RC, Damergis JA, Gee EM, et al. Contraceptive usage, knowledge and correlates of usage among female emergency department patients. Contraception. 2006;74:201–7. [PubMed]
[28] Merchant RC, Vuittonet CL, Clark MA, et al. Implications of question format in emergency department preventive health knowledge surveys. Acad Emerg Med. 2007;14:549–57. [PMC free article] [PubMed]
[29] Gaudet LM, Kives S, Hahn PM, Reid RL. What women believe about oral contraceptives and the effect of counseling. Contraception. 2004;69:31–6. [PubMed]
[30] Hansen T, Skjeldestad FE. Adolescents: is there an association between knowledge of oral contraceptives and profession of provider? Eur J Contracept Reproduc Health Care. 2007;12:303–8. [PubMed]
[31] Hall K, Castano P, Stone P, Westhoff C. The state of oral contraceptive knowledge measurement. Pat Ed Couns. 2010;81:388–94. [PMC free article] [PubMed]
[32] Hou MY, Hurwitz S, Kavanagh E, Fortin J, Goldberg AB. Using daily text-message reminders to improve adherence with oral contraceptives: a randomized controlled trial. Obstet Gynecol. 2010;116:633–40. [PubMed]
[33] Gold J, Lim MSC, Hocking JS, Keogh LA, Spelman T, Hellard ME. Determining the impact of text messaging for sexual health promotion to young people. Sex Trans Infec. 2011;38:247–52. [PubMed]
[34] Fjeldsoe BS, Marshall AL, Miller YD. Behavior change interventions delivered by mobile telephone short-message service. Am J Prev Med. 2009;36:165–73. [PubMed]
[35] Lim MSC, Hocking JS, Hellard ME, Aitken CK, SMS STI. a review of the uses of mobile phone text messaging in sexual health. Int J STD AIDS. 2008;19:287–90. [PubMed]
[36] Grimes DA, Schulz KF. Nonspecific side effects of oral contraceptives: nocebo or noise? Contraception. 2011;83:5–9. [PubMed]
[37] Castaño PM, Bynum JY, Andŕes R, Lara M, Westhoff C. Effect of daily text messages on oral contraceptive continuation: A randomized controlled trial. Obstet Gynecol. 2012;119:14–20. [PubMed]
[38] Farr JN, Jenkins JJ, Paterson DG. Simplification of Flesch Reading Ease Formula. J Applied Psych. 1951;35:333–7.
PubReader format: click here to try

Formats:

Related citations in PubMed

See reviews...See all...

Links

  • PubMed
    PubMed
    PubMed citations for these articles

Recent Activity

Your browsing activity is empty.

Activity recording is turned off.

Turn recording back on

See more...