Logo of jamiaAlertsAuthor InstructionsSubmitAboutJAMIA - The Journal of the American Medical Informatics Association
J Am Med Inform Assoc. 1996 Nov-Dec; 3(6): 399–409.
PMCID: PMC116324

A meta-analysis of 16 randomized controlled trials to evaluate computer-based clinical reminder systems for preventive care in the ambulatory setting.


OBJECTIVE: Computer-based reminder systems have the potential to change physician and patient behaviors and to improve patient outcomes. We performed a meta-analysis of published randomized controlled trials to assess the overall effectiveness of computer-based reminder systems in ambulatory settings directed at preventive care. DESIGN: Meta-analysis. SEARCH STRATEGY: Searches of the Medline (1966-1994), Nursing and Allied Health (1982-1994), and Health Planning and Administration (1975-1994) databases identified 16 randomized, controlled trials of computer-based reminder systems in ambulatory settings. STATISTICAL METHODS: A weighted mixed effects model regression analysis was used to estimate intervention effects for computer and manual reminder systems for six classes of preventive practices. MAIN OUTCOME MEASURE: Adjusted odds ratio for preventive practices. RESULTS: Computer reminders improved preventive practices compared with the control condition for vaccinations (adjusted odds ratio [OR] 3.09; 95% confidence interval [CI] 2.39-4.00), breast cancer screening (OR 1.88; 95% CI 1.44-2.45), colorectal cancer screening (OR 2.25; 95% CI 1.74-2.91), and cardiovascular risk reduction (OR 2.01; 95% CI 1.55-2.61) but not cervical cancer screening (OR 1.15; 95% CI 0.89-1.49) or other preventive care (OR 1.02; 95% CI 0.79-1.32). For all six classes of preventive practices combined the adjusted OR was 1.77 (95% CI 1.38-2.27). CONCLUSION: Evidence from randomized controlled studies supports the effectiveness of data-driven computer-based reminder systems to improve prevention services in the ambulatory care setting.

Full Text

The Full Text of this article is available as a PDF (1.1M).

Selected References

These references are in PubMed. This may not be the complete list of references from this article.
  • Johnston ME, Langton KB, Haynes RB, Mathieu A. Effects of computer-based clinical decision support systems on clinician performance and patient outcome. A critical appraisal of research. Ann Intern Med. 1994 Jan 15;120(2):135–142. [PubMed]
  • Sullivan F, Mitchell E. Has general practitioner computing made a difference to patient care? A systematic review of published reports. BMJ. 1995 Sep 30;311(7009):848–852. [PMC free article] [PubMed]
  • Leaper DJ, Horrocks JC, Staniland JR, De Dombal FT. Computer-assisted diagnosis of abdominal pain using "estimates" provided by clinicians. Br Med J. 1972 Nov 11;4(5836):350–354. [PMC free article] [PubMed]
  • Miller RA, Pople HE, Jr, Myers JD. Internist-1, an experimental computer-based diagnostic consultant for general internal medicine. N Engl J Med. 1982 Aug 19;307(8):468–476. [PubMed]
  • McDonald CJ. Protocol-based computer reminders, the quality of care and the non-perfectability of man. N Engl J Med. 1976 Dec 9;295(24):1351–1355. [PubMed]
  • Pryor TA, Gardner RM, Clayton PD, Warner HR. The HELP system. J Med Syst. 1983 Apr;7(2):87–102. [PubMed]
  • Tierney WM, Miller ME, Overhage JM, McDonald CJ. Physician inpatient order writing on microcomputer workstations. Effects on resource utilization. JAMA. 1993 Jan 20;269(3):379–383. [PubMed]
  • Tierney WM, McDonald CJ, Martin DK, Rogers MP. Computerized display of past test results. Effect on outpatient testing. Ann Intern Med. 1987 Oct;107(4):569–574. [PubMed]
  • Doskocil M, Med M, Vimmer T. Musculus rectus femoris--zacátecní slacha, její funkcní význam. Acta Chir Orthop Traumatol Cech. 1987 Apr;54(2):99–107. [PubMed]
  • Tierney WM, McDonald CJ, Hui SL, Martin DK. Computer predictions of abnormal test results. Effects on outpatient testing. JAMA. 1988 Feb 26;259(8):1194–1198. [PubMed]
  • Tierney WM, Miller ME, McDonald CJ. The effect on test ordering of informing physicians of the charges for outpatient diagnostic tests. N Engl J Med. 1990 May 24;322(21):1499–1504. [PubMed]
  • Sox HC., Jr Preventive health services in adults. N Engl J Med. 1994 Jun 2;330(22):1589–1595. [PubMed]
  • Colditz GA, Burdick E, Mosteller F. Heterogeneity in meta-analysis of data from epidemiologic studies: a commentary. Am J Epidemiol. 1995 Aug 15;142(4):371–382. [PubMed]
  • Barnett GO, Winickoff RN, Morgan MM, Zielstorff RD. A computer-based monitoring system for follow-up of elevated blood pressure. Med Care. 1983 Apr;21(4):400–409. [PubMed]
  • McDonald CJ, Hui SL, Smith DM, Tierney WM, Cohen SJ, Weinberger M, McCabe GP. Reminders to physicians from an introspective computer medical record. A two-year randomized trial. Ann Intern Med. 1984 Jan;100(1):130–138. [PubMed]
  • McDonald CJ, Hui SL, Tierney WM. Effects of computer reminders for influenza vaccination on morbidity during influenza epidemics. MD Comput. 1992 Sep-Oct;9(5):304–312. [PubMed]
  • Tierney WM, Hui SL, McDonald CJ. Delayed feedback of physician performance versus immediate reminders to perform preventive care. Effects on physician compliance. Med Care. 1986 Aug;24(8):659–666. [PubMed]
  • Turner BJ, Day SC, Borenstein B. A controlled trial to improve delivery of preventive care: physician or patient reminders? J Gen Intern Med. 1989 Sep-Oct;4(5):403–409. [PubMed]
  • McDowell I, Newell C, Rosser W. A randomized trial of computerized reminders for blood pressure screening in primary care. Med Care. 1989 Mar;27(3):297–305. [PubMed]
  • McDowell I, Newell C, Rosser W. Computerized reminders to encourage cervical screening in family practice. J Fam Pract. 1989 Apr;28(4):420–424. [PubMed]
  • Rosser WW, Hutchison BG, McDowell I, Newell C. Use of reminders to increase compliance with tetanus booster vaccination. CMAJ. 1992 Mar 15;146(6):911–917. [PMC free article] [PubMed]
  • McDowell I, Newell C, Rosser W. Comparison of three methods of recalling patients for influenza vaccination. CMAJ. 1986 Nov 1;135(9):991–997. [PMC free article] [PubMed]
  • Rosser WW, McDowell I, Newell C. Use of reminders for preventive procedures in family medicine. CMAJ. 1991 Oct 1;145(7):807–814. [PMC free article] [PubMed]
  • Chambers CV, Balaban DJ, Carlson BL, Ungemack JA, Grasberger DM. Microcomputer-generated reminders. Improving the compliance of primary care physicians with mammography screening guidelines. J Fam Pract. 1989 Sep;29(3):273–280. [PubMed]
  • Becker DM, Gomez EB, Kaiser DL, Yoshihasi A, Hodge RH., Jr Improving preventive care at a medical clinic: how can the patient help? Am J Prev Med. 1989 Nov-Dec;5(6):353–359. [PubMed]
  • Ornstein SM, Garr DR, Jenkins RG, Rust PF, Arnon A. Computer-generated physician and patient reminders. Tools to improve population adherence to selected preventive services. J Fam Pract. 1991 Jan;32(1):82–90. [PubMed]
  • Litzelman DK, Dittus RS, Miller ME, Tierney WM. Requiring physicians to respond to computerized reminders improves their compliance with preventive care protocols. J Gen Intern Med. 1993 Jun;8(6):311–317. [PubMed]
  • McPhee SJ, Bird JA, Jenkins CN, Fordham D. Promoting cancer screening. A randomized, controlled trial of three interventions. Arch Intern Med. 1989 Aug;149(8):1866–1872. [PubMed]
  • Fordham D, McPhee SJ, Bird JA, Rodnick JE, Detmer WM. The Cancer Prevention Reminder System. MD Comput. 1990 Sep-Oct;7(5):289–295. [PubMed]
  • Szilagyi PG, Rodewald LE, Savageau J, Yoos L, Doane C. Improving influenza vaccination rates in children with asthma: a test of a computerized reminder system and an analysis of factors predicting vaccination compliance. Pediatrics. 1992 Dec;90(6):871–875. [PubMed]
  • Landis SE, Hulkower SD, Pierson S. Enhancing adherence with mammography through patient letters and physician prompts. A pilot study. N C Med J. 1992 Nov;53(11):575–578. [PubMed]
  • Moran WP, Nelson K, Wofford JL, Velez R. Computer-generated mailed reminders for influenza immunization: a clinical trial. J Gen Intern Med. 1992 Sep-Oct;7(5):535–537. [PubMed]
  • McPhee SJ, Bird JA, Fordham D, Rodnick JE, Osborn EH. Promoting cancer prevention activities by primary care physicians. Results of a randomized, controlled trial. JAMA. 1991 Jul 24;266(4):538–544. [PubMed]
  • Burack RC, Gimotty PA, George J, Stengle W, Warbasse L, Moncrease A. Promoting screening mammography in inner-city settings: a randomized controlled trial of computerized reminders as a component of a program to facilitate mammography. Med Care. 1994 Jun;32(6):609–624. [PubMed]
  • Frame PS, Zimmer JG, Werth PL, Hall WJ, Eberly SW. Computer-based vs manual health maintenance tracking. A controlled trial. Arch Fam Med. 1994 Jul;3(7):581–588. [PubMed]
  • Shea S, Sideli RV, DuMouchel W, Pulver G, Arons RR, Clayton PD. Computer-generated informational messages directed to physicians: effect on length of hospital stay. J Am Med Inform Assoc. 1995 Jan-Feb;2(1):58–64. [PMC free article] [PubMed]
  • Pestotnik SL, Classen DC, Evans RS, Burke JP. Implementing antibiotic practice guidelines through computer-assisted decision support: clinical and financial outcomes. Ann Intern Med. 1996 May 15;124(10):884–890. [PubMed]
  • Safran C, Rind DM, Davis RB, Ives D, Sands DZ, Currier J, Slack WV, Makadon HJ, Cotton DJ. Guidelines for management of HIV infection with computer-based patient's record. Lancet. 1995 Aug 5;346(8971):341–346. [PubMed]
  • Brook RH. Implementing medical guidelines. Lancet. 1995 Jul 15;346(8968):132–132. [PubMed]
  • Tunis SR, Hayward RS, Wilson MC, Rubin HR, Bass EB, Johnston M, Steinberg EP. Internists' attitudes about clinical practice guidelines. Ann Intern Med. 1994 Jun 1;120(11):956–963. [PubMed]
  • Jenders RA, Morgan M, Barnett GO. Use of open standards to implement health maintenance guidelines in a clinical workstation. Comput Biol Med. 1994 Sep;24(5):385–390. [PubMed]
  • Clayton PD, Anderson RK, Hill C, McCormack M. An initial assessment of the cost and utilization of the Integrated Academic Information System (IAIMS) at Columbia Presbyterian Medical Center. Proc Annu Symp Comput Appl Med Care. 1991:109–113. [PMC free article] [PubMed]
  • Heathfield HA, Wyatt J. Philosophies for the design and development of clinical decision-support systems. Methods Inf Med. 1993 Feb;32(1):1–17. [PubMed]

Articles from Journal of the American Medical Informatics Association : JAMIA are provided here courtesy of American Medical Informatics Association


Save items

Related citations in PubMed

See reviews...See all...

Cited by other articles in PMC

See all...


  • Cited in Books
    Cited in Books
    PubMed Central articles cited in books
  • PubMed
    PubMed citations for these articles

Recent Activity

Your browsing activity is empty.

Activity recording is turned off.

Turn recording back on

See more...