User survey finds rapid evidence reviews increased uptake of evidence by Veterans Health Administration leadership to inform fast-paced health-system decision-making

Syst Rev. 2016 Aug 5;5(1):132. doi: 10.1186/s13643-016-0306-5.

Abstract

Background: To provide evidence synthesis for faster-paced healthcare decision-making, rapid reviews have emerged as a streamlined alternative to standard systematic reviews. In 2012, the Veterans Affairs Evidence-based Synthesis Program (VA ESP) added rapid reviews to support Veterans Health Administration (VHA) operational partners' more urgent decision-making needs. VHA operational partners play a substantial role in dissemination of ESP rapid reviews through a variety of routes, including posting on the VA ESP's public website ( http://www.hsrd.

Research: va.gov/publications/esp/ ). As demand for rapid reviews rises, much progress has been made in characterizing methods and practices. However, evidence synthesis organizations still seek to better understand how and when rapid reviews are being used.

Methods: The VA ESP administered an online survey to rapid review operational partners. The survey assessed the nature of decision-making needs, overall perception of review content, resulting actions, and implementation timeframe. We use descriptive statistics and narrative methods to summarize findings.

Results: Between October 2011 and April 2015, we completed 12 rapid reviews for 35 operational partners. Operational partners were primarily non-academic subject matter experts with VA operations' decision-making authority. The most common topic categories reviewed were policy or system (50 %) or process of care (42 %) initiatives. Median report completion time was 14.5 weeks. Survey response rate was 46 %, with at least one operational partner responding for 92 % of reports. Reviews served multiple purposes including policy directive or regulation (72 %), supporting program development and evaluation (55 %), identifying future research needs (45 %), and determining implementation strategy (45 %). Overall, operational partners' perception of report content was positive. A majority of rapid reviews were used immediately and informed actions ranking high on the Institute of Medicine's Degrees of Impact framework: 45.4 % effected change, 18.2 % inspired action, 18.2 % informed the field, 9.1 % received recognition, and 9.1 % spread a message.

Conclusions: VA ESP rapid reviews have increased the VHA's uptake of evidence to inform time-sensitive system-level decision-making. Key areas of interest for future evaluation include assessing user perception of our streamlined methods and the quality of our efforts to inform users of these methods, as well as comparing the usability and impact of our rapid and standard systematic reviews.

Keywords: Decision-making; Evidence synthesis; Implementation; Program impact; Rapid review.

Publication types

  • Research Support, U.S. Gov't, Non-P.H.S.

MeSH terms

  • Attitude of Health Personnel*
  • Decision Making*
  • Delivery of Health Care*
  • Evidence-Based Medicine*
  • Humans
  • Policy
  • Program Development
  • Review Literature as Topic*
  • Surveys and Questionnaires
  • United States
  • United States Department of Veterans Affairs*