NCBI Bookshelf. A service of the National Library of Medicine, National Institutes of Health.

O’Haire C, McPheeters M, Nakamoto E, et al. Engaging Stakeholders To Identify and Prioritize Future Research Needs [Internet]. Rockville (MD): Agency for Healthcare Research and Quality (US); 2011 Jun. (Methods Future Research Needs Reports, No. 4.)

Cover of Engaging Stakeholders To Identify and Prioritize Future Research Needs

Engaging Stakeholders To Identify and Prioritize Future Research Needs [Internet].

Show details

Appendix IEvidence-based Practice Center Future Research Needs Document Pilot Projects: Protocols for Engaging Stakeholders

Project TitleStakeholder Engagement Protocols
Future Research Needs of Treatments of Localized Prostate Cancer
  • A key informant group will assist with the prioritization process via interdisciplinary discussion among a small group (less than 10 participants) with an orientation to improving evidence in therapies for clinically localized prostate cancer. This approach is primarily qualitative and builds on TEC’s expertise in building productive interdisciplinary groups.
  • Stakeholders will be national experts who are supportive of evidence-based medicine and well-versed in the obstacles faced in conducting multiple, large clinical trials—especially in the context of prostate cancer.
  • Short, structured interviews will be conducted via phone with key informants to inform them about the project and solicit input on research gaps.
  • Once prioritization criteria for research gaps and topics are drafted and distributed, there will be three conference calls (1 hour) involving key informants to participate and give feedback.
Future Research Needs for Angiotensin Converting Enzyme (ACE) Inhibitors or Angiotensin II Receptor Blockers (ARBs) added to Standard Medical Therapy for Treating Stable Ischemic Heart Disease
  • Stakeholder workgroup (representing patients, researchers, clinical experts, and funders) will include members from the original technical expert panel for the CER, researchers involved in some of the primary RCTs included in the CER, other clinical experts and researchers in the content area, representatives from relevant professional societies, healthcare decision and policy makers, and representatives from related consumer and patient advocacy groups.
  • Stakeholder conference call will be held to orient the workgroup to the original report the identified evidence gaps, the developed decision analytic framework, and Duke’s planned value of information analyses.
  • After needed evidence is gathered from published literature and information is synthesized and analyzed, findings will be disseminated to relevant stakeholders
  • Incorporate feedback from stakeholders on value of information findings and needed extensions.
  • After research needs document is drafted, there will be a second stakeholder call with the stakeholder group to discuss findings, value of information process, and to review the draft report.
Future Research Needs for the Comparison of Percutaneous Coronary Interventions With Bypass Graft Surgery in Nonacute Coronary Artery Disease
  • Will seek feedback from stakeholders in the form of key informant interviews.
  • Key informants will be identified through the Scientific Resource Center and AHRQ. Ideally, informants will represent the perspective of patients, physicians, payers/policy makers and funders.
  • One or more key informant teleconferences will be held to receive feedback on the identified evidence gaps.
  • Teleconferences with key informants will: finalize (verify/modify) the list of identified evidence gaps, further refine the draft description of the dimensions of the decisional context, and refine the draft analytic framework and if possible recast it as a simplified decision tree to explicate the important parameters.
  • After key informant teleconferences, will conduct phone interviews where key informants will describe:

    whether and how they would use this information

    how familiar they are with systematic reviews, meta-analyses, evidence mapping, decision analysis, cost-effectiveness analysis, and value of information analysis

    how receptive they are to conclusions drawn from different methodologies, and what reservations they have, if any

    how receptive they are to learning more about the more quantitative methodologies to be able to use their conclusions correctly and fully; if the users do not buy in, it may be a moot process

    what information would the ideal research needs prioritization document contain, and what minimum level of detail they would accept in terms of the recommendation itself (e.g., specificity by defining characteristics as per the PICO formalism) and the methodology it is based on (e.g., description of the process, model, assumptions)

    what is the ideal presentation of the research needs prioritization information (graphical, tabular, formulas, in an interactive piece of software, other).

Future Research Needs for Outcomes of Weight Gain in Pregnancy
  • Working with the Scientific Resource Center (SRC) to develop a group of stakeholder individuals and organizations with interest in the topic of maternal weight gain.
  • We will ask for nominations in four areas: advocacy, clinical practice, research, and research funding priorities. Request for nomination from stakeholders will be done initially by mail and e-mail, with personal phone call followup as needed. Stakeholders that Vanderbilt wishes to invite (including an “oversample” to accommodate anticipated lack of availability) will receive letters that include a description of the EHC program, the role of the EPCs, the pilot project, and the time commitment and role of the stakeholders.
  • The EPC will use a modified Delphi process to elicit, collate, and prioritize information from stakeholders and to arrive at a sense of hierarchy of the importance of the recommendations. The group will be guided through consideration of the State-of-the Science Framework and oriented to the ultimate goal of creating a final Research Gaps Analysis and Future Research Recommendations document.
  • To maximize ability to engage stakeholders who are our Delphi Process participants and to explore which approaches are preferred by them, we will offer stakeholders three choices for participation in the first phase of Inquiry and Concept Building (snowballing of ideas): online submission of information, individual phone conversations (as a semi-structured interview from an interview guide), or group conference call. All methods will be provided and stakeholders will self-select into the form of participation that is most suitable to their communication style.
  • A one day DesignShop will be held where stakeholders (local or national) can stimulate thinking and discussion of Future Research Priorities for Understanding Maternal Weight Gain.
  • A followup survey will be conducted using the pilot evaluation tool to solicit information on the experience of the stakeholders.
Future Research Needs to Reduce the Risk of Primary Breast Cancer in Women
  • The Eisenberg Center for Clinical Decisions and Communications Science will be contacted first to identify stakeholders who were engaged in the process of developing materials for consumers, clinicians, and policy-makers for this CER to ensure representation beyond these individuals.
  • The stakeholder workgroup (up to 18 members) will be recruited through snowball sampling. Potential stakeholders will be sent an introductory letter, the executive summary of the CER, the full CER, the anticipated timeline and activities, instructions for agreeing to participate, and informed consent documentation. The stakeholder workgroup will be split into two homogenous groups based on the type of organization they represent and their stake in future research.
  • Oregon will host a 1–2 hour web based presentation that will orient the stakeholder workgroup on the review and the identified future research needs. All materials from the presentation will be provided to participants.
  • After the presentation, two electronic questionnaires will be posted for stakeholder workgroups to complete. Both questionnaires will be tailored to the specific group to which they are administered.
Future Research Needs for Treatment of Common Hip Fractures
  • Stakeholders will receive an invitation letter outlining a brief description of the project and the stakeholder’s expected role, along with background information (i.e. executive summary of the original report).
  • Initial meeting with stakeholders will be conducted through a group conference call. Summaries of group calls will be circulated among all participants to allow for further feedback processes. Individual e-mail and telephone calls for specific questions will also be anticipated.
  • Stakeholders for the prioritization of research questions and projects will be provided the research questions and projected developed by the EPC, and instructions for the prioritization process.
  • All stakeholders will complete disclosure forms, and will be instructed to include information on related current research in which they are involved.
Pilot Study: Identifying Future Research Needs for Management of Gestational DiabetesThere will be two groups of stakeholders:
  1. A small, local group will provide detailed input including on the framing of questions, issues of study design and feasibility. The local group will include clinicians, nutritionists and patient advocates (social workers). Initial engagement of this group will be through an online feedback form, addressing questions on study design and feasibility of research. There will be two face-to-face meetings to present a summary of the electronic responses and to discuss in more depth any issues arising from those responses.
  2. A larger group of external stakeholders will prioritize the research questions and be engaged in the modified Delphi process. This group will include two people from each of the identified types of stakeholders (total of 10). Feedback from the local group will be used to revise the research questions and to develop the Delphi questionnaire. This group will be engaged in the modified Delphi process.
Future Research Needs for Integration of Mental Health/Substance Abuse and Primary Care
  • An internal kick-off meeting will be held to discuss potential stakeholders. Team members will include UNC’s mental health and primary care experts, with input from the Minnesota group.
  • Recruitment of approved stakeholders for participation in the project will begin with an introductory email invitation with a brief description of the project. The executive summary will also be provided along with a link to the original report. Conflict of interest (COI) disclosures will also be obtained to screen for potential conflicts of interest.
  • A list of current gaps in literature will be presented to stakeholders by teleconference asking for feedback on anything that may have been missed in the search. A moderator will ensure a voice for each stakeholder, and to further ensure that all stakeholder opinions are recorded, all notes from the call will be forwarded to the stakeholders along with a followup call for additional clarification and additions.
  • Stakeholders identified as funders for ongoing research will be informed of findings by the library team.
  • Stakeholders will be emailed a document with the refined list of research gaps to be prioritized according to their preference and knowledge of the area, using ranks and a Likert scale. Once results are compiled and synthesized, a summary of the results will be presented by teleconference the whole stakeholder group for a consensus decision. At this teleconference, the pros and cons of pursuing future research for the gaps identified will be discussed, and stakeholders will be asked to rank their top 3–5 future research priorities out of all those identified.
Bookshelf ID: NBK62557
PubReader format: click here to try


  • PubReader
  • Print View
  • Cite this Page
  • PDF version of this title (571K)
  • Disable Glossary Links

Recent Activity

Your browsing activity is empty.

Activity recording is turned off.

Turn recording back on

See more...