Logo of bmcmrmBioMed Centralsearchsubmit a manuscriptregisterthis articleBMC Medical Research Methodology
BMC Med Res Methodol. 2012; 12: 114.
Published online Aug 3, 2012. doi:  10.1186/1471-2288-12-114
PMCID: PMC3477082

What is the most appropriate knowledge synthesis method to conduct a review? Protocol for a scoping review

Abstract

Background

A knowledge synthesis attempts to summarize all pertinent studies on a specific question, can improve the understanding of inconsistencies in diverse evidence, and can identify gaps in research evidence to define future research agendas. Knowledge synthesis activities in healthcare have largely focused on systematic reviews of interventions. However, a wider range of synthesis methods has emerged in the last decade addressing different types of questions (e.g., realist synthesis to explore mediating mechanisms and moderators of interventions). Many different knowledge synthesis methods exist in the literature across multiple disciplines, but locating these, particularly for qualitative research, present challenges. There is a need for a comprehensive manual for synthesis methods (quantitative/qualitative or mixed), outlining how these methods are related, and how to match the most appropriate knowledge synthesis method to answer a research question. The objectives of this scoping review are to: 1) conduct a systematic search of the literature for knowledge synthesis methods across multi-disciplinary fields; 2) compare and contrast the different knowledge synthesis methods; and, 3) map out the specific steps to conducting the knowledge syntheses to inform the development of a knowledge synthesis methods manual/tool.

Methods

We will search relevant electronic databases (e.g., MEDLINE, CINAHL), grey literature, and discipline-based listservs. The scoping review will consider all study designs including qualitative and quantitative methodologies (excluding economic analysis or clinical practice guideline development), and identify knowledge synthesis methods across the disciplines of health, education, sociology, and philosophy. Two reviewers will pilot-test the screening criteria and data abstraction forms, and will independently screen the literature and abstract the data. A three-step synthesis process will be used to map the literature to our objectives.

Discussion

This project represents the first attempt to broadly and systematically identify, define and classify knowledge synthesis methods (i.e., less traditional knowledge synthesis methods). We anticipate that our results will lead to an accepted taxonomy for less traditional knowledge synthesis methods, and to the development and implementation of a methods manual for these reviews which will be relevant to a wide range of knowledge users, including researchers, funders, and journal editors.

Background

Knowledge synthesis has the potential to inform the management of health problems [1] and is integral to the health of the Canadian population [2]. A knowledge synthesis summarizes all pertinent studies on a specific question, can improve the understanding of inconsistencies in diverse evidence, and can define future research agendas [1,3]. Knowledge synthesis is also an important part of the knowledge translation (KT) process (and ideally should form the ‘base unit’ of KT strategies for providers and policy makers), and be used to provide the evidence base for KT products including clinical practice guidelines, policy briefs and decision aids [4]. As such, knowledge synthesis can be used to interpret results of individual studies within the context of the totality of evidence. This is an important consideration, given that basing practice and policy decisions on a single study or expert opinion can be misleading [5].

Knowledge synthesis activities in healthcare have often focused on the methodologically rigorous Cochrane reviews, most commonly of interventions. The definition of a systematic review according to the Cochrane Collaboration is “A review of clearly formulated questions that uses systematic and explicit methods to identify, select, and critically appraise relevant research, and to collect and analyse data from the studies that are included in the review. Statistical methods (meta-analysis) may or may not be used to analyse and summarise the results of the included studies” [6]. However, Cochrane-like review methods may not always be applicable for answering all knowledge synthesis questions, particularly those investigating complex and multidisciplinary topics [7,8]. For example, members of our team recently attempted to conduct a systematic review to better understand the relationship between the perceived characteristics of clinical practice guidelines and their uptake by clinicians, and found that a flexible approach that borrowed relevant components of less traditional knowledge synthesis methods (i.e., including realist reviews and meta-ethnography) was more relevant to determine the mechanisms and circumstances underpinning guideline implementation [9]. This example highlights the need for less traditional methods for completing a review. By matching the appropriate design to fit the question, synthesis outputs are more likely to be relevant and be useful for end users.

Furthermore, a traditional review such as a Cochrane review cannot always explain why particular interventions work in some settings but not in others [10]. For example, a Cochrane review found that school feeding programs significantly improved the growth and cognitive performance of disadvantaged children [11], but failed to provide direction for policy-makers to decide which intervention should be implemented and under what circumstances. By conducting a realist review alongside the Cochrane review (which can be used to understand ‘what works for whom and under what circumstances’ [10]), the authors were able to provide concrete recommendations that could be implemented in practice and policy making [7]. To address these types of questions and adequately incorporate the needs, preferences and experiences of patients into healthcare delivery, there is an increasing need to consider less traditional review methods of complex evidence (i.e., heterogeneous, methodologically diverse, difficult to classify, and contradictory) [12,13]. Another approach is to consider conducting a systematic review as a “first step” to better understand complex evidence (or to conduct them in parallel with novel reviews), particularly for evidence generated from philosophy and the social sciences. The increasing number of synthesis methods that have recently emerged within the healthcare literature supports this need [14-17].

Table Table11 summarizes a selection of knowledge synthesis methods that currently exist in the literature across multiple disciplines (identified through consultation with knowledge synthesis experts and qualitative researchers). Although many of these approaches can be applied to healthcare situations, the methods for conducting them have not been as clearly operationalized as traditional reviews of interventions. Consultation with researchers and end users of reviews that we conducted in preparation for this research indicate a lack of clarity around how to match the appropriate review method to the research question, the methods used to conduct these reviews, and how to analyze and present the results from the review to inform decision making. These issues are challenging for researchers interested in tackling reviews of complex questions and for decision makers trying to interpret and apply this evidence. Other identified challenges involve locating the numerous synthesis methods (particularly those for synthesizing qualitative research), which can be problematic and resource-intensive since they are scattered widely within the literature and across many different disciplines and databases. The terms used to describe the different synthesis methods are often similar (e.g., ‘meta-synthesis’, ‘meta-ethnography’, ‘meta-narrative’, ‘meta-study’, ‘meta-interpretation’) and their definitions can overlap [12]. This area of research is further complicated because some of these methods are referred to as a ‘complete’ synthesis method (i.e., providing guidance on the search strategy, study selection, appraisal, and analysis), while others provide guidance only on specific parts of the process, such as data analysis [12].

Table 1
Characteristics of a preliminary list of existing knowledge synthesis methods

Some researchers have attempted to outline methods for the synthesis of qualitative [47] and mixed-methods research [36,45] and to build a typology of such reviews [41], while others have highlighted methods for knowledge synthesis reviews to inform specific end-user targets such as for management and policy-making in the health field [45]. A recent overview by Gough and colleagues attempted to outline the differences between review designs and methods by describing the important conceptual and practical differences amongst them [8]. However, a comprehensive manual for all of the different synthesis methods (quantitative/qualitative or mixed), outlining how they are related and how to decide which methodology is the most appropriate for a particular research question does not currently exist. To our knowledge, the current study will be the first to describe an overall taxonomy of all existing types of knowledge synthesis methods, to characterise the differences between them, and to develop a strategy for knowledge users to be able to select the most appropriate method to answer their research questions.

The specific objectives of the current study are to: (1) to conduct a systematic search for knowledge synthesis methods across multi-disciplinary fields, such as health and philosophy; (2) compare and contrast the different knowledge synthesis methods; and, (3) map out the specific steps to conducting the knowledge synthesis methods, which will be used to inform the development of a knowledge synthesis methods manual/tool.

Methods/Design

Search strategy

We will use the methodologically rigorous scoping review approach proposed by Arksey and O’Malley [48] to conduct a systematic search across the disciplines of health and philosophy. We will search the following electronic databases from inception onwards: MEDLINE, CINAHL, EMBASE, PsycInfo, the Cochrane Methodology Register, Cochrane Database of Systematic Reviews, Social Sciences Abstracts, LISA, Philosopher’s Index, and ERIC. We will also perform targeted searches for grey literature (i.e., difficult to locate or unpublished material) by searching 1) Google, 2) relevant discipline-based listservs (e.g., CANMEDLIB, MEDLIB), and 3) the websites of agencies that fund or conduct knowledge synthesis (e.g., CIHR, Canadian Agency for Drugs and Technologies in Health, Agency for Healthcare Research and Quality, Cochrane and Campbell Collaborations, Joanna Briggs Institute, Centre for Reviews and Dissemination).

The draft literature search for MEDLINE can be found in Additional file 1, which uses a combination of medical sub-headings (MeSH) and free text terms. It will be modified as necessary for the other databases. The search strategy will not be limited by study design, year or language of dissemination and will be peer reviewed by another information specialist using the Peer Review of Electronic Search Strategies (PRESS) checklist [49]. The literature search will be supplemented by scanning the reference lists of included studies, searching authors’ personal files, and contacting methodological experts in each field.

Study selection: inclusion criteria

Study design: All study designs will be considered including qualitative and quantitative methods such as methodology reports; knowledge syntheses (including a description of the synthesis method); short reports describing the development, use, or comparison of methods for knowledge synthesis. Type of knowledge synthesis: We will focus on synthesis methods above and beyond traditional systematic reviews and exclude methods on economic analysis or clinical practice guidelines. Disciplines: Health: “A state of complete physical, mental and social well-being and not merely the absence of disease or infirmity” [50] (and thus includes the disciplines of psychology, education and sociology) and philosophy. These were selected because many of the knowledge synthesis methods originated from these disciplines (e.g., systematic review methods rooted in education and psychology; realist reviews based on philosophy).

Study selection: screening

Prior to commencing the screening process, a calibration exercise will be conducted to ensure reliability in correctly selecting articles for inclusion. It will entail independently screening a random sample of 5% of the included citations by two reviewers. Eligibility criteria will be modified if low agreement is observed between the reviewers (e.g., a kappa statistic less than 50%). The reviewers will then independently screen the remainder of the search results using a pre-defined relevance criteria form for all levels of screening (e.g., title and abstract, full-text review). Discrepancies will be resolved by discussion with a third reviewer.

Data abstraction

A data abstraction form will be tested independently by two reviewers on a random sample of 10 articles and revised iteratively, as needed. It is anticipated that the data items will include study characteristics (e.g., first author, year of publication) and characteristics related to the method (e.g., general description of the review method, discipline) (Additional file 1). Two investigators will independently read each article and extract the relevant data. Differences in abstraction will be resolved by discussion or the involvement of a third reviewer. We will not formally appraise methodological quality because the aim of a scoping review is to identify gaps in the evidence base and to target topic areas for future reviews.

Data analysis

We will analyze the data according to a three-stage process aimed at addressing the three research objectives: to characterize the synthesis methodologies (Synthesis objective 1); to identify the similarities and differences amongst these methods (Synthesis objective 2); and to map out a process for conducting different synthesis methods and to provide an approach for matching the research question to the appropriate methods (Synthesis objective 3). Table Table22 shows the analysis plan and anticipated outputs for each of these objectives. Data analysis will involve quantitative (e.g., frequency analysis) and qualitative (e.g., thematic analysis) methods. We anticipate that this multi-layer synthesis process will also identify existing gaps in the literature, and reveal potential topics for conducting other systematic or novel reviews in the future.

Table 2
Analysis plan and anticipated outputs for each of the 3 synthesis objectives

Engagement of knowledge users and KT plan

We have adopted an integrated KT approach to this project through the inclusion of knowledge users (i.e., systematic review methodologists, journal editors, review funders, policy makers, students and educators who teach knowledge synthesis methodology), who have been and will continue to be involved in every step of the process through to the reporting format and the methods for disseminating and implementing findings, drawing on Graham’s Knowledge-to-Action (KTA) framework [51]. We plan to develop an active KT plan by: 1) identifying the key messages arising from this research project; 2) determining the principal target audiences for each of these messages; 3) seeking out the most credible messenger for these messages and engaging their interest in becoming involved in the communication of these messages; and 4) launching a KT strategy grounded in the best available research evidence. We will use a diverse range of approaches to disseminate the results of this review to the different stakeholder groups (including an interactive workshop that will bring together the key target audiences for our research). These strategies will ensure that the research continues to reflect the relevant needs of the end users of this information, and to facilitate appropriate dissemination of outputs.

Anticipated challenges

We foresee some potential challenges related to this scoping review. First, the yield of the literature search might be more extensive than anticipated—the team will work closely with the information specialist to ensure that the scope is manageable. Second, it might be challenging to categorize the knowledge synthesis methods accurately (e.g., distinguishing between quantitative/qualitative or mixed / hybrid approaches or those not formally categorized) and to appropriately match a research question with a synthesis method. However, we have a strong team with diverse experience in different research methods, and are planning to hold stakeholder meetings to iteratively receive in-depth feedback from our end users.

Discussion

The proposed scoping review has the potential to impact practice and policy and will make several contributions to the KT and health services research literature. First, the work will advance the science of knowledge synthesis by providing a systematic process for key knowledge users to make informed decisions about which synthesis method is the most appropriate to answer their research questions. This may also augment the quality of the research evidence produced. In particular, the work will highlight the potential for novel knowledge synthesis methods to clarify complex, multi-component, and multi-disciplinary healthcare interventions [13], and to contribute to the advancement of evidence-based practice and evidence-based decision-making. Second, there is currently no comprehensive manual for all available synthesis methods (quantitative/qualitative or mixed). To develop this manual, a taxonomy and comparison of all available synthesis methods are needed. Our work aims to develop the taxonomy of synthesis methods across multiple disciplines such as health and philosophy. Third, the scoping review will help map the literature, identify gaps where primary methods evidence is lacking and needed, and where systematic reviews are required; we anticipate that this work will lead to multiple subsequent systematic reviews. For example, one future systematic review may focus on knowledge synthesis methods for health services research and another may focus on knowledge synthesis of qualitative data. Fourth, the work has the potential to directly influence knowledge synthesis funders such as the Canadian Institutes of Health Research (CIHR) in developing resources (e.g., modules) that can be used to increase awareness of novel synthesis methods and their relevance for addressing complex evidence. This information is especially imperative for those conducting peer review of knowledge synthesis grants. Fifth, the scoping review can be used by publishers and editors to assist with the peer review of manuscripts describing these types of knowledge syntheses. Sixth, our findings have the potential to influence health research methods curricula within clinical epidemiology programs, by expanding the current understanding of synthesis methods. The development and evaluation of complex interventions has emerged as an important component of KT, so expertise in conducting non-traditional review methods will become increasingly important for researchers, teachers, and students. Lastly, the work will be targeted across a broad scope of health disciplines, which will provide the opportunity to elicit more generalizable findings that can directly inform practice and policy decisions within these disciplines. Results from this work will be the starting point of a comprehensive manual and decision algorithm on how to conduct the different synthesis methods and the proposed KT strategy will serve to engage the relevant stakeholders in clarifying and fulfilling the research agenda proposed in the scoping review (Table (Table33 summarizes the anticipated products that will be generated).

Table 3
Anticipated products generated by the scoping review

Conducting a scoping review of available knowledge synthesis methods across multi-disciplinary fields will help funders, publishers, policy-makers, researchers, teachers, and students make informed decisions about the most appropriate synthesis method to answer research questions about complex evidence, and provide the opportunity to elicit findings directly informing practice and policy decisions.

Competing interests

The authors declare that they have no competing interests.

Authors’ contributions

All authors participated in the design and development of the protocol. MK, ACT, and SES drafted the manuscript, and all authors read and approved the final manuscript.

Funding

The study was funded by a Canadian Institutes of Health Research (CIHR) Knowledge Synthesis grant. MK holds a CIHR Banting Postdoctoral Fellowship, ACT a CIHR/DSEN new investigator award, and SES a Tier 1 Canada Research Chair in Knowledge Translation.

Pre-publication history

The pre-publication history for this paper can be accessed here:

http://www.biomedcentral.com/1471-2288/12/114/prepub

Supplementary Material

Additional file 1:

Appendices.

Acknowledgements

We thank Drs. Jeremy Grimshaw, David Moher, and Peter Tugwell, who provided their support and expertise in knowledge synthesis methods and knowledge translation on this protocol.

References

  • Cook DJ, Mulrow CD, Haynes RB. Systematic reviews: synthesis of best evidence for clinical decisions. Ann Intern Med. 1997;126(5):376–380. [PubMed]
  • Key elements of a population health approach. Available at: http://www.phac-aspc.gc.ca/ph-sp/approach-approche/appr-eng.php#key_elements (Accessed June 19, 2012).
  • Devereaux PJ, Manns BJ, Ghali WA, Quan H, Guyatt GH. Reviewing the reviewers: the quality of reporting in three secondary journals. CMAJ. 2001;164(11):1573–1576. [PMC free article] [PubMed]
  • Straus SE, Tetroe J, Graham ID. Knowledge Translation in Health Care: Moving from Evidence to Practice. UK: Wiley-Blackwell Publishing Ltd; 2009.
  • Antman EM, Lau J, Kupelnick B, Mosteller F, Chalmers TC. A comparison of results of meta-analyses of randomized control trials and recommendations of clinical experts. Treatments for myocardial infarction. JAMA. 1992;268(2):240–248. doi: 10.1001/jama.1992.03490020088036. [PubMed] [Cross Ref]
  • Higgins JPT, Green S. Cochrane Handbook for Systematic Reviews of Interventions Version 5.1.0 [updated March 2011]. The Cochrane Collaboration. 2011. Available from http://www.cochrane-handbook.org.
  • Greenhalgh T, Kristjansson E, Robinson V. Realist review to understand the efficacy of school feeding programmes. BMJ. 2007;335(7625):858–861. doi: 10.1136/bmj.39359.525174.AD. [PMC free article] [PubMed] [Cross Ref]
  • Gough D, Thomas J, Oliver S. Clarifying differences between review designs and methods. Syst Rev. 2012;1:28. doi: 10.1186/2046-4053-1-28. [PMC free article] [PubMed] [Cross Ref]
  • Kastner M, Estey E, Perrier L, Graham ID, Grimshaw J, Straus SE. Understanding the relationship between the perceived characteristics of clinical practice guidelines and their uptake: a realist review. Impl Sci. 2011;6:69. doi: 10.1186/1748-5908-6-69. [PMC free article] [PubMed] [Cross Ref]
  • Pawson R, Greenhalgh T, Harvey G, Walshe K. Realist review–a new method of systematic review designed for complex policy interventions. J Health Serv Res Policy. 2005;10(Suppl 1):21–34. [PubMed]
  • Kristjansson EA, Robinson V, Petticrew M, MacDonald B, Krasevec J, Janzen L. et al. School feeding for improving the physical and psychosocial health of disadvantaged elementary school children. Cochrane Database Syst Rev. 2007;1:CD004676. [PubMed]
  • Ring N, Ritchie K, Mandava L, Jepson R. A guide to synthesising qualitative research for researchers undertaking health technology assessments and systematic reviews. Available at: http://www.healthcareimprovementscotland.org/programmes/clinical__cost_effectiveness/shtg/synth_qualitative_research.aspx (Accessed on June 19, 2012).
  • Shepperd S, Lewin S, Straus S, Clarke M, Eccles MP, Fitzpatrick R. et al. Can we systematically review studies that evaluate complex interventions? PLoS Med. 2009;6(8):e1000086. doi: 10.1371/journal.pmed.1000086. [PMC free article] [PubMed] [Cross Ref]
  • Mazzocato P, Savage C, Brommels M, Aronsson H, Thor J. Lean thinking in healthcare: a realist review of the literature. Qual Saf Health Care. 2010;19(5):376–382. doi: 10.1136/qshc.2009.037986. [PubMed] [Cross Ref]
  • Thorne S, Paterson B. Shifting images of chronic illness. Image J Nurs Sch. 1998;30(2):173–178. doi: 10.1111/j.1547-5069.1998.tb01275.x. [PubMed] [Cross Ref]
  • Wong G, Greenhalgh T, Pawson R. Internet-based medical education: a realist review of what works, for whom and in what circumstances. BMC Med Educ. 2010;10:12. doi: 10.1186/1472-6920-10-12. [PMC free article] [PubMed] [Cross Ref]
  • Rycroft-Malone J, McCormack B, Hutchinson AM. et al. Realist synthesis: illustrating the method for implementation research. Impl Sci. 2012;7:33. doi: 10.1186/1748-5908-7-33. [PMC free article] [PubMed] [Cross Ref]
  • Sutton AJ, Abrams KR. Bayesian methods in meta-analysis and evidence synthesis. Stat Methods Med Res. 2001;10:277–303. doi: 10.1191/096228001678227794. [PubMed] [Cross Ref]
  • Roberts KA, Dixon-Woods M, Fitzpatrick R, Abrams KR, Jones DR. Factors affecting uptake of childhood immunization: a Bayesian synthesis of qualitative and quantitative evidence. Lancet. 2002;360:1596–1599. doi: 10.1016/S0140-6736(02)11560-1. [PubMed] [Cross Ref]
  • Stemler S. An overview of content analysis. Practical Assessment, Research and Evaluation. 2001;7:17.
  • Dixon-Woods M, Cavers D, Agarwal S, Annandale E, Arthur A, Harvey J. et al. Conducting a critical interpretive synthesis of the literature on access to healthcare by vulnerable groups. BMC Med Res Methodol. 2006;6:35. doi: 10.1186/1471-2288-6-35. [PMC free article] [PubMed] [Cross Ref]
  • Droitcour J, Silberman G, Chelimsky E. Cross-design synthesis: a new form of metaanalysis for combining results from randomised clinical trials and medical-practice databases. Int Journal of Tech Assessment in Health Care. 1993;9:440–927. doi: 10.1017/S0266462300004694. [PubMed] [Cross Ref]
  • Banning J. Ecological triangulation: an approach for qualitative meta-synthesis. Available at: http://mycahs.colostate.edu/james.h.banning/PDFs/Ecological%20Triangualtion.pdf (Accessed on June 19, 2012).
  • Pope C, Ziebland S, Mays N. Qualitative research in health care: analysing qualitative data. Br Med J. 2000;320:114–116. doi: 10.1136/bmj.320.7227.114. [PMC free article] [PubMed] [Cross Ref]
  • Brunton G, Oliver S, Oliver K, Lorenc T. A Synthesis of Research Addressing Children’s, Young People’s and Parents’ Views of Walking and Cycling for Transport. London: EPPI-Centre, Social Science Research Unit, Institute of Education, University of London; 2006.
  • Strauss AL, Corbin J. Basics of Qualitative Research: Techniques and Procedures for Developing Grounded Theory. Thousand Oaks: Sage; 1998.
  • Noblit GW, Hare RD. Meta-ethnography: synthesizing qualitative studies. Newbury Park: Sage; 1988.
  • Weed M. “Meta interpretation”: a method for the interpretive synthesis of qualitative research. Forum Qualitative Sozialforschung/Forum: Qualitative Social Research. 2005;6(1; Art. 37):1–18.
  • Greenhalgh T, Robert G, Macfarlane F, Bate P, Kyriakidou O, Peacock R. Storylines of research in diffusion of innovation: a meta-narrative approach to systematic review. Soc Sci Med. 2005;61(2):417–430. doi: 10.1016/j.socscimed.2004.12.001. [PubMed] [Cross Ref]
  • Paterson BL, Thorne SE, Canam C, Jillings C. Meta-Study of Qualitative Health Research. A Practical Guide to Meta-Analysis and Meta-Synthesis. Thousand Oaks: Sage Publications; 2001.
  • Sandelowski M, Barroso J. Creating metasummaries of qualitative findings. Nurs Res. 2003;52(4):226–233. doi: 10.1097/00006199-200307000-00004. [PubMed] [Cross Ref]
  • Sandelowski M, Docherty S, Emden C. Qualitative metasynthesis: Issues and techniques. Res Nurs Health. 1997;20(4):365–371. doi: 10.1002/(SICI)1098-240X(199708)20:4<365::AID-NUR9>3.0.CO;2-E. [PubMed] [Cross Ref]
  • Pluye P, Grad R, Dunikowski LG, Stephenson R. Impact of clinical information-retrieval technology on physicians: A literature review of quantitative, qualitative and mixed methods studies. Int J Med Inform. 2005;74:745–768. doi: 10.1016/j.ijmedinf.2005.05.004. [PubMed] [Cross Ref]
  • Pluye P, Gagnon MP, Griffiths F, Johnson-Lafleur J. A scoring system for appraising mixed methods research, and concomitantly appraising qualitative, quantitative and mixed methods primary studies in Mixed Studies Reviews. Int J Nurs Stud. 2009;46(4):529–546. doi: 10.1016/j.ijnurstu.2009.01.009. [PubMed] [Cross Ref]
  • Sandelowski M. In: Handbook of Mixed Methods: Social and Behavioral Research. Tashakkori A, Teddue C, editor. London: Sage; 2003. Tables or tableaux? The challenges of writing and reading mixed methods studies; pp. 321–350.
  • Dixon-Woods M, Agarwal S, Jones D, Young B, Sutton A. Synthesizing qualitative and quantitative evidence: a review of possible methods. J Health Serv Res Policy. 2005;10(1):45–53. doi: 10.1258/1355819052801804. [PubMed] [Cross Ref]
  • Popay J, Roberts H, Sowden A, Petticrew M, Arai L, Rodgers M, Britten N, Roen K, Duffy S. Guidance on the conduct of narrative synthesis in systematic reviews. Results of an ESRC funded research project. UK: University of Lancaster; 2006. Unpublished report.
  • Yin R. Applied Social Research Methods Series Vol 5. 3. Thousand Oaks CA: Sage; 2003. Case study research, design and methods.
  • Miles MB, Huberman AM. Qualitative data analysis: an expanded sourcebook. London: Sage; 1994.
  • Jensen L, Allen M. Meta-synthesis of qualitative findings. Qual Health Res. 1996;6(4):553–560. doi: 10.1177/104973239600600407. [Cross Ref]
  • Grant MJ, Booth A. A typology of reviews: an analysis of 14 review types and associated methodologies. Health Info Libr J. 2009;26:91–108. doi: 10.1111/j.1471-1842.2009.00848.x. [PubMed] [Cross Ref]
  • Yin R, Heald K. Using the case survey method to analyse policy studies. Admin Sci Q. 1975;20:371–381. doi: 10.2307/2391997. [Cross Ref]
  • Pelz D. Use of innovation in innovating processes by local governments. Ann Arbor: University of Michigan, CRUSK Institute for Social Research; 1981.
  • Lucas PJ, Arai L, Baird B, Law C, Roberts HM. Worked examples of alternative methods for the synthesis of qualitative and quantitative research in systematic reviews. BMC Med Res Methodol. 2007;7:4. doi: 10.1186/1471-2288-7-4. [PMC free article] [PubMed] [Cross Ref]
  • Mays N, Pope C, Popay J. Systematically reviewing qualitative and quantitative evidence to inform management and policy-making in the health field. J Health Serv Res Policy. 2005;10(1):6–20. doi: 10.1258/1355819054308576. [PubMed] [Cross Ref]
  • Thomas J. Harden A (2008) Methods for the thematic synthesis of qualitative research in systematic reviews. BMC Med Res Methodol. 2008;8:45. doi: 10.1186/1471-2288-8-45. [PMC free article] [PubMed] [Cross Ref]
  • Barnett-Page E, Thomas J. Methods for the synthesis of qualitative research: a critical review. BMC Med Res Method. 2009;9:59. doi: 10.1186/1471-2288-9-59. [PMC free article] [PubMed] [Cross Ref]
  • Arksey H, O’Malley L. Scoping studies: towards a methodological framework. Int J Social Res Method. 2005;8:19–31. doi: 10.1080/1364557032000119616. [Cross Ref]
  • Sampson M, McGowan J, Cogo E, Grimshaw J, Moher D, Lefebvre C. An evidence-based practice guideline for the peer review of electronic search strategies. J Clin Epidemiol. 2009;62(9):944–952. doi: 10.1016/j.jclinepi.2008.10.012. [PubMed] [Cross Ref]
  • World Health Organization (WHO) definition of health. Available at: http://www.who.int/about/definition/en/print.html. Accessed on July 3, 2012.
  • Graham ID, Logan J, Harrison MB, Straus SE, Tetroe J, Caswell W. et al. Lost in knowledge translation: time for a map? J Contin Educ Health Prof. 2006;26(1):13–24. doi: 10.1002/chp.47. [PubMed] [Cross Ref]

Articles from BMC Medical Research Methodology are provided here courtesy of BioMed Central
PubReader format: click here to try

Formats:

Related citations in PubMed

See reviews...See all...

Cited by other articles in PMC

See all...

Links

Recent Activity

Your browsing activity is empty.

Activity recording is turned off.

Turn recording back on

See more...