Send to

Choose Destination
Res Synth Methods. 2018 Dec;9(4):510-520. doi: 10.1002/jrsm.1279. Epub 2017 Nov 28.

Evaluation of a new method for librarian-mediated literature searches for systematic reviews.

Author information

Medical Library-Erasmus MC, Erasmus University Medical Centre Rotterdam, Rotterdam, the Netherlands.
Spencer S Eccles Health Sciences Library, University of Utah, Salt Lake City, UT, USA.
Department of Family Medicine, School for Public Health and Primary Care (CAPHRI), Maastricht University, Maastricht, the Netherlands.
Kleijnen Systematic Reviews Ltd, York, UK.


To evaluate and validate the time of completion and results of a new method of searching for systematic reviews, the exhaustive search method (ESM), using a pragmatic comparison.


Single-line search strategies were prepared in a text document. Term completeness was ensured with a novel optimization technique. Macros in MS Word converted the syntaxes between databases and interfaces almost automatically. We compared search characteristics, such as number of search terms and databases, and outcomes, such as number of included and retrieved references and precision, from ESM searches and other Dutch academic hospitals identified by searching PubMed for systematic reviews published between 2014 and 2016. We compared time to perform the ESM with a secondary comparator of recorded search times from published literature and contact with authors to acquire unpublished data.


We identified 73 published Erasmus MC systematic reviews and 258 published by other Dutch academic hospitals meeting our criteria. We pooled search time data from 204 other systematic reviews. The ESM searches differed by using 2 times more databases, retrieving 44% more references, including 20% more studies in the final systematic review, but the time needed for the search was 8% of that of the control group. Similarities between methods include precision and the number of search terms.


The evaluated similarities and differences suggest that the ESM is a highly efficient way to locate more references meeting the specified selection criteria in systematic reviews than traditional search methods. Further prospective research is required.


bibliographic databases; information storage and retrieval; quality improvement; review literature as topic

[Available on 2019-12-01]

Supplemental Content

Full text links

Icon for Wiley
Loading ...
Support Center