A detailed description of the critical appraisal of individual studies is included in Appendix 3.
Systematic Reviews
The SR13 set clear objectives but did not cite a published protocol. A comprehensive literature search was conducted on multiple databases as well as a grey literature search. However, the search was restricted to publications from 2002 onward and by language (English). No justification was given for the restricted search dates, so it is unclear whether potentially relevant evidence was not considered in formulation of results, and also reduces transparency due to the absence of clarity surrounding evidence synthesis. The primary concern was that no explicit list of included studies and study characteristics was provided. In general the review did not follow standard SR reporting format as set out by the Preferred Reporting Items for Systematic Reviews and Meta-Analyses Statement. Scientific quality was assessed with the National Health and Medical Research Council Dimensions of Evidence tool, and quality was taken into consideration in the formulation of conclusions. Quality of individual studies was not discussed explicitly. No pooling of results or assessment of publication bias was conducted. The review included disclosure of professional affiliations and funding sources none of which appeared to be industry-associated.
Non-Randomized Studies
The two non-randomized studies23,24 were both based on health records; therefore, while they suffered from the typical limitations of retrospective studies including lack of randomization and blinding and possible misclassification bias, some design elements such as patient selection and follow-up did not pose a significant risk of bias. In terms of reporting, both studies stated their objectives, intervention, and study findings clearly. One study reported estimates of random variability and probability values,24 but the other study did not as no group comparisons were conducted.23 Neither study reported safety outcomes associated with folate testing. In addition, one study did not report demographic characteristics thoroughly.24 As these were database linked studies, the external validity was reasonable for hospital patients in developed countries with folate fortification. One study conducted a thorough review of indications for folate testing in a subset of the total population but did not report demographic characteristics of this subgroup leading to unclear generalizability of these outcomes.23 Neither study had the presence of design elements necessary to blind participants or assessors but the statistical analysis was appropriate and the main outcomes were measured appropriately. As both studies relied on chart data it is possible that a change in management may not have been recorded. Potential confounders were not considered in one study23 and minimally assessed (i.e., age, body mass index, hematological profile, other micronutrient status, race, alcohol intake, use of supplements) in the context of group comparisons in the other, but did not include clinical conditions associated with folate deficiency.24 Neither study disclosed a sample size calculation.
Evidence-Based Guidelines
There was substantial variation in the quality of evidence-based guidelines. Most guidelines had clearly described objectives,25–33 target populations,25–33 and explicitly stated health questions supporting their scope and purpose.25,26,26–32 The clinical expertise represented on the guideline development groups and the target users were clearly stated by most guidelines,25–27,29–33 but not all,25,28,33 and included representation from multiple clinical specialties as well as methodological support. Specific health questions were not stated by one guideline.33 Patient input was not sought by any of the guideline development teams but one guideline stated that patient preferences were considered when “a recommendation involves a substantial element of personal choice or values.”30 The level of rigour of development varied. While comprehensive search strategies were employed by all guideline development teams, it was unclear whether the search was truly systematic in several cases as the number of reviewers involved in screening, selection, and abstraction tasks was not disclosed.25,27,28,32,33 Likewise, several guidelines failed to disclose their study selection methods27,28,32,33 or disclose the number of reviewers involved in information synthesis.27,28,32 Despite these drawbacks, the quality of evidence,25–32 methods for formulating recommendations,25–31,33 as well as consideration of risk-benefit profile, 25–33 linkage between recommendations and supporting evidence,26–28,31 and a peer-review process25–31,33 were present in the majority of guidelines. One guideline failed to declare a peer-review process,32 and the direct linkage between evidence and recommendations was unclear in several.25,32,33 In several cases it was clear that evidence search results did not include information to inform recommendations regarding folate testing, which relied on expert opinion.29,30 Some guidelines27,29–31,33 disclosed a plan and timeline for updating the review, though dates were unclear in several cases. The clarity of presentation of recommendations was good in most cases.25,26,28–33 Key recommendations were embedded within text and not explicitly stated in some cases.25,32,33 The area in which most25,26,26–28,32,33 but not all29–31 guidelines were lacking was applicability. Facilitators and barriers to implementation, implementation tools, and a method of monitoring or auditing impact were not described. In cases where these elements are missing the potential and measured impact of these guidelines on practice and the culture of folate testing is difficult to gauge. Also, the lack of patient input may have had consequences for the scope of the guidelines and relevance to the needs of patient populations at risk for folate deficiency. All guidelines disclosed funding sources and competing interests and while it was unclear whether views of guideline group members influenced recommendations (especially in the case of clinical consensus) no funding sources were of great concern (i.e., no manufacturers or purveyors of folate testing).