CRD summary

The authors concluded that behaviour-based safety interventions were associated with a statistically significant reduction in workplace accidents or injuries, but the poor quality of the studies means that these results should be interpreted with caution. There were limitations to this review but, overall, the authors' conclusion appears to reflect limited evidence from poor-quality studies.

Authors' objectives

To evaluate the effectiveness of behaviour-based safety (BBS) interventions in reducing accidents and injuries in the workplace.

Searching

MEDLINE, Ergonomics, Expanded Academic Index, Compendex, Health and Safety Science Abstracts, the Social Sciences Citation Index and PsycINFO were searched for peer-reviewed studies published in the English language up to January 2004; the search terms were reported. In addition, other studies by the most prominent authors in the field were tracked and reference lists in all related reports and reviews were screened.

Study selection

Assessment of study quality

Two reviewers independently assessed validity using the Epidemiological Appraisal Instrument (see Other Publications of Related Interest). This contained 43 items in the following five fields: study description, selection of participants, observation quality, data analysis and generalisability of the results. Scores of between 0 and 2 were assigned to each item. Any disagreements between the reviewers were resolved through consensus.

Data extraction

The authors did not state how the data were extracted for the review, or how many reviewers performed the data extraction.

For each study, the numbers of accidents or injuries were extracted, calculated from available data, or estimated from graphs. The reviewers reported details of the methods used. One standardised accident/injury rate (SAR) with 95% confidence interval (CI) was calculated for each study (number of observed events divided by the number of expected events using pre-intervention data).

Methods of synthesis

Results of the review

Thirteen studies were included (number of participants not calculable). There was one study with a control group (maximum n=140) and twelve before-and-after studies. The sample size, where reported, ranged from 10 to 1,000.

The studies were of poor to 'marginal' quality (validity scores ranged from 0.19 to 0.46). Methodological problems included lack of the following: description of losses to follow-up; accounting for confounders; reporting of measures of variability of results data; reporting of reliability and validity of outcome measures; and adjustment for duration of follow-up.

All included studies showed a decrease in accidents or injuries post BBS intervention, with the SARs for each study ranging from 0.13 to 0.98; the decrease was statistically significant in eight of these studies.

The studies were statistically heterogeneous (Q=278.4, d.f.=12). The overall metaSAR showed a statistically significant reduction in accidents or injuries post-intervention; the metaSAR using a random-effects model was 0.61 (95% CI: 0.72, 0.97).

Authors' conclusions

BBS interventions were associated with a statistically significant reduction in workplace accidents or injuries, but the poor quality of the studies means that these results should be interpreted with caution. Further good-quality studies are required.

CRD commentary

The review addressed a clear question that was defined in terms of the intervention and outcomes; inclusion criteria were not defined for the participants or study design. Several relevant sources were searched but no attempts were made to minimise either publication or language bias; this could have resulted in the omission of other relevant studies. Methods were used to minimise reviewer error and bias in the validity assessment, but it was not clear whether similar steps were taken in the study selection and data extraction processes. Validity was assessed and the results reported, and validity was taken into account when summarising the evidence.

The finding of significant heterogeneity suggests that meta-analysis might not have been an appropriate method of summarising these studies. There were limitations to this review (such as incomplete reporting of review methods) but, overall, the authors' conclusion appears to reflect the limited evidence obtained from poor-quality studies.

Implications of the review for practice and research

Practice: The authors did not state any implications for practice.

Research: The authors stated that the quality of future studies of behaviour-based interventions could be improved by prior assessment of the needs of the workplace and designing an appropriate intervention; use of a comparable control group; adequate reporting of losses to follow-up, sample size calculation, participation rates, eligibility criteria and characteristics of the participants; use of randomisation; accounting for confounders in the analysis; statistically testing intervention effects; and an evaluation of the validity and reliability of the outcome measures.

Bibliographic details

Tuncel S, Lotlikar H, Salem S, Daraiseh N. Effectiveness of behaviour based safety interventions to reduce accidents and injuries in workplaces: critical appraisal and meta-analysis. Theoretical Issues in Ergonomics Science 2006; 7(3): 191-209.

Other publications of related interest

Genaidy A, LeMasters GK. Epidemiological appraisal instrument (EAI). Theor Issues Ergon Sci 2006;7:187-9.

Indexing Status

Subject indexing assigned by CRD

MeSH

Accident Prevention /methods; Accidents, Occupational /prevention & control /psychology; Behavior Therapy; Habits; Health Behavior; Occupational Health; Organizational Culture; Risk Factors; Risk-Taking; Safety; Safety Management /organization & administration; Workplace /organization & administration; Wounds and Injuries /prevention & control

AccessionNumber

12007007033

Database entry date

31/03/2008

Record Status

This is a critical abstract of a systematic review that meets the criteria for inclusion on DARE. Each critical abstract contains a brief summary of the review methods, results and conclusions followed by a detailed critical assessment on the reliability of the review and the conclusions drawn.