Measuring situation awareness in health care providers: a systematic review of measurement properties using COSMIN methodology

Chiman Ghaderi; Roghayeh Esmaeili; Abbas Ebadi; Mohammad Reza Amiri

doi:10.1186/s13643-023-02220-6

Measuring situation awareness in health care providers: a systematic review of measurement properties using COSMIN methodology

Syst Rev. 2023 Apr 1;12(1):60. doi: 10.1186/s13643-023-02220-6.

Authors

Chiman Ghaderi^{1

2}, Roghayeh Esmaeili³, Abbas Ebadi^{4

5}, Mohammad Reza Amiri⁶

Affiliations

¹ Department of Anesthesiology and Operating Room, Student Research Committee, School of Nursing and Midwifery, Shahid Beheshti University of Medical Sciences, Tehran, Iran.
² Department of Operating Room, Maragheh University of Medical Sciences, Maragheh, Iran.
³ Department of Medical-Surgical, School of Nursing and Midwifery, Shahid Beheshti University of Medical Sciences, Vali Asr Ave., Niayesh Cross Road, Niayesh Complex, Tehran, Iran. r.esmaieli@sbmu.ac.ir.
⁴ Behavioral Sciences Research Center, Life Style Institute, Baqiyatallah University of Medical Sciences, Tehran, Iran.
⁵ Nursing Faculty, Baqiyatallah University of Medical Sciences, Tehran, Iran.
⁶ Department of Medical Library and Information Sciences, School of Paramedicine, Hamadan University of Medical Sciences, Hamadan, Iran.

Abstract

Background: Situation awareness (SA) is a key factor in accountability and ensuring patient safety in health care. SA is an essential element to research on human factors in healthcare. It is essential to identify valid instruments for measuring this concept and assessing how it is affected by interventions and educational methods.

Methods: This systematic review aimed to assess the measurement properties of situation awareness instruments in health care providers' (HCP_S) using the COnsensus-based Standards for the selection of health Measurement INstruments (COSMIN) methodology. Four databases (Medline (through PubMed), Embase, Scopus, and Web of Science) were systematically searched. A manual search was also conducted on Google Scholar and the reference list of the included primary studies to supplement the electronic search. Studies aiming to determine the measurement properties of SA instruments or non-technical skills in HCP_S were included. The overall results for each measurement property were reported as sufficient, insufficient, inconsistent, or indeterminate, and the quality of evidence was reported as high, moderate, low, or very low.

Results: A total of 25 studies and 15 instruments were included in the study. More than one measurement property was reported in some of the studies, and none of the studies presented all measurement properties. The most common measurement properties were content validity (12/25) and internal consistency (12/25). Cross-cultural validity and responsiveness were not investigated in any study. Evidence quality for the measurement properties was not high in any of the 15 instruments.

Conclusions: None of the instruments can be recommended as the most suitable instrument, and all instruments were classified as promising instruments in need of further psychometric assessment. This systematic review proves the dire need for the development and psychometric evaluation of instruments to measure SA in HCPs in clinical settings.

Systematic review registration: PROSPERO CRD42020147349.

Keywords: Health care providers; Non-technical skills; Psychometrics; Reliability; Situation awareness; Validity.

Publication types

Systematic Review
Research Support, Non-U.S. Gov't

MeSH terms

Awareness*
Delivery of Health Care*
Health Personnel
Humans
Patient Safety
Psychometrics
Reproducibility of Results