Format

Send to

Choose Destination
J Am Med Inform Assoc. 2018 Oct 1;25(10):1284-1291. doi: 10.1093/jamia/ocy113.

eAssessment: development of an electronic version of the Objective Structured Assessment of Debriefing tool to streamline evaluation of video recorded debriefings.

Author information

1
Department of Cardiopulmonary Science, LSU Health New Orleans School of Allied Health Professions, 1900 Gravier Street, New Orleans, Louisiana 70112, USA.
2
Department of Social Medicine, Federal University of Espirito Santo, Vitoria, ES 29043-900, Brazil.
3
Epidemiology Data Center, LSU Health New Orleans School of Public Health, 2020 Gravier Street, New Orleans, Louisiana 70112, USA.
4
LSU Health New Orleans School of Nursing, 1900 Gravier Street, New Orleans, Louisiana 70112, USA.
5
Department of Surgery, LSU Health New Orleans School of Medicine, 1542 Tulane Ave, Rm 734, New Orleans, LA 70112, USA.

Abstract

Objective:

The Objective Structured Assessment of Debriefing (OSAD) is an evidence-based, 8-item tool that uses a behaviorally anchored rating scale in paper-based form to evaluate the quality of debriefing in medical education. The objective of this project was twofold: 1) to create an easy-to-use electronic format of the OSAD (eOSAD) in order to streamline data entry; and 2) to pilot its use on videoed debriefings.

Materials and Methods:

The eOSAD was developed in collaboration with the LSU Health New Orleans Epidemiology Data Center using SurveyGizmo (Widgix Software, LLC, Boulder, CO, USA) software. The eOSAD was then piloted by 2 trained evaluators who rated 37 videos of faculty teams conducting pre-briefing and debriefing after a high-fidelity trauma simulation. Inter-rater reliability was assessed, and evaluators' qualitative feedback was obtained.

Results:

Inter-rater reliability was good [prebrief, intraclass correlation coefficient, ICC = 0.955 (95% CI, 0.912-0.977), Pā€‰<ā€‰.001; debrief, ICC = 0.853 (95% CI, 0.713-0.924), Pā€‰<ā€‰.001]. Qualitative feedback from evaluators found that the eOSAD was easy to complete, simple to read and add comments, and reliably stored data that were readily retrievable, enabling the smooth dissemination of information collected.

Discussion:

The eOSAD features a secure login, sharable internet access link for distant evaluators, and the immediate exporting of data into a secure database for future analysis. It provided convenience for end-users, produced reliable assessments among independent evaluators, and eliminated multiple sources of possible data corruption.

Conclusion:

The eOSAD tool format advances the post debriefing evaluation of videoed inter-professional team training in high-fidelity simulation.

PMID:
30299477
DOI:
10.1093/jamia/ocy113

Supplemental Content

Full text links

Icon for Silverchair Information Systems
Loading ...
Support Center