Format

Send to

Choose Destination
Med Decis Making. 2017 Aug;37(6):715-724. doi: 10.1177/0272989X17696998. Epub 2017 Mar 29.

The Potential of Collective Intelligence in Emergency Medicine: Pooling Medical Students' Independent Decisions Improves Diagnostic Performance.

Author information

1
Center for Adaptive Rationality, Max Planck Institute for Human Development, Berlin, Germany (JEK, SMH, RHJMK).
2
AG Progress Test Medizin, Charité Medical School, Berlin, Germany (JEK).
3
Department of Emergency Medicine, Inselspital, University Hospital Bern, Bern, Switzerland (WEH).
4
German Institute for International Educational Research, Centre for International Student Assessment, Frankfurt am Main, Germany (OK-H).

Abstract

BACKGROUND:

Evidence suggests that pooling multiple independent diagnoses can improve diagnostic accuracy in well-defined tasks. We investigated whether this is also the case for diagnostics in emergency medicine, an ill-defined task environment where diagnostic errors are rife.

METHODS:

A computer simulation study was conducted based on empirical data from 2 published experimental studies. In the computer experiments, 285 medical students independently diagnosed 6 simulated patients arriving at the emergency room with dyspnea. Participants' diagnoses (n = 1,710), confidence ratings, and expertise levels were entered into a computer simulation. Virtual groups of different sizes were randomly created, and 3 collective intelligence rules (follow-the-plurality rule, follow-the-most-confident rule, and follow-the-most-senior rule) were applied to combine the independent decisions into a final diagnosis. For different group sizes, the performance levels (i.e., percentage of correct diagnoses) of the 3 collective intelligence rules were compared with each other and against the average individual accuracy.

RESULTS:

For all collective intelligence rules, combining independent decisions substantially increased performance relative to average individual performance. For groups of 4 or fewer, the follow-the-most-confident rule outperformed the other rules; for larger groups, the follow-the-plurality rule performed best. For example, combining 5 independent decisions using the follow-the-plurality rule increased diagnostic accuracy by 22 percentage points. These results were robust across case difficulty and expertise level. Limitations of the study include the use of simulated patients diagnosed by medical students. Whether results generalize to clinical practice is currently unknown.

CONCLUSION:

Combining independent decisions may substantially improve the quality of diagnoses in emergency medicine and may thus enhance patient safety.

KEYWORDS:

collective intelligence; emergency medicine; follow-the-plurality rule; medical diagnostics; simulation; wisdom of crowds

PMID:
28355975
DOI:
10.1177/0272989X17696998
[Indexed for MEDLINE]

Supplemental Content

Full text links

Icon for Atypon
Loading ...
Support Center