Format

Send to

Choose Destination
Conscious Cogn. 2012 Mar;21(1):422-30. doi: 10.1016/j.concog.2011.09.021. Epub 2011 Nov 8.

A signal detection theoretic approach for estimating metacognitive sensitivity from confidence ratings.

Author information

1
Department of Psychology, Columbia University, New York, NY 10027, USA. brian@psych.columbia.edu

Abstract

How should we measure metacognitive ("type 2") sensitivity, i.e. the efficacy with which observers' confidence ratings discriminate between their own correct and incorrect stimulus classifications? We argue that currently available methods are inadequate because they are influenced by factors such as response bias and type 1 sensitivity (i.e. ability to distinguish stimuli). Extending the signal detection theory (SDT) approach of Galvin, Podd, Drga, and Whitmore (2003), we propose a method of measuring type 2 sensitivity that is free from these confounds. We call our measure meta-d', which reflects how much information, in signal-to-noise units, is available for metacognition. Applying this novel method in a 2-interval forced choice visual task, we found that subjects' metacognitive sensitivity was close to, but significantly below, optimality. We discuss the theoretical implications of these findings, as well as related computational issues of the method. We also provide free Matlab code for implementing the analysis.

PMID:
22071269
DOI:
10.1016/j.concog.2011.09.021
[Indexed for MEDLINE]

Supplemental Content

Full text links

Icon for Elsevier Science
Loading ...
Support Center