Format

Send to

Choose Destination
Behav Res Methods. 2017 Aug;49(4):1399-1406. doi: 10.3758/s13428-016-0796-z.

The ROC Toolbox: A toolbox for analyzing receiver-operating characteristics derived from confidence ratings.

Author information

1
Center for Vital Longevity, University of Texas at Dallas, Dallas, TX, USA. joshua.koen@utdallas.edu.
2
Department of Psychiatry and Behavioral Sciences, Johns Hopkins University School of Medicine, Baltimore, MD, USA.
3
Department of Psychology, University of California, Davis, CA, USA.
4
Center for Mind and Brain, University of California, Davis, CA, USA.

Abstract

Signal-detection theory, and the analysis of receiver-operating characteristics (ROCs), has played a critical role in the development of theories of episodic memory and perception. The purpose of the current paper is to present the ROC Toolbox. This toolbox is a set of functions written in the Matlab programming language that can be used to fit various common signal detection models to ROC data obtained from confidence rating experiments. The goals for developing the ROC Toolbox were to create a tool (1) that is easy to use and easy for researchers to implement with their own data, (2) that can flexibly define models based on varying study parameters, such as the number of response options (e.g., confidence ratings) and experimental conditions, and (3) that provides optimal routines (e.g., Maximum Likelihood estimation) to obtain parameter estimates and numerous goodness-of-fit measures.The ROC toolbox allows for various different confidence scales and currently includes the models commonly used in recognition memory and perception: (1) the unequal variance signal detection (UVSD) model, (2) the dual process signal detection (DPSD) model, and (3) the mixture signal detection (MSD) model. For each model fit to a given data set the ROC toolbox plots summary information about the best fitting model parameters and various goodness-of-fit measures. Here, we present an overview of the ROC Toolbox, illustrate how it can be used to input and analyse real data, and finish with a brief discussion on features that can be added to the toolbox.

KEYWORDS:

Memory; Open source software; Perception; Signal detection theory

PMID:
27573007
PMCID:
PMC5332475
DOI:
10.3758/s13428-016-0796-z
[Indexed for MEDLINE]
Free PMC Article

Supplemental Content

Full text links

Icon for Springer Icon for PubMed Central
Loading ...
Support Center