pmc logo image
Logo of jabaJournal of Applied Behavior Analysis Web SiteSubscriber LoginJournal of the Experimental Analysis of Behavior Web SiteSubscription InformationInformation for AuthorsJournal of Applied Behavior Analysis Web SiteJournal of Applied Behavior Analysis Web Site
Journal List > J Appl Behav Anal > v.10(1); Spring 1977

Formats:
J Appl Behav Anal. 1977 Spring; 10(1): 103–116.
doi: 10.1901/jaba.1977.10-103.
PMCID: PMC1311156
Copyright notice
Considerations in the choice of interobserver reliability estimates
Donald P. Hartmann1
University of Utah
1I wish to thank Irwin Altman, David Born, Eugene Garcia, Donna Gelfand, Gary Gregor, Emily Herbert, Charles Turner, and my graduate students for their critical reading of earlier drafts of this manuscript. Reprints may be obtained from the author, Department of Psychology, The University of Utah, Salt Lake City, Utah 84112.
Small right arrow pointing to: See commentary "Reviewer's comment: just because it's reliable doesn't mean that you can use it" on page 117.
 
Small right arrow pointing to: This article has been cited by other articles in PMC.
Abstract
Two types of interobserver reliability values may be needed in treatment studies in which observers constitute the primary data-acquisition system: trial reliability and the reliability of the composite unit or score which is subsequently analyzed, e.g., daily or weekly session totals. Two approaches to determining interobserver reliability are described: percentage agreement and “correlational” measures of reliability. The interpretation of these estimates, factors affecting their magnitude, and the advantages and limitations of each approach are presented.
Full text
Full text is available as a scanned copy of the original print version. Get a printable copy (PDF file) of the complete article (1.9M), or click on a page image below to browse page by page. Links to PubMed are also available for Selected References.
 
icon of scanned page 103
103
icon of scanned page 104
104
icon of scanned page 105
105
icon of scanned page 106
106
icon of scanned page 107
107
icon of scanned page 108
108
icon of scanned page 109
109
icon of scanned page 110
110
icon of scanned page 111
111
icon of scanned page 112
112
icon of scanned page 113
113
icon of scanned page 114
114
icon of scanned page 115
115
icon of scanned page 116
116
 
Selected References
These references are in PubMed. This may not be the complete list of references from this article.
  • Fleiss JL. Measuring agreement between two judges on the presence or absence of a trait. Biometrics. 1975 Sep;31(3):651–659. [PubMed]
  • Kazdin Alan E, Klock Joan. The effect of nonverbal teacher approval on student attentive behavior. J Appl Behav Anal. 1973 Winter;6(4):643–654. [PubMed]
  • Schmidt Gilbert W, Ulrich Roger E. Effects of group contingent events upon classroom noise. J Appl Behav Anal. 1969 Fall;2(3):171–179. [PubMed]
  • Wahler RG. Some structural aspects of deviant child behavior. J Appl Behav Anal. 1975 Spring;8(1):27–42. [PubMed]
Articles from Journal of Applied Behavior Analysis are provided here courtesy of
Society for the Experimental Analysis of Behavior

PubMed articles by these authors

Links