pmc logo image
Logo of jabaJournal of Applied Behavior Analysis Web SiteSubscriber LoginJournal of the Experimental Analysis of Behavior Web SiteSubscription InformationInformation for AuthorsJournal of Applied Behavior Analysis Web SiteJournal of Applied Behavior Analysis Web Site
Journal List > J Appl Behav Anal > v.11(4); Winter 1978

Formats:
J Appl Behav Anal. 1978 Winter; 11(4): 523–527.
doi: 10.1901/jaba.1978.11-523.
PMCID: PMC1311335
Copyright notice
A method for combining occurrence and nonoccurrence interobserver agreement scores
Francis C. Harris and Benjamin B. Lahey1
University of Georgia
1Reprints may be obtained from Benjamin B. Lahey, Psychology Clinic, Dept. of Psychology, University of Georgia, Athens, GA 30602.
Small right arrow pointing to: This article has been cited by other articles in PMC.
Abstract
Various statistics have been proposed as standard methods for calculating and reporting interobserver agreement scores. The advantages and disadvantages of each have been discussed in this journal recently but without resolution. A formula is presented that combines separate measures of occurrence and nonoccurrence percentages of agreement, with weight assigned to each measure, varying according to the observed rate of behavior. This formula, which is a modification of a formula proposed by Clement (1976), appears to reduce distortions due to “chance” agreement encountered with very high or low observed rates of behavior while maintaining the mathematical and conceptual simplicity of the conventional method for calculating occurrence and nonoccurrence agreement.
Full text
Full text is available as a scanned copy of the original print version. Get a printable copy (PDF file) of the complete article (715K), or click on a page image below to browse page by page. Links to PubMed are also available for Selected References.
 
icon of scanned page 523
523
icon of scanned page 524
524
icon of scanned page 525
525
icon of scanned page 526
526
icon of scanned page 527
527
 
Selected References
These references are in PubMed. This may not be the complete list of references from this article.
  • Baer Donald M. Reviewer's comment: just because it's reliable doesn't mean that you can use it. J Appl Behav Anal. 1977 Spring;10(1):117–119. [PubMed]
  • Hartmann Donald P. Considerations in the choice of interobserver reliability estimates. J Appl Behav Anal. 1977 Spring;10(1):103–116. [PubMed]
  • Hopkins BL, Hermann Jaime A. Evaluating interobserver reliability of interval data. J Appl Behav Anal. 1977 Spring;10(1):121–126. [PubMed]
  • Kelly Michael Bryan. A review of the observational data-collection and reliability procedures reported in The Journal of Applied Behavior Analysis. J Appl Behav Anal. 1977 Spring;10(1):97–101. [PubMed]
  • Kratochwill Thomas R, Wetzel Ralph J. Observer agreement, credibility, and judgment: some considerations in presenting observer agreement data. J Appl Behav Anal. 1977 Spring;10(1):133–139. [PubMed]
  • Yelton Ann R, Wildman Beth G, Erickson Marilyn T. A probability-based formula for calculating interobserver agreement. J Appl Behav Anal. 1977 Spring;10(1):127–131. [PubMed]
Articles from Journal of Applied Behavior Analysis are provided here courtesy of
Society for the Experimental Analysis of Behavior

PubMed articles by these authors

Links