Predictive validity and efficiency of ongoing visual-inspection criteria for interpreting functional analyses

J Appl Behav Anal. 2018 Apr;51(2):303-320. doi: 10.1002/jaba.450. Epub 2018 Mar 12.

Abstract

Prior research has evaluated the reliability and validity of structured criteria for visually inspecting functional-analysis (FA) results on a post-hoc basis, after completion of the FA (i.e., post-hoc visual inspection [PHVI]; e.g., Hagopian et al., 1997). However, most behavior analysts inspect FAs using ongoing visual inspection (OVI) as the FA is implemented, and the validity of applying structured criteria during OVI remains unknown. In this investigation, we evaluated the predictive validity and efficiency of applying structured criteria on an ongoing basis by comparing the interim interpretations produced through OVI with (a) the final interpretations produced by PHVI, (b) the authors' post-hoc interpretations (PHAI) reported in the research studies, and (c) the consensus interpretations of these two post-hoc analyses. Ongoing visual inspection predicted the results of PHVI and the consensus interpretations with a very high degree of accuracy, and PHAI with a reasonably high degree of accuracy. Furthermore, the PHVI and PHAI results involved 32 FA sessions, on average, whereas the OVI required only 19 FA sessions to accurately identify the function(s) of destructive behavior (i.e., a 41% increase in efficiency). We discuss these findings relative to other methods designed to increase the accuracy and efficiency of FAs.

Keywords: data analysis; functional analysis; problem behavior; structured visual inspection; visual inspection.

Publication types

  • Research Support, N.I.H., Extramural

MeSH terms

  • Behavior Observation Techniques / standards*
  • Data Analysis*
  • Data Visualization*
  • Humans
  • Problem Behavior / psychology*
  • Reproducibility of Results