pmc logo image
Logo of jeabehavJournal of the Experimental Analysis of Behavior Web SiteSubscriber LoginJournal of Applied Behavior Analysis Web SiteSubscription InformationInformation for AuthorsJournal of the Experimental Analysis of Behavior Web SiteJournal of the Experimental Analysis of Behavior Web Site

Formats:

J Exp Anal Behav. 1968 May; 11(3 Pt 2 Suppl): 327–383.
doi: 10.1901/jeab.1968.11-s327.
PMCID: PMC1338497
A quantitative analysis of the responding maintained by interval schedules of reinforcement1
A. Charles Catania and G. S. Reynolds
1This research was supported by NSF Grants G8621 and G18167 (B. F. Skinner, Principal Investigator) to Harvard University, and was conducted at the Harvard Psychological Laboratories. Some of the material has been presented at the 1961 and 1963 meetings of the Psychonomic Society. The authors' thanks go to Mrs. Antoinette C. Papp and Mr. Wallace R. Brown, Jr., for care of pigeons and assistance in the daily conduct of the experiments, and to Mrs. Geraldine Hansen for typing several revisions of the manuscript. We are indebted to many colleagues, and in particular to N. H. Azrin, who maintained responsibility for the manuscript well beyond the expiration of his editorial term, and to D. G. Anger, L. R. Gollub, and S. S. Pliskoff. Some expenses of preparation of the manuscript were defrayed by NSF Grant GB 3614 (to New York University), by NSF Grants GB 316 and GB 2541 (to the University of Chicago), and by the Smith Kline and French Laboratories. Expenses of publication were defrayed by NIH Grant MH 13613 (to New York University) and NSF Grants GB 5064 and GB 6821 (to the University of California, San Diego). Reprints may be obtained from A. C. Catania, Department of Psychology, New York University, University College of Arts and Sciences, New York, N.Y. 10453.
Abstract
Interval schedules of reinforcement maintained pigeons' key-pecking in six experiments. Each schedule was specified in terms of mean interval, which determined the maximum rate of reinforcement possible, and distribution of intervals, which ranged from many-valued (variable-interval) to single-valued (fixed-interval). In Exp. 1, the relative durations of a sequence of intervals from an arithmetic progression were held constant while the mean interval was varied. Rate of responding was a monotonically increasing, negatively accelerated function of rate of reinforcement over a range from 8.4 to 300 reinforcements per hour. The rate of responding also increased as time passed within the individual intervals of a given schedule. In Exp. 2 and 3, several variable-interval schedules made up of different sequences of intervals were examined. In each schedule, the rate of responding at a particular time within an interval was shown to depend at least in part on the local rate of reinforcement at that time, derived from a measure of the probability of reinforcement at that time and the proximity of potential reinforcements at other times. The functional relationship between rate of responding and rate of reinforcement at different times within the intervals of a single schedule was similar to that obtained across different schedules in Exp. 1. Experiments 4, 5, and 6 examined fixed-interval and two-valued (mixed fixed-interval fixed-interval) schedules, and demonstrated that reinforcement at one time in an interval had substantial effects on responding maintained at other times. It was concluded that the rate of responding maintained by a given interval schedule depends not on the overall rate of reinforcement provided but rather on the summation of different local effects of reinforcement at different times within intervals.
Full text
Full text is available as a scanned copy of the original print version. Get a printable copy (PDF file) of the complete article (7.6M), or click on a page image below to browse page by page. Links to PubMed are also available for Selected References.
Selected References
These references are in PubMed. This may not be the complete list of references from this article.
  • ANGER D. The dependence of interresponse times upon the relative reinforcement of different interresponse times. J Exp Psychol. 1956 Sep;52(3):145–161. [PubMed]
  • Blough DS. The reinforcement of least-frequent interresponse times. J Exp Anal Behav. 1966 Sep;9(5):581–591. [PubMed]
  • CATANIA AC. Concurrent performances: reinforcement interaction and response independence. J Exp Anal Behav. 1963 Apr;6:253–263. [PubMed]
  • CATANIA AC. Concurrent performances: a baseline for the study of reinforcement magnitude. J Exp Anal Behav. 1963 Apr;6:299–300. [PubMed]
  • Clark FC. The effect of deprivation and frequency of reinforcement on variable-interval responding. J Exp Anal Behav. 1958 Aug;1(3):221–228. [PubMed]
  • Clark R. Some time-correlated reinforcement schedules and their effects on behavior. J Exp Anal Behav. 1959 Jan;2(1):1–22. [PubMed]
  • Cumming WW, Schoenfeld WN. Behavior under extended exposure to a high-value fixed interval reinforcement schedule. J Exp Anal Behav. 1958 Aug;1(3):245–263. [PubMed]
  • DEWS PB. Free-operant behavior under conditions of delayed reinforcement. I. CRF-type schedules. J Exp Anal Behav. 1960 Jul;3:221–234. [PubMed]
  • DEWS PB. The effect of multiple S delta periods on responding on a fixed-interval schedule. J Exp Anal Behav. 1962 Jul;5:369–374. [PubMed]
  • FARMER J. PROPERTIES OF BEHAVIOR UNDER RANDOM INTERVAL REINFORCEMENT SCHEDULES. J Exp Anal Behav. 1963 Oct;6:607–616. [PubMed]
  • Findley JD. Preference and Switching under Concurrent Scheduling. J Exp Anal Behav. 1958 Apr;1(2):123–144. [PubMed]
  • FINDLEY JD. An experimental outline for building and exploring multi-operant behavior repertoires. J Exp Anal Behav. 1962 Jan;5(Suppl):113–166. [PubMed]
  • FLESHLER M, HOFFMAN HS. A progression for generating variable-interval schedules. J Exp Anal Behav. 1962 Oct;5:529–530. [PubMed]
  • GOLLUB LR. THE RELATIONS AMONG MEASURES OF PERFORMANCE ON FIXED-INTERVAL SCHEDULES. J Exp Anal Behav. 1964 Sep;7:337–343. [PubMed]
  • HEARST E. The behavioral effects of some temporally defined schedules of reinforcement. J Exp Anal Behav. 1958 Jan;1:45–55. [PubMed]
  • HERRNSTEIN RJ. Relative and absolute strength of response as a function of frequency of reinforcement. J Exp Anal Behav. 1961 Jul;4:267–272. [PubMed]
  • HERRNSTEIN RJ. SECONDARY REINFORCEMENT AND RATE OF PRIMARY REINFORCEMENT. J Exp Anal Behav. 1964 Jan;7:27–36. [PubMed]
  • KAPLAN M. The effects of noxious stimulus intensity and duration during intermittent reinforcement of escape behavior. J Comp Physiol Psychol. 1952 Dec;45(6):538–549. [PubMed]
  • KELLEHER RT, GOLLUB LR. A review of positive conditioned reinforcement. J Exp Anal Behav. 1962 Oct;5:543–597. [PubMed]
  • Malott RW, Cumming WW. Concurrent schedules of interresponse time reinforcement: probability of reinforcement and the lower bounds of the reinforced interresponse time intervals. J Exp Anal Behav. 1966 Jul;9(4):317–325. [PubMed]
  • MILLENSON JR. Some behavioral effects of a two-valued, temporally defined reinforcement schedule. J Exp Anal Behav. 1959 Jul;2:191–202. [PubMed]
  • Millenson JR. Random interval schedules of reinforcement. J Exp Anal Behav. 1963 Jul;6(3):437–443. [PubMed]
  • Millenson JR. Probability of response and probability of reinforcement in a response-defined analogue of an interval schedule. J Exp Anal Behav. 1966 Mar;9(2):87–94. [PubMed]
  • Neuringer Allen J, Chung Shin-Ho. Quasi-reinforcement: control of responding by a percentage-reinforcement schedule. J Exp Anal Behav. 1967 Jan;10(1):45–54. [PubMed]
  • NEVIN JA. TWO PARAMETERS OF CONDITIONED REINFORCEMENT IN A CHAINING SITUATION. J Comp Physiol Psychol. 1964 Dec;58:367–373. [PubMed]
  • REYNOLDS GS. Relativity of response rate and reinforcement frequency in a multiple schedule. J Exp Anal Behav. 1961 Apr;4:179–184. [PubMed]
  • REYNOLDS GS. Some limitations on behavioral contrast and induction during successive discrimination. J Exp Anal Behav. 1963 Jan;6:131–139. [PubMed]
  • Reynolds GS. Discrimination and emission of temporal intervals by pigeons. J Exp Anal Behav. 1966 Jan;9(1):65–68. [PubMed]
  • REYNOLDS GS, CATANIA AC. Temporal discrimination in pigeons. Science. 1962 Jan 26;135:314–315. [PubMed]
  • Schoenfeld WN, Cumming WW. STUDIES IN A TEMPORAL CLASSIFICATION OF REINFORCEMENT SCHEDULES: SUMMARY AND PROJECTION. Proc Natl Acad Sci U S A. 1960 May;46(5):753–758. [PubMed]
  • Schoenfeld WN, Cumming WW, Hearst E. ON THE CLASSIFICATION OF REINFORCEMENT SCHEDULES. Proc Natl Acad Sci U S A. 1956 Aug;42(8):563–570. [PubMed]
  • Shimp CP. The reinforcement of short interresponse times. J Exp Anal Behav. 1967 Sep;10(5):425–434. [PubMed]
  • STADDON JE. SOME PROPERTIES OF SPACED RESPONDING IN PIGEONS. J Exp Anal Behav. 1965 Jan;8:19–27. [PubMed]
  • Staddon JE. Attention and temporal discrimination: factors controlling responding under a cyclic-interval schedule. J Exp Anal Behav. 1967 Jul;10(4):349–359. [PubMed]
  • Stubbs A. The discrimination of stimulus duration by pigeons. J Exp Anal Behav. 1968 May;11(3):223–238. [PubMed]
  • WEISS B, LATIES VG. DRUG EFFECTS ON THE TEMPORAL PATTERNING OF BEHAVIOR. Fed Proc. 1964 Jul–Aug;23:801–807. [PubMed]
  • WEISS B, MOORE EW. Drive level as a factor in distribution of responses in fixed-interval reinforcement. J Exp Psychol. 1956 Aug;52(2):82–84. [PubMed]
  • WILSON MP. Periodic reinforcement interval and number of periodic reinforcements as parameters of response strength. J Comp Physiol Psychol. 1954 Feb;47(1):51–56. [PubMed]