pmc logo image
Logo of jeabehavJournal of the Experimental Analysis of Behavior Web SiteSubscriber LoginJournal of Applied Behavior Analysis Web SiteSubscription InformationInformation for AuthorsJournal of the Experimental Analysis of Behavior Web SiteJournal of the Experimental Analysis of Behavior Web Site

Formats:

J Exp Anal Behav. 1962 October; 5(4 Suppl): 543–597.
doi: 10.1901/jeab.1962.5-s543.
PMCID: PMC1404082
A Review of Positive Conditioned Reinforcement1
Roger T. Kelleher and Lewis R. Gollub
1Preparation of this review by the first author was supported in part by Research Grants M-2094 and MY-2645 from the Institute of Mental Health of the National Institutes of Health, U.S. Public Health Service. Preparation of this review by the second author was supported in part by NSF Grant G-8621, by a grant from the General Research Board of the University of Maryland, and by Research Grant MY 1604, National Institutes of Health, U.S. Public Health Service. The authors are indebted to Dr. W. H. Morse for his criticism of an earlier draft of this paper, and to Mrs. Marion Stauffer, Mrs. Lillian Stickle, and Miss Sandra Schneiderman for their help in preparation of the manuscript.
Abstract
This review critically analyzes experimental data relevant to the concept of conditioned reinforcement. The review has five sections. Section I is a discussion of the relationship between primary and conditioned reinforcement in terms of chains of stimuli and responses. Section II is a detailed analysis of the conditions in which the component stimuli in chained schedules of reinforcement will become conditioned reinforcers; this section also analyzes studies of token reinforcement, observing responses, switching responses, implicit chained schedules, and higher-order conditioning. Section III analyzes experiments in which potential conditioned reinforcers are used either to prolong responding or to generate responding during experimental extinction. This section discusses hypotheses that have been offered as alternatives to the concept of conditioned reinforcement and hypotheses concerning the necessary and sufficient conditions for establishing a conditioned reinforcer. Section IV discusses other variables that act when a conditioned reinforcer is being established or that act when an established conditioned reinforcer is used to develop or maintain behavior. Section V is a general discussion of conditioned reinforcement.
The evidence indicates that the conditioned reinforcing effectiveness of a stimulus is directly related to the frequency of primary reinforcement occurring in its presence, but is independent of the response rate or response pattern occurring in its presence. Results from chained schedules comprised of several components indicate that a stimulus can be established as a conditioned reinforcer by pairing it with an already established conditioned reinforcer rather than a primary reinforcer; however, this type of higher-order conditioning has not been clearly demonstrated with respondent conditioning procedures.
Although discriminative stimuli are usually conditioned reinforcers, the available evidence indicates that establishing a stimulus as a discriminative stimulus is not necessary or sufficient for establishing it as a conditioned reinforcer. Discriminative stimuli in chained schedules with several components are not always conditioned reinforcers; stimuli that are simply paired with reinforcers can become conditioned reinforcers.
The hypotheses that have been offered as alternatives to the concept of conditioned reinforcement are too limited to integrate the data that exist. The concepts of conditioned reinforcement and chained schedule, however, can be used to integrate the data obtained with diverse techniques. Recent experiments have revealed several techniques for the development of effective conditioned reinforcers. These techniques provide a powerful tool for advancing understanding of conditioned reinforcement and for extending control over behavior.
Full text
Full text is available as a scanned copy of the original print version. Get a printable copy (PDF file) of the complete article (8.3M), or click on a page image below to browse page by page. Links to PubMed are also available for Selected References.
Selected References
These references are in PubMed. This may not be the complete list of references from this article.
  • BERSH PJ. The influence of two variables upon the establishment of a secondary reinforcer for operant responses. J Exp Psychol. 1951 Jan;41(1):62–73. [PubMed]
  • BITTERMAN ME, FEDDERSEN WE, TYLER DW. Secondary reinforcement and the discrimination hypothesis. Am J Psychol. 1953 Jul;66(3):456–464. [PubMed]
  • BUTTER CM, THOMAS DR. Secondary reinforcement as a function of the amount of primary reinforcement. J Comp Physiol Psychol. 1958 Jun;51(3):346–348. [PubMed]
  • CARLTON PL, MARKS RA. Cold exposure and heat reinforced operant behavior. Science. 1958 Nov 28;128(3335):1344–1344. [PubMed]
  • COATE WB. Weakening of conditioned bar-pressing by prior extinction of its subsequent discriminated operant. J Comp Physiol Psychol. 1956 Apr;49(2):135–138. [PubMed]
  • COPPOCK HW, CHAMBERS RM. Reinforcement of position preference by automatic intravenous injections of glucose. J Comp Physiol Psychol. 1954 Oct;47(5):355–357. [PubMed]
  • D'AMATO MR. Secondary reinforcement and magnitude of primary reinforcement. J Comp Physiol Psychol. 1955 Oct;48(5):378–380. [PubMed]
  • D'AMATO MR, LACHMAN R, KIVY P. Secondary reinforcement as affected by reward schedule and the testing situation. J Comp Physiol Psychol. 1958 Dec;51(6):737–741. [PubMed]
  • DINSMOOR JA. A quantitative comparison of the discriminative and reinforcing functions of a stimulus. J Exp Psychol. 1950 Aug;40(4):458–472. [PubMed]
  • DINSMOOR JA. Resistance to extinction following periodic reinforcement in the presence of a discriminative stimulus. J Comp Physiol Psychol. 1952 Feb;45(1):31–35. [PubMed]
  • ELAM CB, TYLER DW, BITTERMAN ME. A further study of secondary reinforcement and the discrimination hypothesis. J Comp Physiol Psychol. 1954 Oct;47(5):381–384. [PubMed]
  • FERSTER CB. Sustained behavior under delayed reinforcement. J Exp Psychol. 1953 Apr;45(4):218–224. [PubMed]
  • Ferster CB. Intermittent Reinforcement of a Complex Response in a Chimpanzee. J Exp Anal Behav. 1958 Apr;1(2):163–165. [PubMed]
  • FERSTER CB, DEMYER MK. A method for the experimental analysis of the behavior of autistic children. Am J Orthopsychiatry. 1962 Jan;32:89–98. [PubMed]
  • Findley JD. Preference and Switching under Concurrent Scheduling. J Exp Anal Behav. 1958 Apr;1(2):123–144. [PubMed]
  • FINDLEY JD. An experimental outline for building and exploring multi-operant behavior repertoires. J Exp Anal Behav. 1962 Jan;5(Suppl):113–166. [PubMed]
  • FOX RE, KING RA. The effects of reinforcement scheduling on the strength of a secondary reinforcer. J Comp Physiol Psychol. 1961 Jun;54:266–269. [PubMed]
  • GRICE GR, DAVIS JD. Effect of irrelevant thirst motivation on a response learned with food reward. J Exp Psychol. 1957 May;53(5):347–352. [PubMed]
  • GUTTMAN N. Operant conditioning, extinction, and periodic reinforcement in relation to concentration of sucrose used as reinforcing agent. J Exp Psychol. 1953 Oct;46(4):213–224. [PubMed]
  • HALL JF. Studies in secondary reinforcement: I. Secondary reinforcement as a function of the frequency of primary reinforcement. J Comp Physiol Psychol. 1951 Jun;44(3):246–251. [PubMed]
  • HANSON HM, WITOSLAWSKI JJ. Interaction between the components of a chained schedule. J Exp Anal Behav. 1959 Apr;2:171–177. [PubMed]
  • HOLZ WC, AZRIN NH. Discriminative properties of punishment. J Exp Anal Behav. 1961 Jul;4:225–232. [PubMed]
  • HOPKINS CO. Effectiveness of secondary reinforcing stimuli as a function of the quantity and quality of food reinforcement. J Exp Psychol. 1955 Nov;50(5):339–342. [PubMed]
  • HULL CL, LIVINGSTON JR, ROUSE RO, BARKER AN. True, sham, and esophageal feeding as reinforcements. J Comp Physiol Psychol. 1951 Jun;44(3):236–245. [PubMed]
  • JENKINS WO. A temporal gradient of derived reinforcement. Am J Psychol. 1950 Apr;63(2):237–243. [PubMed]
  • Kelleher Roger T. Intermittent Conditioned Reinforcement in Chimpanzees. Science. 1956 Oct 12;124(3224):679–680. [PubMed]
  • KELLEHER RT. Conditioned reinforcement in chimpanzees. J Comp Physiol Psychol. 1957 Dec;50(6):571–575. [PubMed]
  • KELLEHER RT. Stimulus-producing responses in chimpanzees. J Exp Anal Behav. 1958 Jan;1:87–102. [PubMed]
  • Kelleher RT. Fixed-ratio schedules of conditioned reinforcement with chimpanzees. J Exp Anal Behav. 1958 Aug;1(3):281–289. [PubMed]
  • KELLEHER RT. Schedules of conditioned reinforcement during experimental extinction. J Exp Anal Behav. 1961 Jan;4:1–5. [PubMed]
  • KELLEHER RT, FRY WT. Stimulus functions in chained fixed-interval schedules. J Exp Anal Behav. 1962 Apr;5:167–173. [PubMed]
  • LAWSON R. Amount of primary reward and strength of secondary reward. J Exp Psychol. 1953 Sep;46(3):183–187. [PubMed]
  • LAWSON R. Brightness discrimination performance and secondary reward strength as a function of primary reward amount. J Comp Physiol Psychol. 1957 Feb;50(1):35–39. [PubMed]
  • MCCLELLAND DC, MCGOWN DR. The effect of variable food reinforcement on the strength of a secondary reward. J Comp Physiol Psychol. 1953 Apr;46(2):80–86. [PubMed]
  • MASON DJ. The relation of secondary reinforcement to partial reinforcement. J Comp Physiol Psychol. 1957 Jun;50(3):264–268. [PubMed]
  • MILES RC. The relative effectiveness of secondary reinforcers throughout deprivation and habit-strength parameters. J Comp Physiol Psychol. 1956 Apr;49(2):126–130. [PubMed]
  • MYERS JL. Secondary reinforcement: a review of recent experimentation. Psychol Bull. 1958 Sep;55(5):284–301. [PubMed]
  • NAPALKOV AV. [Chains of motor conditioned reflexes in pigeons.]. Zh Vyssh Nerv Deiat Im I P Pavlova. 1959 Jul–Aug;9:615–621. [PubMed]
  • OLDS J, MILNER P. Positive reinforcement produced by electrical stimulation of septal area and other regions of rat brain. J Comp Physiol Psychol. 1954 Dec;47(6):419–427. [PubMed]
  • POWELL DR, Jr, PERKINS CC., Jr Strength of secondary reinforcement as a determiner of the effects of duration of goal response on learning. J Exp Psychol. 1957 Feb;53(2):106–112. [PubMed]
  • PREMACK D. Toward empirical behavior laws. I. positive reinforcement. Psychol Rev. 1959 Jul;66(4):219–233. [PubMed]
  • PROKASY WF., Jr The acquisition of observing responses in the absence of differential external reinforcement. J Comp Physiol Psychol. 1956 Apr;49(2):131–134. [PubMed]
  • RATNER SC. Effect of extinction of dipper-approaching on subsequent extinction of bar-pressing and dipper-approaching. J Comp Physiol Psychol. 1956 Dec;49(6):576–581. [PubMed]
  • RAZRAN G. A note on second-order conditioning and secondary reinforcement. Psychol Rev. 1955 Sep;62(5):327–332. [PubMed]
  • RAZRAN G. The observable unconscious and the inferable conscious in current Soviet psychophysiology: interoceptive conditioning, semantic conditioning, and the orienting reflex. Psychol Rev. 1961 Mar;68:1–147. [PubMed]
  • SHAPIRO MM. Respondent salivary conditioning during operant lever pressing in dogs. Science. 1960 Sep 2;132:619–620. [PubMed]
  • Skinner BF, Morse WH. Sustained performance during very long experimental sessions. J Exp Anal Behav. 1958 Aug;1(3):235–244. [PubMed]
  • STEIN L. Secondary reinforcement established with subcortical stimulation. Science. 1958 Feb 28;127(3296):466–467. [PubMed]
  • VERPLANCK WS, HAYES JR. Eating and drinking as a function of maintenance schedule. J Comp Physiol Psychol. 1953 Oct;46(5):327–333. [PubMed]
  • WEISS B. Thermal behavior of the sub-nourished and pantothenic-acid-deprived rat. J Comp Physiol Psychol. 1957 Oct;50(5):481–485. [PubMed]
  • WIKE EL, BARRIENTOS G. Secondary reinforcement and multiple drive reduction. J Comp Physiol Psychol. 1958 Oct;51(5):640–643. [PubMed]
  • WILSON MP, KELLER FS. On the selective reinforcement of spaced responses. J Comp Physiol Psychol. 1953 Jun;46(3):190–193. [PubMed]
  • WYCKOFF LB., Jr The role of observing responses in discrimination learning. Psychol Rev. 1952 Nov;59(6):431–442. [PubMed]
  • WYCKOFF LB. Toward a quantitative theory of secondary reinforcement. Psychol Rev. 1959 Jan;66(1):68–78. [PubMed]
  • WYCKOFF LB, SIDOWSKI J, CHAMBLISS DJ. An experimental study of the relationship between secondary reinforcing and cue effects of a stimulus. J Comp Physiol Psychol. 1958 Feb;51(1):103–109. [PubMed]
  • ZIMMERMAN DW. Durable secondary reinforcement: method and theory. Psychol Rev. 1957 Nov;64,(6):373–383. [PubMed]
  • ZIMMERMAN DW. Sustained performance in rats based on secondary reinforcement. J Comp Physiol Psychol. 1959 Jun;52(3):353–358. [PubMed]