pmc logo image
Logo of jeabehavJournal of the Experimental Analysis of Behavior Web SiteSubscriber LoginJournal of Applied Behavior Analysis Web SiteSubscription InformationInformation for AuthorsJournal of the Experimental Analysis of Behavior Web SiteJournal of the Experimental Analysis of Behavior Web Site

Formats:

J Exp Anal Behav. 1963; 6(3 Pt 2 Suppl): 477–506.
doi: 10.1901/jeab.1963.6-s477.
PMCID: PMC1404084
THE ROLE OF TEMPORAL DISCRIMINATIONS IN THE REINFORCEMENT OF SIDMAN AVOIDANCE BEHAVIOR1
Douglas Anger
1The author is indebted to N. Azrin, E. Hearst, R. Herrnstein, W. Morse, W. Schoenfeld, and M. Sidman for valuable criticism of a preliminary draft of this paper. The author is also indebted to M. Sidman for permission to reproduce Figs. 5A, 5C, 6A, 7A, 7C, and 10, and for the opportunity to study unpublished data and records from some of the experiments discussed here. Reprints may be obtained from the author, Department of Pharmacology, The Upjohn Company, Kalamazoo, Michigan.
Abstract
Animals learn to avoid with the Sidman procedure even though the avoidance response is not followed by the termination of any warning stimulus in the environment. What reinforces this response? The accepted explanation has been that the avoidance response is reinforced when it terminates other behavior that has become aversive by pairing with shock. However, the reinforcement may also be derived from the temporal discriminations that develop with Sidman avoidance. These and other temporal discriminations show that the animal has available some events that vary with the postresponse time. The shock will closely follow the temporal stimuli at long postresponse times and would be expected to make them aversive. The stimuli at short postresponse times would have a relatively low aversiveness due to their more remote relation to shock. Since the avoidance response changes a long postresponse time to a short one, that response would be followed by a decrease in aversiveness which would reinforce it. When sharp temporal discriminations are present, reinforcement from the decrease in aversiveness of temporal stimuli probably plays a dominant role in maintaining the avoidance response. This formulation fits the available data and has adequate answers for the objections that have been raised to earlier conceptions of the role temporal discriminations might play in Sidman avoidance. Although under some conditions the reinforcement in Sidman avoidance seems to be primarily due to the decrease in aversiveness of temporal stimuli, under other conditions there probably is reinforcement from the termination of conditioned aversive responses.
Full text
Full text is available as a scanned copy of the original print version. Get a printable copy (PDF file) of the complete article (4.8M), or click on a page image below to browse page by page. Links to PubMed are also available for Selected References.
Selected References
These references are in PubMed. This may not be the complete list of references from this article.
  • ANGER D. The dependence of interresponse times upon the relative reinforcement of different interresponse times. J Exp Psychol. 1956 Sep;52(3):145–161. [PubMed]
  • BARLOW JA. Secondary motivation through classical conditioning: a reconsideration of the nature of backward conditioning. Psychol Rev. 1956 Nov;63(6):406–408. [PubMed]
  • BLOUGH DS. Delayed matching in the pigeon. J Exp Anal Behav. 1959 Apr;2:151–160. [PubMed]
  • BOREN JJ, SIDMAN M. Maintenance of avoidance behaviour with intermittent shocks. Can J Psychol. 1957 Sep;11(3):185–192. [PubMed]
  • BRUNER A, REVUSKY SH. Collateral behavior in humans. J Exp Anal Behav. 1961 Oct;4:349–350. [PubMed]
  • BRUSH FR, BRUSH ES, SOLOMON RL. Traumatic avoidance learning: the effects of CS-US interval with a delayed-conditioning procedure. J Comp Physiol Psychol. 1955 Aug;48(4):285–293. [PubMed]
  • DAVIS RC. Response patterns. Trans N Y Acad Sci. 1957 Jun;19(8):731–739. [PubMed]
  • DINSMOOR JA. Punishment. I. The avoidance hypothesis. Psychol Rev. 1954 Jan;61(1):34–46. [PubMed]
  • DINSMOOR JA. Variable-interval escape from stimuli accompanied by shocks. J Exp Anal Behav. 1962 Jan;5:41–47. [PubMed]
  • FERSTER CB. Sustained behavior under delayed reinforcement. J Exp Psychol. 1953 Apr;45(4):218–224. [PubMed]
  • KAMIN LJ. Traumatic avoidance learning: the effects of CS-US interval with a trace-conditioning procedure. J Comp Physiol Psychol. 1954 Feb;47(1):65–72. [PubMed]
  • KELLEHER RT, FRY W, COOK L. Inter-response time distribution as a function of differential reinforcement of temporally spaced responses. J Exp Anal Behav. 1959 Apr;2:91–106. [PubMed]
  • MARTIN B. The assessment of anxiety by physiological behavioral measures. Psychol Bull. 1961 May;58:234–255. [PubMed]
  • Mechner F. Probability Relations within Response Sequences under Ratio Reinforcement. J Exp Anal Behav. 1958 Apr;1(2):109–121. [PubMed]
  • MOWRER OH, KEEHN JD. How are intertrial avoidance responses reinforced? Psychol Rev. 1958 Jul;65(4):209–221. [PubMed]
  • SCHUSTER CR, ZIMMERMAN J. Timing behavior during prolonged treatment with dl-amphetamine. J Exp Anal Behav. 1961 Oct;4:327–330. [PubMed]
  • SIDMAN M. Avoidance conditioning with brief shock and no exteroceptive warning signal. Science. 1953 Aug 7;118(3058):157–158. [PubMed]
  • SIDMAN M. Two temporal parameters of the maintenance of avoidance behavior by the white rat. J Comp Physiol Psychol. 1953 Aug;46(4):253–261. [PubMed]
  • SIDMAN M. The temporal distribution of avoidance responses. J Comp Physiol Psychol. 1954 Oct;47(5):399–402. [PubMed]
  • SIDMAN M. Some properties of the warning stimulus in avoidance behavior. J Comp Physiol Psychol. 1955 Dec;48(6):444–450. [PubMed]
  • SIDMAN M. Drug-behavior interaction. Ann N Y Acad Sci. 1956 Nov 2;65(4):282–302. [PubMed]
  • Sidman M. Some Notes on "Bursts" in Free-operant Avoidance Experiments. J Exp Anal Behav. 1958 Apr;1(2):167–172. [PubMed]
  • Sidman M. By-products of aversive control. J Exp Anal Behav. 1958 Aug;1(3):265–280. [PubMed]
  • SIDMAN M. Reduction of shock frequency as reinforcement for avoidance behavior. J Exp Anal Behav. 1962 Apr;5:247–257. [PubMed]
  • SIDMAN M. An adjusting avoidance schedule. J Exp Anal Behav. 1962 Apr;5:271–277. [PubMed]
  • SIDMAN M, BOREN JJ. The use of shock-contingent variations in response-shock intervals for the maintenance of avoidance behavior. J Comp Physiol Psychol. 1957 Dec;50(6):558–562. [PubMed]
  • Stein L, Sidman M, Brady JV. Some effects of Two Temporal Variables on Conditioned Suppression. J Exp Anal Behav. 1958 Apr;1(2):153–162. [PubMed]
  • WILSON MP, KELLER FS. On the selective reinforcement of spaced responses. J Comp Physiol Psychol. 1953 Jun;46(3):190–193. [PubMed]