In behavioral psychology, stimulus control is a phenomenon that occurs when an organism behaves in one way in the presence of a given stimulus and another way in its absence. Any stimulus that modifies behavior in this manner is referred to as a discriminative stimulus. Stimulus control of behavior occurs when the performance of a particular behavior is controlled by the presence or absence of a discriminative stimulus. For example, the presence of a stop sign (a discriminative stimulus) at a traffic intersection increases the probability that "braking" behavior will occur.
Some theorists believe that all behavior is under some form of stimulus control. For example, in the analysis of B. F. Skinner, verbal behavior is a complicated assortment of behaviors with a variety of controlling stimuli.
The controlling effects of stimuli are seen in quite diverse situations and in many aspects of behavior. For example, a stimulus presented at one time may control responses emitted immediately or at a later time; two stimuli may control the same behavior; a single stimulus may trigger behavior A at one time and behavior B at another; a stimulus may control behavior only in the presence of another stimulus, and so on. These sorts of control are brought about by a variety of methods and they play a large role in systematic accounts of behavioral processes.
In simple, practical situations, for example if one were training a dog using operant conditioning, optimal stimulus control might be described as follows:
- The behavior occurs immediately when the discriminative stimulus is given.
- The behavior never occurs in the absence of the stimulus.
- The behavior never occurs in response to some other stimulus.
- No other behavior occurs in response to this stimulus.
Operant stimulus control is typically established by discrimination training. For example, to make a light control a pigeon's pecks on a button, reinforcement only occurs following a peck to the button. Over a series of trials the pecking response becomes more probable in the presence of the light and less probable in its absence, and the light is said to become an SD. Virtually any stimulus that the animal can perceive may become a discriminative stimulus, and many different schedules of reinforcement may be used to establish stimulus control. For example, a green light might be associated with a VR 10 schedule and a red light associated with a FI 20-sec schedule, in which case the green light will control a higher rate of response than the red light.
Procedures for generating generalization gradients in operant conditioning are similar to those for used in classical conditioning, as described above. An important early example is an experiment by Hanson (1959). First a group of pigeons was reinforced for pecking a disc illuminated by a light of 550 nm wavelength, and never reinforced otherwise. Reinforcement was then stopped, and a series of different wavelength lights was presented one at a time. The results were plotted as a generalization gradient, as in the tone generalization experiment described above. The more the wavelength differed from the trained stimulus, the fewer responses were produced.
Hanson's experiment went on to study the effects of discrimination training on the shape of the generalization gradient. Birds were reinforced for pecking at a 550 nm light, which looks yellowish-green to human observers. The birds were not reinforced when they saw a wavelength more toward the red end of the spectrum. Each of four groups saw a single unreinforced wavelength, either 555, 560, 570, or 590 nm, in addition to the reinforced 550 wavelength. The birds were then tested as before, with a range of unreinforced wavelengths. This procedure yielded sharper generalization gradients than did the simple generalization procedure used with the first group, a result like that seen in the classical conditioning case described above. In addition, however, Hansen's experiment showed a new phenomenon, called the "peak shift". That is, the peak of the test gradients shifted away from the SD, such that the birds responded more often to a wavelength they had never seen before than to the reinforced SD. An earlier theory involving inhibitory and excitatory gradients partially explained the results, A more detailed quantitative model of the effect was proposed by Blough (1975). Other theories have been proposed, including the idea that the peak shift is an example of relational control; that is, the discrimination was perceived as a choice between the "greener" of two stimuli, and when a still greener stimulus was offered the pigeons responded even more rapidly to that than to the originally reinforced stimulus.
Matching to sample
In a typical matching-to-sample task, a stimulus is presented in one location (the "sample"), and the subject chooses a stimulus in another location that matches the sample in some way (e.g., shape or color). In the related "oddity" matching procedure, the subject responds to a comparison stimulus that does not match the sample. These are called "conditional" discrimination tasks because which stimulus is responded to depends or is "conditional" on the sample stimulus.
The matching-to-sample procedure has been used to study a very wide range of problems. Of particular note is the "delayed matching to sample" variation, which has often been used to study short-term memory in animals. In this variation, the subject is exposed to the sample stimulus, and then the sample is removed and a time interval, the "delay", elapses before the choice stimuli appear. To make a correct choice the subject has to retain information about the sample across the delay. The length of the delay, the nature of the stimuli, events during the delay, and many other factors have been found to influence performance on this task.
- Behavior therapy
- Motivating operation
- Quantitative analysis of behavior
- Signal detection
- Baum, William M. (2005). Understanding behaviorism : Behavior, culture, and evolution. (2. ed.). Malden, MA: Blackwell Pub. ISBN 140511262X.
- Skinner, Burrhus Frederick (1957). Verbal Behavior. Acton, MA: Copley Publishing Group. ISBN 1-58390-021-7
- Skinner, B.F. (1992). Verbal behavior. Acton, Mass.: Copley. ISBN 1583900217.
- Catania, A. C. "Learning" 3rd ed, 1992, Prentice Hall, Englewoood Cliffs, NJ.
- Pryor, Karen (2002). Don't Shoot the Dog!. City: Ringpress Books Ltd. ISBN 1-86054-238-7.
- Watanabe, S; Sakamoto, K.; Wakita, M. (1994). "Pigeons’ discrimination of paintings by Monet and Picasso". Journal of the Experimental Analysis of Behavior. 63 (2): 165–174. PMC . PMID 16812755. doi:10.1901/jeab.1995.63-165.
- Hanson, H. M. (1959). "Effects of discrimination training on stimulus generalization". Journal of Experimental Psychology. 58: 321–334. doi:10.1037/h0042606.
- Spence, K. W. (1937). "The differential response in animals to stimuli varying in a single dimension". Psychological Review. 44: 430–444. doi:10.1037/h0062885.
- Blough, D. S. "Steady state data and a quantitative model of operant generalization and discrimination" Journal of Experimental Psychology: Animal Behavior Process, 1975, 104, 3-21.)
- Rachlin, Howard (1991). Introduction to modern behaviorism (3rd ed.). New York: W.H. Freeman. ISBN 0716721767.
- Blough, D. S. "Delayed matching in the pigeon" Journal of the Experimental Analysis of Behavior, 1959, 2, 151-160
- Bouton, M. E. "Learning and Behavior: A Contemporary Synthesis" (second edition) Sunderland MA: Sinauer
- Mazur, J. E. (2006). Learning and behavior. 6th edition. Upper Saddle River, NJ: Prentice Hall.
- Nevin, J. A. (1965). "Decision theory in studies of discrimination in animals". Science. 150 (3699): 1057. doi:10.1126/science.150.3699.1057.
- Nevin, J. A. (1969). "Signal detection theory and operant behavior". Journal of the Experimental Analysis of Behavior. 12: 475–480. doi:10.1901/jeab.1969.12-475.
- Staddon, J. E. R. (2001). Adaptive dynamics – The theoretical analysis of behavior. The MIT Press. London, England.
- Staddon, J. E. R. (2003). Adaptive behavior and learning. New York: Cambridge University Press. Second (internet) edition:
- Adaptive Behavior and Learning