Stimulus control

Stimulus control is the phenomenon of a stimulus increasing the probability of a behavior (operant response) because of a history of that behavior being differentially reinforced in the presence of the stimulus. In other words, stimulus control is basically learning to pay attention to things that we identify in the environment (discriminative stimuli) that give us information about the effectiveness of our behavior: what behavior is likely to be effective or ineffective, under which conditions, and what the behavior gives us (reinforcement or punishment). Therefore, in the presence of those stimuli we are likely to respond differentially.

Imagine the following experiment. A pigeon is trained to peck an unlit left key in order to obtain food (reinforcer). After the animal learns this simple task, a right key is lit. Because the right key gives little information to the pigeon, after some time it is ignored. But what would happen if we changed the procedure, turning the light on and off, and giving food to the pigeon only when it pecks the left key when the right key is lit? Under these conditions, the pigeon starts to peck the left key when the right key is lit, and not when it is dark. Thus, we can say that the pigeon starts to respond differently in the presence of these two stimuli (right key lit or dark). That is, the discriminative stimulus is controlling the pigeon’s behavior. In this context, control does not mean that the pigeon has no choice; it only refers to the probability of responding in the presence of the discriminative stimulus (lit right key).

The opposite of discrimination, in which a subject learns to respond to one stimulus and not to another stimulus (e.g. the pigeon responds when the right key is lit and not when it is dark), is generalization. After behaving in a certain way in the presence of one stimulus, animals tend to behave similarly in the presence of a similar stimulus. That is, their behavior generalizes from one stimulus to another. For example, what would a pigeon do if, after being exposed to the procedure described above (i.e., after it learned to peck a left key only when a right key is lit), the intensity or wavelength of the light is changed? One way to try to answer to this question would be presenting five variations of the lit right key, each one presented for a relative brief period (e.g. 5 seconds), and measure the number of responses to the left key to each of the five color variations. The universal result – with pigeons, rats, fungi, monkeys, goldfish and people – is that response is highest to the original training stimulus (in this experiment, the initial key lighting plan), and decreases systematically as the physical difference between the training and the test stimuli increases.

In the quantitative analysis of behavior, stimulus control is examined from a number of perspectives, including Matching to Sample, and signal detection (Nevin, 1965; 1969).

Matching to sample

Matching-to-Sample is a form of conditional discrimination. In this form of conditional discrimination procedure, only one of two or more stimuli presented on other comparison keys from the sample, shares some property (e.g., shape). Responses to the similar stimulus are reinforced. In Oddity matching, a form of matching-to-sample, responses to the comparison stimulus that does not match the sample are reinforced.

Characteristics

Proper stimulus control is said to have four characteristics:

• The behavior occurs immediately when the conditioned stimulus is given.
• The behavior never occurs in the absence of the stimulus.
• The behavior never occurs in response to some other stimulus.
• No other behavior occurs in response to this stimulus.^[1]

See also

• Behavior therapy
• Behaviorism
• Signal detection
• Quantitative analysis of behavior
• Motivating operation

References

1. ^ Pryor, Karen (2002). Don't Shoot the Dog!. City: Ringpress Books Ltd. ISBN 1860542387. 

• Mazur, J. E. (2006). Learning and behavior. 6th edition. Upper Saddle River, NJ: Prentice Hall.
• Nevin, J. A. (1965). Decision theory in studies of discrimination in animals. Science, 150, 1057.
• Nevin, J. A. (1969). Signal detection theory and operant behavior. Journal of the Experimental Analysis of Behavior, 12, 475-480.
• Staddon, J. E. R. (2001). Adaptive dynamics – The theoretical analysis of behavior. The MIT Press. London, England.
• Staddon, J. E. R. (2003). Adaptive behavior and learning. New York: Cambridge University Press. Second (internet) edition:
• Adaptive Behavior and Learning