Operant conditioning chamber
|This article needs additional citations for verification. (September 2010)|
An operant conditioning chamber (also known as the Skinner box) is a laboratory apparatus used in the experimental analysis of behavior to study animal behavior. The operant conditioning chamber was created by B. F. Skinner while he was a graduate student at Harvard University (studying for a master's degree in 1930 and a doctorate in 1931). It may have been inspired by Jerzy Konorski's studies. It is used to study both operant conditioning and classical conditioning.
An operant conditioning chamber permits experimenters to study behavior conditioning (training) by teaching a subject animal to perform certain actions (like pressing a lever) in response to specific stimuli, such as a light or sound signal. When the subject correctly performs the behavior, the chamber mechanism delivers food or another reward. In some cases, the mechanism delivers a punishment for incorrect or missing responses. For instance, to test how operant conditioning works for certain invertebrates, such as fruit flies, psychologists use a device known as a "heat box". Essentially this takes up the same form as the Skinner box, but the box is composed of two sides: one side that can undergo temperature change and the other that does not. As soon as the invertebrate crosses over to the side that can undergo a temperature change, the area is heated up. Eventually, the invertebrate will be conditioned to stay on one side of a heat box, or more specifically the side that does not undergo a temperature change. This goes to the extent that even when the temperature is turned to its lowest point, the fruit fly will still refrain from approaching that area of the heat box. These types of apparatuses allow experimenters to perform studies in conditioning and training through reward/punishment mechanisms.
The structure forming the shell of a chamber is a box large enough to easily accommodate the animal being used as a subject. (Commonly used model animals include rodents—usually lab rats—pigeons, and primates). It is often sound-proof and light-proof to avoid distracting stimuli.
Operant chambers have at least one operandum (or "manipulandum"), and often two or more, that can automatically detect the occurrence of a behavioral response or action. Typical operanda for primates and rats are response levers; if the subject presses the lever, the opposite end moves and closes a switch that is monitored by a computer or other programmed device. Typical operanda for pigeons and other birds are response keys with a switch that closes if the bird pecks at the key with sufficient force. The other minimal requirement of a conditioning chamber is that it has a means of delivering a primary reinforcer (a reward, such as food, etc.) or unconditioned stimulus like food (usually pellets) or water. It can also register the delivery of a conditioned reinforcer, such as an LED (see Jackson & Hackenberg 1996 in the Journal of the Experimental Analysis of Behavior for example) signal as a "token".
Despite such a simple configuration, one operandum and one feeder, it is possible to investigate many psychological phenomena. Modern operant conditioning chambers typically have many operanda, like many response levers, two or more feeders, and a variety of devices capable of generating many stimuli, including lights, sounds, music, figures, and drawings. Some configurations use an LCD panel for the computer generation of a variety of visual stimuli.
Some operant chambers can also have electrified nets or floors so that shocks can be given to the animals; or lights of different colors that give information about when the food is available. Although the use of shock is not unheard of, approval may be needed in some countries to avoid unnecessary harmful experimentation on animals.
Skinner's operant chamber allowed him to explore the rate of response as a dependent variable, as well as develop his theory of schedules of reinforcement. If the event increased the number of responses it is said to strengthen its responding and if it decreased the number of responses it weakens the responding. The first operant chambers were attached to cumulative records on drums producing characteristic pauses, scallops, and other lines. Operant conditioning chambers have become common in a variety of research disciplines including behavioral pharmacology, and whose results inform many disciplines outside of psychology such as behavioral economics.
Application to games
Skinner is noted to have said that he did not want to be an eponym. Further, he believed that Clark Hull and his Yale students coined the expression: Skinner stated he did not use the term himself, and went so far as to ask Howard Hunt to use "lever box" instead of "Skinner box" in a published document.
- R.Carlson, Neil (2009). Psychology-the science of behavior. U.S: Pearson Education Canada; 4th edition. p. 207. ISBN 978-0-205-64524-4.
- Schacter, Daniel L., Daniel T. Gilbert, and Daniel M. Wegner. "Chapter 7.9 B. F. Skinner: The Role of Reinforcement and Punishment" Psychology. ; Second Edition. N.p.: Worth, Incorporated, 2011.
- Hopson, J. (April 2001). "Behavioral game design". Gamasutra.
- Dennis Coon (2005). Psychology: A modular approach to mind and behavior. Thomson Wadsworth. pp. 278–279. ISBN 0-534-60593-1.
- Skinner, B. F. (1959). Cumulative record (1999 definitive ed.). Cambridge, MA: B.F. Skinner Foundation. p 620
- Skinner, B. F. (1983). A Matter of Consequences. New York, NY: Alfred A. Knopf, Inc. p 116, 164
|Wikimedia Commons has media related to Skinner boxes.|
- From Pavlov to Skinner Box - background and experiment