Wikia

Psychology Wiki

Extinction (learning)

Talk1
34,140pages on
this wiki

Assessment | Biopsychology | Comparative | Cognitive | Developmental | Language | Individual differences | Personality | Philosophy | Social |
Methods | Statistics | Clinical | Educational | Industrial | Professional items | World psychology |

Clinical: Approaches · Group therapy · Techniques · Types of problem · Areas of specialism · Taxonomies · Therapeutic issues · Modes of delivery · Model translation project · Personal experiences ·


This article is in need of attention from a psychologist/academic expert on the subject.
Please help recruit one, or improve this page yourself if you are qualified.
This banner appears on articles that are weak and whose contents should be approached with academic caution
.

Extinction in classical conditioningEdit

During the acquisition phase of Classical conditioning, a previously neutral stimulus (CS) is repeatedly paired with a naturally aversive stimulus (UCS) and the production of a conditioned response (CR) is taken as evidence of learning. Extinction in psychology refers to the repeated presentation of a conditioned stimulus (CS) without the Unconditioned Stimulus (UCS) used in the acquisition phase of the conditioning procedure. After a number of unpaired trials, the conditioned response (CR) (acquired in the acquisition phase) will be reduced. Complete extinction of a CR occurs only after there is no response to the CS+. The rate at which a subject is extinguished is determined by the rate of reinforcement Partial (< 100%) or continuous (100%) during conditioning.

Extinction in operant conditioningEdit

In operant conditioning paradigm, extinction refers to the decline of an operant response when it is no longer reinforced in the presence of its discriminative stimulus. Extinction is observed after withholding of reinforcement for a previously reinforced behavior which decreases the future probability of that behavior. For example, a child who climbs under his desk, a response which has been reinforced by attention, is subsequently ignored until the attention-seeking behavior no longer occurs. In his autobiography, B. F. Skinner noted how he accidentally discovered the extinction of an operant response due to the malfunction of his laboratory equipment:

My first extinction curve showed up by accident. A rat was pressing the lever in an experiment on satiation when the pellet dispenser jammed. I was not there at the time, and when I returned I found a beautiful curve. The rat had gone on pressing although no pellets were received.... The change was more orderly than the extinction of a salivary reflex in Pavlov’s setting, and I was terribly excited. It was a Friday afternoon and there was no one in the laboratory who I could tell. All that weekend I crossed streets with particular care and avoided all unnecessary risks to protect my discovery from loss through my accidental death.[1]

When the extinction of a response has occurred, the discriminative stimulus is then known as an extinction stimulus (SΔ or s delta). When an S delta is present, the reinforcing consequence which characteristically follows a behavior does not occur. This is the opposite of a discriminative stimulus which is a signal that reinforcement will occur. For instance, in an operant chamber, if food pellets are only delivered when a response is emitted in the presence of a green light, the green light is a discriminative stimulus. If when a red light is present food will not be delivered, then the red light is an extinction stimulus. (food here is used as an example of a reinforcer).


Successful Extinction ProceduresEdit

In order for extinction to work effectively, it must be done consitently. Extinction is considered successful when responding in the presence of an extinction stimulus (a red light or a teacher not giving a bad student attention, for instance) is zero. When a behavior reappers again after it has gone through extinction, it is called spontaneous recovery.

Fear conditioningEdit

Extinction is typically studied within the Pavlovian fear conditioning framework in which extinction refers to the reduction in a conditioned response (CR; e.g., fear response/freezing) when a conditioned stimulus (CS; e.g., neutral stimulus/light or tone) is repeatedly presented in the absence of the unconditioned stimulus (US; e.g., foot shock/loud noise) with which it has been previously paired.

The simplest explanation of extinction is that as the CS is presented without the aversive US, the animal gradually "unlearns" the CS-US association which is known as the associative loss theory. However, this explanation is complicated by observations where there is some fear restoration, such as reinstatement (restoration of CR in the context where extinction training occurred but not a different context after aversive US is presented again), renewal (restoration of CR in context A but not in B when learning occurred in context A and extinction in context B), and spontaneous recovery (restoration of CR when the retention test occurs after a long but not a short delay after extinction training) and alternative explanations have been offered.[2]

Research on fear extinction in animals models (typically rats) has clinical implications such as exposure-based therapies for the treatment of phobias and anxiety conditions.[2]


Extinction burstEdit

While extinction, when implemented consistently over time, results in the eventual decrease of the undesired behavior, in the near-term the subject might exhibit what is called an extinction burst. An extinction burst will often occur when the extinction procedure has just begun. This consists of a sudden and temporary increase in the response's frequency, followed by the eventual decline and extinction of the behavior targeted for elimination.

Take, as an example, a pigeon that has been reinforced to peck an electronic button. During its training history, every time the pigeon pecked the button, it will have received a small amount of bird seed as a reinforcer. So, whenever the bird is hungry, it will peck the button to receive food. However, if the button were to be turned off, the hungry pigeon will first try pecking the button just as it has in the past. When no food is forthcoming, the bird will likely try again... and again, and again. After a period of frantic activity, in which their pecking behavior yields no result, the pigeon's pecking will decrease in frequency.

The evolutionary advantage of this extinction burst is clear. In a natural environment, an animal that persists in a learned behavior, despite not resulting in immediate reinforcement, might still have a chance of producing reinforcing consequences if they try again. This animal would be at an advantage over another animal that gives up too easily.

Despite the name, however, not every explosive reaction to adverse stimuli subsides to extinction. Indeed a small minority of individuals persist in their reaction indefinitely.

Extinction-induced variabilityEdit

Extinction-induced variability serves an adaptive role similar to the extinction burst. When extinction begins, subjects can exhibit variations in response topography (the movements involved in the response). Response topography is always somewhat variable due to differences in environment or idiosyncratic causes but normally a subject's history of reinforcement keeps slight variations stable by maintaining successful variations over less successful variations. Extinction can increase these variations significantly as the subject attempts to acquire the reinforcement that previous behaviors produced. If a person attempts to open a door by turning the knob, but is unsuccessful, they may next try jiggling the knob, pushing on the frame, knocking on the door or other behaviors to get the door to open. Extinction-induced variability can be used in shaping to reduce problematic behaviors by reinforcing desirable behaviors produced by extinction-induced variability.

D-CycloserineEdit

D-Cycloserine (DCS) is being trialed as an adjuvant to conventional exposure-based treatments for anxiety disorders. The psychotropic responses are related to D-cycloserine's action as a partial agonist of the neuronal NMDA receptor for glutamate and have been examined in implications with sensory-related fear extinction in the amygdala.[2]


TheoriesEdit

The dominant account of extinction involves associative models. However, there is debate over whether extinction involves simply "unlearning" the US-CS association (e.g. the Rescorla-Wagner account) or alternatively whether a "new learning" of an inhibitory association that masks the original excitatory association (e.g. Konorski, Pearce and Hall account). A third account concerns non-associative mechanisms such as habituation, modulation and response fatigue. Myers and Davis laboratory work with fear extinction in rodents has suggested that multiple mechanisms may be at work depending on the timing and circumstances in which the extinction occurs.[2]

Given the competing views and difficult observations for the various accounts researchers have turned to investigations at the cellular level (most often in rodents) to tease apart the specific brain mechanisms of extinction in particular the role of the brain structures (amygdala, hippocampus, the prefontal cortex), and specific neurotransmitter systems (e.g. GABA, NMDA).[2] A recent study in rodents by Amano, Unal and Paré published in Nature Neuroscience found that extinction is correlated with synaptic inhibition in the fear output neurons of the central amygdala that project to the periaqueductal gray that controls freezing behavior. They infer that inhibition derives from the prefrontal cortex and suggest promising targets at the cellular for new treatments of anxiety.[3]


See alsoEdit

References & BibliographyEdit

  1. B. F. Skinner (1979). The Shaping of a Behaviorist: Part Two of an Autobiography, p. 95.
  2. 2.0 2.1 2.2 2.3 2.4 Myers & Davis (2007) Mechanisms of Fear Extinction. Molecular Psychiatry, 12, 120-150.
  3. Amano T, Unal CT, Paré D. (2010). Synaptic correlates of fear extinction in the amygdala. Nature Neuroscience 13:489-494 DOI:10.1038/nn.2499 PMID 20208529

Key textsEdit

BooksEdit

PapersEdit

Smith, R. C., & Bowles, S. (1971). A BIBLIOGRAPHY OF EXPERIMENTAL EXTINCTION. Psychological Reports, 29, 895–930.

Additional materialEdit

BooksEdit

PapersEdit

External linksEdit

Learning
Types of learning
Avoidance conditioning | Classical conditioning | Confidence-based learning | Discrimination learning | Emulation | Experiential learning | Escape conditioning | Incidental learning |Intentional learning | Latent learning | Maze learning | Mastery learning | Mnemonic learning | Nonassociative learning | Nonreversal shift learning | Nonsense syllable learning | Nonverbal learning | Observational learning | Omission training | Operant conditioning | Paired associate learning | Perceptual motor learning | Place conditioning | Probability learning | Rote learning | Reversal shift learning | Second-order conditioning | Sequential learning | Serial anticipation learning | Serial learning | Skill learning | Sidman avoidance conditioning | Social learning | Spatial learning | State dependent learning | Social learning theory | State-dependent learning | Trial and error learning | Verbal learning 
Concepts in learning theory
Chaining | Cognitive hypothesis testing | Conditioning | Conditioned responses | Conditioned stimulus | Conditioned suppression | Constant time delay | Counterconditioning | Covert conditioning | Counterconditioning | Delayed alternation | Delay reduction hypothesis | Discriminative response | Distributed practice |Extinction | Fast mapping | Gagné's hierarchy | Generalization (learning) | Generation effect (learning) | Habits | Habituation | Imitation (learning) | Implicit repetition | Interference (learning) | Interstimulus interval | Intermittent reinforcement | Latent inhibition | Learning schedules | Learning rate | Learning strategies | Massed practice | Modelling | Negative transfer | Overlearning | Practice | Premack principle | Preconditioning | Primacy effect | Primary reinforcement | Principles of learning | Prompting | Punishment | Recall (learning) | Recency effect | Recognition (learning) | Reconstruction (learning) | Reinforcement | Relearning | Rescorla-Wagner model | Response | Reinforcement | Secondary reinforcement | Sensitization | Serial position effect | Serial recall | Shaping | Stimulus | Reinforcement schedule | Spontaneous recovery | State dependent learning | Stimulus control | Stimulus generalization | Transfer of learning | Unconditioned responses | Unconditioned stimulus 
Animal learning
Cat learning | Dog learning  Rat learning 
Neuroanatomy of learning
Neurochemistry of learning
Adenylyl cyclase  
Learning in clinical settings
Applied Behavior Analysis | Behaviour therapy | Behaviour modification | Delay of gratification | CBT | Desensitization | Exposure Therapy | Exposure and response prevention | Flooding | Graded practice | Habituation | Learning disabilities | Reciprocal inhibition therapy | Systematic desensitization | Task analysis | Time out 
Learning in education
Adult learning | Cooperative learning | Constructionist learning | Experiential learning | Foreign language learning | Individualised instruction | Learning ability | Learning disabilities | Learning disorders | Learning Management | Learning styles | Learning theory (education) | Learning through play | School learning | Study habits 
Machine learning
Temporal difference learning | Q-learning 
Philosophical context of learning theory
Behaviourism | Connectionism | Constructivism | Functionalism | Logical positivism | Radical behaviourism 
Prominant workers in Learning Theory|-
Pavlov | Hull | Tolman | Skinner | Bandura | Thorndike | Skinner | Watson 
Miscellaneous|-
Category:Learning journals | Melioration theory 
edit


This page uses Creative Commons Licensed content from Wikipedia (view authors).

Around Wikia's network

Random Wiki