Methods | Statistics | Clinical | Educational | Industrial | Professional items | World psychology |
Biological: Behavioural genetics · Evolutionary psychology · Neuroanatomy · Neurochemistry · Neuroendocrinology · Neuroscience · Psychoneuroimmunology · Physiological Psychology · Psychopharmacology (Index, Outline)
- This article is about the self administration of rewards in animal studies. For its medical sense in humans see: self medication.
In animal experimentation, self-administration is a form of operant conditioning where the reward is a drug. This drug can be administered remotely through an implanted intravenous line or an intracerebroventricular injection. Self-administration of putatively addictive drugs is considered one of the most valid experimental models to investigate drug-seeking and drug-taking behavior. The higher the frequency with which a test animal emits the operant behavior, the more rewarding (and possibly addictive), the test substance is considered. Self-administration of addictive drugs has been studied using humans, non-human primates, mice., and, most commonly, rats.
Self-administration of heroin and cocaine is used to screen drugs for possible effects in reducing drug-taking behavior, especially reinstatement of drug seeking after extinction. Drugs with this effect may be useful for treating people with drug addiction by helping them establish abstinence or reducing their probability or relapsing to drug use after a period of abstinence.
In a prominent model of self-administration developed by George Koob, rats are allowed to self-administer cocaine for either 1 hour each day (short access) or 6 hours each day (long access). Those animals who are allowed to self-administer for 6 hours a day show behavior that is thought to resemble cocaine dependence, such as an escalation of the total dose taken during each session and an increase in the dose taken when cocaine is first made available.
The "self-administration" behavioral paradigm serves as an animal behavioral model of the human pathology of addiction. During the task, animal subjects are operant conditioned to perform one action, typically a lever press, in order to receive a drug. Reinforcement (through the use of the drug) occurs contingent upon the subject performing the desired behavior. Drug dosing in self-administration studies is response-dependent. This is an important element of creating a disease model of drug addiction in humans because response-independent drug administration is associated with increased toxicity and different neurobiological, neurochemical and behavioral effects. In summary, the effects of response-dependent drug dosing greatly differ from response-independent drug dosing and self-administration studies appropriately capture this distinction.
As far back as the mid 20th century, researchers have investigated animals’ drive to consume drugs of abuse in order to better understand human addictive processes. Spragg was one of the first researchers to create a model of chronic morphinism in a chimpanzee to explore the role of operant conditioning in relation to a drug dependency. When deprived of both food and morphine, chimpanzees would repeatedly attempt to seek out the drug of choice, even doing so much as to physically pull the experimenter into the room housing morphine and syringes. Weeks (1962) published an account of the first true use of the intravenous self-administration paradigm in a study aiming to model morphine addiction in unrestrained rats. For the first time, a drug of abuse served as an operant reinforcer and rats self-administered morphine to satiety in stereotyped response patterns.
The scientific community quickly adopted the self-administration paradigm as a behavioral means to examine addictive processes and adapted it to non-human primates. Thompson and Schuster (1964) studied the relative reinforcement properties of morphine in restrained Rhesus monkeys using intravenous self-administration. Significant changes in response to other types of reinforcers (i.e., food, shock avoidance) were observed in drug-dependent subjects. In 1969, Deneau, Yanagita and Seevers provided macaque monkeys free access to a variety of drugs of abuse for investigating whether nonhuman primates would voluntarily initiate self-administration of these substances. Initiation and maintenance of self-administration produced dependence and toxicity in monkeys, thereby more closely approximating important aspects of drug addiction in humans and allowing for the first of modern self-administration studies.
The procedure of testing the efficacy of a pharmacological agent as a reinforcer would soon become a standard assay. Most frequently, studies were performed in nonhuman primates to identify abuse potential, as required by the drug development process. In 1983, Collins et al. published a landmark paper in which rats were exposed to a battery of 27 psychoactive substances. The team compared test drug self-administration rates with saline vehicle self-administration rates. If animals self-administered at a rate significantly greater than vehicle, the drug was considered an active reinforcer with abuse potential. With few exceptions, the abuse liability observed in rats paralleled that observed from previous research in monkeys. In light of these similarities between the different animal models, it was identified that the abuse potential of psychoactive substances could be investigated using rats instead of nonhuman primates.
Operant conditioning represents the behavioral paradigm underlying self-administration studies. Subjects are trained to perform some action, such as a lever press, with the anticipation of receiving a reinforcer, such as food or water (under food- or water- restricted conditions, respectively). The reinforcer functions to increase the future probability of a response. Following this initial training, the reinforcer is replaced by a test drug to be administered by one of the following methods: oral, inhalation, intraperitoneal, intracerebral, intravenous. Intravenous catheterization is used most commonly because it maximizes bioavailability and has rapid onset. Additionally, humans suffering from addiction often resort to intravenous drug use for similar reasons, so this route of administration increases the face validity of the construct.
Upon presentation of the drug to the subject, a number of experimental variables might be manipulated to test hypotheses:
Both humans and animals will adjust the rate and number of drug infusions to maintain stable rewarding blood levels of drugs, like cocaine. A dilute dose of cocaine will be administered intravenously at a faster rate than a concentrated dose of cocaine.
Continuous Reinforcement: A single operant response triggers the dispense of a single dose of reinforcer, though this is true only in theory. A time-out period follows each operant response that successfully yields a dose of reinforcer; during this period, operant responses fail to produce drug administration allowing previous injections to take effect. Moreover, time-outs also help prevent subjects from overdosing during self-administration experiments. Fixed-Ratio studies require a predefined number of operant responses to dispense one unit of reinforcer. Standard Fixed Ratio reinforcement schedules include FR5 and FR10, requiring 5 and 10 operant responses to dispense a unit of reinforcer, respectively. Progressive Ratio reinforcement schedules utilize a multiplicative increase in the number of operant responses required to dispense a unit of reinforcer. For example, successive trials might require 5 operant responses per unit of reward, then 10 responses per unit of reward, then 15, and so on. The number of operant responses required per unit of reinforcer may be altered after each trial, each session, or any other time period as defined by the experimenter. Progressive ratio reinforcement schedules provide information about the extent to which a pharmacological agent reinforces through the breakpoint. The breakpoint is the number of operant responses at which the subject ceases engaging in self-administration, defined by some period of time between operant responses (generally up to an hour). Fixed Interval (FI) schedules require that a set amount of time pass between drug infusions, regardless of the number of times that the desired response is performed. This “refractory” period can prevent the animal from overdosing on a drug. Variable Interval (VI) schedules of reinforcement allow the experimenter to adjust the amount of time that elapses between drug infusions. At this point, this method has only shown to be effective with cocaine.
Secondary Reinforcement Schedules
Second-order reinforcement schedules build on basic reinforcement schedules by introducing a conditioned stimulus that cues the onset of the reinforcer. Second-order schedules are built from two simpler schedules; completion of the first schedule results in the presentation of a conditioned stimulus (such as a colored light), with a fixed-interval schedule following the cue and resulting in the original reinforcer at the end of the fixed interval. Second-order schedules result in a very high rate of operant response following the presentation of the conditioned stimulus, as this cue becomes a reinforcer of its own. Benefits of this schedule include the ability to maintain a high level of responding with relatively few drug infusions, reduced risk of self-administered overdose, and external validity to human populations where environmental context can provide a strong reinforcing effect for drug use.
Extinction and ReinstatementEdit
Extinction involves the discontinuation of a particular reinforcer in response to operant behavior, such as replacing a reinforcing drug infusion with a saline vehicle. When the reinforcing element of the operant paradigm is no longer present, a gradual reduction in operant responses results in eventual cessation or “extinction” of the operant behavior. Reinstatement is the restoration of operant behavior to acquire a reinforcer, often triggered by external events/cues or exposure to the original reniforcer itself. Reinstatement can be broken into a few broad categories:
Drug-induced reinstatement: exposure to a reinforcing drug after extinction of drug-seeking operant behavior can often reinstate drug-seeking, and can even occur when the new drug of exposure is different from the original reinforcer. This is thought to be strongly linked to drug sensitization  Cue-induced reinstatement: environmental cues associated with drug administration can trigger drug reinstatement by acting as conditioned stimuli, even during drug abstinence 
1. Environmental surroundings as well as drug-associated behavior or actions can function as environmental cues.
2. Stress-induced reinstatement: in many cases, a stressor can reinstate drug-seeking in a drug-abstinent animal. This can include (but is not limited to) acute stressors such as foot-shock or social defeat stress. In many cases, it appears that social stress can potentiate drug reinstatement just as strongly as exposure to the drug itself 
Animal self-administration experiments are typically performed in standard operant conditioning chambers adapted for the catheters used to deliver a drug intravenously. The catheter is secured to the animal by a harness or back plate and is tethered to a protective leash that extends upward through a hole in the top of a chamber, where it attaches to a rotating swivel on a mechanical arm that allows the subject to move around freely. The chamber houses two levers: one whose depression results in the delivery of a drug, the other whose depression does nothing. Activity on these levers can be used to measure drug administration (via activity at the drug-inducing lever) as well as changes in nonspecific behavior that reflect short- and long-term effects of the drug (via activity at the non-inducing lever). The sterile intravenous catheter used to deliver the drug into the bloodstream of the subject is typically composed of a flexible plastic, silastic tubing and nylon mesh placed subcutaneously. It is attached to a mechanical pump that can be calibrated to deliver a specific amount of drug upon depression of one of the levers in the chamber. Other chamber modifications are required if the drug is to be delivered orally or via inhalation, such as liquid containers or an aerosol distribution mechanism.
Self-Administration studies have long been considered the “standard” in addiction research using both animal and human models. Conducting self-administration studies in animal models provides a much greater level of experimental flexibility than in humans because investigating the effects of novel pharmacological drug treatments poses significantly fewer ethical and practical barriers. In 1999, Pilla and colleagues published in Nature a study documenting the efficacy of a partial D3-agonist (BP-897) in reducing environmental cue-induced cocaine craving and vulnerability to relapse. An interesting aspect of this study was the use of second-order reinforcement schedules to identify a dissociation in the effects of BP-897 in that the drug inhibits cue-induced cocaine seeking but has no primary reinforcement effect. This latter condition is important for any pharmacological agent to be used in the treatment of addiction—drugs used to treat addiction should be less reinforcing than the drug whose addiction they treat and optimally have no reinforcing effects.
A recent study published in Nature showed an upregulation of microRNA-212 in the dorsal striatum of rats previously exposed to cocaine for extended periods. Animals infected with a viral vector overexpressing miR-212 in the dorsal striatum produced the same initial levels of cocaine intake; however, drug consumption progressively decreased as net cocaine exposure increased. The authors of the study noted that viral-infected animals exhibited decreased operant responding during the post-infusion time-out period and proposed that this demonstrated a reduction in compulsive drug-seeking behavior.(Hollander et al.) miR-212 acts through Raf1 to enhance the CREB response; CREB-TORC is known to negatively regulate the reinforcing effects of cocaine. (Hollander et al.) This study provides one example (miR-212, owing to its amplification of CREB) of a self-administration study that may provide potential therapeutic targets for the treatment of cocaine addiction. One of the most important advances to emerge from self-administration studies comes from a behavioral model for addiction in animals. This model relies on observation of three separate phenomena to classify a rat as “addicted:” 1) Persistence in drug-seeking: Depends on the attempts of rats to obtain drug during time-out or no-periods in the self-administration apparatus. 2) Resistance to punishment: Measured by how much rats maintain rates of self-administration when cocaine infusion is paired with an electric shock. 3) Motivation for the drug: Measured by the breakpoint in progressive ratio reinforcement. (Deroche-Gamonet et al.)
The researchers used an additional test to further support classification of a rat as “addicted” by measuring relapse rates during reinstatement paradigms. Human drug addicts reportedly relapse at a rate of >90% as measured from the initial diagnosis. Rats that responded at high rates after some form of cue-induced reinstatement could be considered likely to relapse.(Deroche-Gamonet et al.) This model provided an important advancement for the method of self-administration because it allows animal models to better approximate the physiological and behavioral aspects of drug addiction in humans.
Self-administration experiments can also be paired with methods such as in vitro electrophysiology or molecular biology to understand the effects of addiction on neural circuitry. Self-administration studies have allowed researchers to locate a staggering number of changes in brain signaling that occur in addiction. One example of such a study involved examining synaptic plasticity in rats undergoing the behavioral shift to addiction. Using the criteria for classifying rats as “addicts” or “non-addicts” as put forth by Deroche-Gamonet et al., it was found that addicted rats display a prolonged and persistent impairment in mGluR2/3-dependent Long-Term Depression. Despite exposure to the same self-administration paradigm, control rats recovered this form of synaptic plasticity. The authors of the study propose an important explanation for their results in that this specific loss of plasticity over an extended period is responsible for the progressive loss of controlled drug use.(Kasanetz et al.) This represents a potential molecular mechanism by which addicts might differ from non-addicts and undergo pathological learning processes during the development of addiction.
Much like animal studies, human experiments that pair self-administration studies with additional neuroscientific techniques provide unique insight into the disease of addiction. Human self-administration studies have gained momentum with the widespread use of fMRI technology to measure BOLD signals. Brain imaging coupled with human self-administration studies with the laboratory have led to the development of a three-stage model of human neurocircuitry of addiction: Binge/Intoxication, Preoccupation/Anticipation, and Withdrawal/Negative Effect. Koob, Lloyd, and Mason reviewed the laboratory models approximating each stage of the model of human addiction.(Koob et al.) The binge-intoxication phase traditionally has been modeled by drug or alcohol self-administration; the psychological effects of addiction might be modeled by the increased motivation for self-administration observed in drug-dependent animals. Self-administration studies capably model the somatic effects of addiction, but many of the most deleterious effects related to drug addiction can be considered psychological in nature. (Koob et al.) Models like the one published by Deroche-Gamonet and colleagues in 2004 better approximate the effects of addiction on physiology and psychology, but animal models are inherently limited in their ability to reproduce human behavior.
The use of the self-administration methodology to model human drug addiction provides powerful insight into the physiological and behavioral effects of the disease. While self-administration experiments in humans or animals each pose unique barriers to complete understanding of addiction, the scientific community continues to invest a great deal of effort in both avenues of research in the hopes of improving understanding and treatment of addiction.
- ↑ Higgins, Stephen, Warren K. Bickel, John R. Hughes (1994). Influence of an alternative reinforcer on human cocaine self-administration. Life Sciences 55 (3): 179–187.
- ↑ Beveridge, Thomas, Hilary R. Smith, James B. Daunais, Michael A. Nader, Linda J. Porrino (9 Jun 2006). Chronic cocaine self-administration is associated with altered functional activity in the temporal lobes of non human primates. European Journal of Neuroscience 23 (11): 3109–3118.
- ↑ Pomrenze M, Baratta, V. M, Cadle, B., Cooper, D.C. (2012). Cocaine self-administration in the mouse: A low- cost, chronic catheter preparation. Nature Precedings March 29 http://dx.doi.org/10.1038/npre.2012.7040.1
- ↑ (2005) Neurobiology of Addiction, Academic Press.Template:Page needed
- ↑ Waterhouse, B.D (Ed.). (2003). Methods in Drug Abuse Research: Cellular and Circuit Level Analyses (17-50). Boca Raton, FL: CRC Press LLC.
- ↑ Spragg, S.D.S. (1940). Morphine addiction in chimpanzees. Comparative Psychology Monographs, 15(7), 1–132.
- ↑ Weeks, J. R. (1962). Experimental morphine addiction: Method for automatic intravenous injections in unrestrained rats. Science, 138, 143-144.
- ↑ Thompson, T. & Schuster, C.R. (1964). Morphine self-administration, food-reinforced, and avoidance behaviors in rhesus monkeys. Psychopharmacologia, 5, 87–94.
- ↑ Deneau, G., Yanagita, T. & Seevers, M.H. (1969). Self-administration of psychoactive substances by the monkey. Psychopharmacology, 16(1): 30-48.
- ↑ Collins, R.J., Weeks, J.R., Cooper, M.M., Good, P.I., & Russell, R.R. (1984). Prediction of abuse liability of drugs using IV self-administration by rats. Psychopharmacology, 82, 6–13.
- ↑ Panlilio, L. V. & Goldberg, S. R. (2007). Self-administration of drugs in animals and humans as a model and an investigative tool. Addiction, 102, 1863–1870.
- ↑ Pomrenze M, Baratta, V. M, Cadle, B., Donald C. Cooper (2012). Cocaine self-administration in the mouse: A low- cost, chronic catheter preparation. Nature Precedings March 29 http://dx.doi.org/10.1038/npre.2012.7040.1
- ↑ Pomrenze M, Baratta, V. M, Cadle, B., Donald C. Cooper (2012). Cocaine self-administration in the mouse: A low- cost, chronic catheter preparation. Nature Precedings March 29 http://www.figshare.com/articles/Cocaine_self-administration_in_the_mouse:_A_low-_cost,_chronic_catheter_preparation/91521
- ↑ Weiss SJ, Kearns DN, Cohn SI, Schindler CW, Panlilio LV (2003) Stimulus control of cocaine self-administration. J Exp Anal Behav 79:111-135. PMID 12696744
- ↑ Everitt B.J. & Robbins T.W. (2000). Second-order schedules of drug reinforcement in rats and monkeys: measurement of reinforcing efficacy and drug-seeking behaviour. Psychopharmacology, 153, 17-30.
- ↑ De Vries TJ, Schoffelmeer AN, Binnekade R, Mulder AH, Vanderschuren LJ (1998) Drug-induced reinstatement of heroin- and cocaine-seeking behaviour following long-term extinction is associated with expression of behavioural sensitization. Eur J Neurosci, 10, 3565-3571. PMID 9824469
- ↑ Buccafusco J.J. & Shuster L. (Eds.) (2009). Methods of Behavior Analysis in Neuroscience (2nd ed.) Boca Raton, FL: CRC Press
- ↑ Crombag HS, Bossert JM, Koya E, Shaham Y (2008) Review: Context-induced relapse to drug seeking: a review. Philos Trans R Soc Lond B Biol Sci, 2008 Oct 12;363(1507):3233-43.
- ↑ Pomrenze M, Baratta, V. M, Cadle, B., Cooper, D.C. (2012). Cocaine self-administration in the mouse: A low- cost, chronic catheter preparation. Nature Precedings March 29 http://www.neuro-cloud.net/nature-precedings/pomrenze
- ↑ Pomrenze M, Baratta, V. M, Cadle, B., Cooper, D.C. (2012). Cocaine self-administration in the mouse: A low- cost, chronic catheter preparation. Nature Precedings March 29 http://www.figshare.com/articles/Cocaine_self-administration_in_the_mouse:_A_low-_cost,_chronic_catheter_preparation/91521
- ↑ Adriani, W., Macri, S., Pacifici, R., & Laviola, G. (2002). Peculiar vulnerability to nicotine oral self administration in mice during early adolescence. Neuropsychopharmacology , 212-224.
- ↑ Jaffe, A., Sharpe, L., & Jaffe, J. (1989). Rats self-administer sufentanil in aerosol form. Pharmacology , 289-293.
- ↑ Pilla, M., Perachon, S., Sautel, F., Garrido, F., Mann, A., Wermuth, C. G., et al. (1999). Selective inhibition of cocaine-seeking behaviour by a partial dopamine D3 receptor agonist. [10.1038/22560]. Nature, 400(6742), 371-375.
- ↑ Koob, G. F., Kenneth Lloyd, G., & Mason, B. J. (2009). Development of pharmacotherapies for drug addiction: a Rosetta Stone approach. [10.1038/nrd2828]. Nat Rev Drug Discov, 8(6), 500-515.
- ↑ Hollander, J. A., Im, H.-I., Amelio, A. L., Kocerha, J., Bali, P., Lu, Q., et al. (2010). Striatal microRNA controls cocaine intake through CREB signalling. [10.1038/nature09202]. Nature, 466(7303), 197-202.
- ↑ Deroche-Gamonet, V., Belin, D., & Piazza, P. V. (2004). Evidence for addiction-like behavior in the rat. Science, 305(5686), 1014-1017.
- ↑ Lüscher, C., & Malenka, Robert C. (2011). Drug-Evoked Synaptic Plasticity in Addiction: From Molecular Changes to Circuit Remodeling. Neuron, 69(4), 650-663.
- ↑ Kasanetz, F., Deroche-Gamonet, V., Berson, N., Balado, E., Lafourcade, M., Manzoni, O., et al. (2010). Transition to addiction is associated with a persistent impairment in synaptic plasticity. Science, 328(5986), 1709-1712.
- ↑ Koob, G. F., & Volkow, N. D. (2009). Neurocircuitry of Addiction. Neuropsychopharmacology, 35(1), 217-238.
|This page uses Creative Commons Licensed content from Wikipedia (view authors).|