HOME

TheInfoList



OR:

Brain stimulation reward (BSR) is a pleasurable phenomenon elicited via direct stimulation of specific brain regions, originally discovered by
James Olds James Olds (May 30, 1922 – August 21, 1976) was an American psychologist who co-discovered the pleasure center of the brain with Peter Milner while he was a postdoctoral fellow at McGill University in 1954. He is considered to be one of the fou ...
and
Peter Milner Peter Milner (13 June 1919 – 2 June 2018) was a British-born Canadian neuroscientist. Biography Milner was born in Silkstone Common and grew up in Barnsley, South Yorkshire, England. His father was David William Milner, a research chemist an ...
. BSR can serve as a robust
operant Operant conditioning, also called instrumental conditioning, is a learning process where behaviors are modified through the association of stimuli with reinforcement or punishment. In it, operants—behaviors that affect one's environment—are c ...
reinforcer. Targeted stimulation activates the reward system circuitry and establishes response habits similar to those established by
natural reward Behavioral addiction is a form of addiction that involves a compulsion to engage in a rewarding non- substance-related behavior – sometimes called a natural reward – despite any negative consequences to the person's physical, mental, social ...
s, such as food and sex. Experiments on BSR soon demonstrated that stimulation of the
lateral hypothalamus The lateral hypothalamus (LH), also called the lateral hypothalamic area (LHA), contains the primary orexinergic nucleus within the hypothalamus that widely projects throughout the nervous system; this system of neurons mediates an array of cognit ...
, along with other regions of the brain associated with natural reward, was both rewarding as well as motivation-inducing.
Electrical brain stimulation Electrical brain stimulation (EBS), also referred to as focal brain stimulation (FBS), is a form of electrotherapy used as a technique in research and clinical neurobiology to stimulate a neuron or neural network in the brain through the direct ...
and intracranial drug injections produce robust reward sensation due to a relatively direct activation of the reward circuitry. This activation is considered to be more direct than rewards produced by natural stimuli, as those signals generally travel through the more indirect
peripheral A peripheral or peripheral device is an auxiliary device used to put information into and get information out of a computer. The term ''peripheral device'' refers to all hardware components that are attached to a computer and are controlled by the ...
nerves. BSR has been found in all vertebrates tested, including humans, and it has provided a useful tool for understanding how natural rewards are processed by specific brain regions and circuits, as well the neurotransmission associated with the reward system. Intracranial self-stimulation (ICSS) is the operant conditioning method used to produce BSR in an experimental setting. ICSS typically involves subjects with permanent electrode implants in one of several regions of the brain known to produce BSR when stimulated. Subjects are trained to continuously respond to electrical stimulation of that brain region. ICSS studies have been particularly useful for examining the effects of various pharmacological manipulations on reward sensitivity. ICSS has been utilized as a means to gauge addiction liability for drugs of many classes, including those that act on monoaminergic, opioid, and cholinergic neurotransmission. These data correlate well with findings from
self-administration Self-administration is, in its medical sense, the process of a subject administering a pharmacological substance to themself. A clinical example of this is the subcutaneous "self-injection" of insulin by a diabetic patient. In animal experimentati ...
studies on the addictive properties of drugs.


History

In 1953,
James Olds James Olds (May 30, 1922 – August 21, 1976) was an American psychologist who co-discovered the pleasure center of the brain with Peter Milner while he was a postdoctoral fellow at McGill University in 1954. He is considered to be one of the fou ...
and Peter Milner, of
McGill University McGill University (french: link=no, Université McGill) is an English-language public research university located in Montreal, Quebec, Canada. Founded in 1821 by royal charter granted by King George IV,Frost, Stanley Brice. ''McGill Universit ...
, observed that rats preferred to return to the region of the test apparatus where they received direct electrical stimulation to the septal area of the brain. From this demonstration, Olds and Milner inferred that the stimulation was rewarding, and through subsequent experiments, they confirmed that they could train rats to execute novel behaviors, such as lever pressing, in order to receive short pulse trains of brain stimulation. Olds and Milner discovered the reward mechanisms in the brain involved in positive reinforcement, and their experiments led to the conclusion that electrical stimulation could serve as an operant reinforcer. According to
B.F. Skinner Burrhus Frederic Skinner (March 20, 1904 – August 18, 1990) was an American psychologist, behaviorist, author, inventor, and social philosopher. He was a professor of psychology at Harvard University from 1958 until his retirement in 1974. ...
, operant reinforcement occurs when a behavior is followed by the presentation of a stimulus, and it is considered essential to the learning of response habits. Their discovery enabled
motivation Motivation is the reason for which humans and other animals initiate, continue, or terminate a behavior at a given time. Motivational states are commonly understood as forces acting within the agent that create a disposition to engage in goal-dire ...
and reinforcement to be understood in terms of their underlying physiology, and it led to further experimentation to determine the neural basis of reward and reinforcement. Since the initial discovery, the phenomenon of BSR has been demonstrated in all species tested, and
Robert Galbraith Heath Robert Galbraith Heath (May 9, 1915 – September 21, 1999) was an American psychiatrist. He followed the theory of biological psychiatry that organic defects were the sole source of mental illness, and that consequently mental problems were tr ...
similarly demonstrated that BSR can be applied to humans. In one oft-cited example, in 1972, Heath's subject known as "B-19" reported "feelings of pleasure, alertness, and warmth" and "protested each time the unit was taken from him, pleading to self-stimulate just a few more times". Among ethicists, early "direct brain stimulation" or "psychosurgery" experiments have been criticized as "dubious and precarious (even) by yesterday's standards". In a case published in 1986, a subject who was given the ability to self-stimulate at home ended up ignoring her family and personal hygiene, and spent entire days on electrical self-stimulation. By the time her family intervened, the subject had developed an open sore on her finger from repeatedly adjusting the current.


Brain stimulation reinforcement

Early studies on the motivational effects of brain stimulation addressed two primary questions: 1. Which brain sites can be stimulated to produce the perception of reward? and 2. Which drugs influence the response to stimulation and via what mechanism? Investigation of the brain reward circuitry reveals that it consists of a distributed, multi-synaptic circuit that determines both BSR and natural reward function. The natural drives that motivate and shape behavior reach the reward circuitry trans-synaptically through the peripheral senses of sight, sound, taste, smell, or touch. However, experimentally-induced BSR more directly activates the reward circuitry and bypasses transduction through peripheral sensory pathways. For this reason, electrical brain stimulation provides a tool for identifying the reward circuitry within the
central nervous system The central nervous system (CNS) is the part of the nervous system consisting primarily of the brain and spinal cord. The CNS is so named because the brain integrates the received information and coordinates and influences the activity of all par ...
with some degree of anatomical and neurochemical specificity. Studies involving these two forms of laboratory reward showed stimulation of a broad range of limbic and diencephalic structures could be rewarding as well as implicated the
dopamine Dopamine (DA, a contraction of 3,4-dihydroxyphenethylamine) is a neuromodulatory molecule that plays several important roles in cells. It is an organic compound, organic chemical of the catecholamine and phenethylamine families. Dopamine const ...
-containing neurons of the
mesolimbic The mesolimbic pathway, sometimes referred to as the reward pathway, is a dopaminergic pathway in the brain. The pathway connects the ventral tegmentum, ventral tegmental area in the midbrain to the ventral striatum of the basal ganglia in the for ...
dopamine system in motivational function. The motivational effect of intracranial self-stimulation varies substantially depending on the placement site of the surgically implanted electrode during electrical stimulation, and animals will work to stimulate different neural sites depending on their current state. Often, animals that work to initiate brain stimulation will also work to terminate the stimulation.


Relationship to natural rewards and drives

The relationship between BSR and natural rewards (e.g. food, water and copulation) has long been debated, and much of the early research on BSR is focused on their respective similarities and differences. BSR is facilitated through the same reinforcement pathway activated by natural rewards. Self-stimulation can exert robust activation of central reward mechanisms due to more direct action than natural rewards, which initially activate
peripheral nerves The peripheral nervous system (PNS) is one of two components that make up the nervous system of bilateral animals, with the other part being the central nervous system (CNS). The PNS consists of nerves and ganglia, which lie outside the brain a ...
. BSR to the
medial forebrain bundle The medial forebrain bundle (MFB), is a neural pathway containing axon, fibers from the basal olfactory regions, the periamygdaloid region and the septal nuclei, as well as fibers from brainstem regions, including the ventral tegmental area and nig ...
(MFB) through either electrical or chemical means activates key components of the reward pathway also activated by natural rewards. When specific regions of the
hypothalamus The hypothalamus () is a part of the brain that contains a number of small nuclei with a variety of functions. One of the most important functions is to link the nervous system to the endocrine system via the pituitary gland. The hypothalamu ...
are electrically stimulated, it elicits reward-related behaviors such as eating, drinking, or copulation responses. Natural rewards are associated with a state of deprivation from unmet needs or desires (e.g., hunger). These states drive instinctual, motivated behaviors like food consumption. It has been argued that this is not the case with BSR, as it does not meet an intrinsic survival-based need. BSR also notably lacks an established neural representation in memory that naturally facilitates the learning of reward expectancy. Both of these effects lead to diminished response rate for BSR in the early trials of a series; however, experiments have also shown that extinguished behavior can be quickly reinstated by a
priming Priming may refer to: * Priming (agriculture), a form of seed planting preparation, in which seeds are soaked before planting * Priming (immunology), a process occurring when a specific antigen is presented to naive lymphocytes causing them to di ...
stimulation that refreshes the short-term association involved in reward expectancy. Studies on BSR indicate that reinforcing brain stimulation may activate the natural pathways associated with natural drives as well as stimulate the reinforcement pathways that are usually activated by natural rewards.


Strength of drive

Rats will perform lever-pressing at rates of several thousand responses per hour for days in exchange for direct electrical stimulation of the
lateral hypothalamus The lateral hypothalamus (LH), also called the lateral hypothalamic area (LHA), contains the primary orexinergic nucleus within the hypothalamus that widely projects throughout the nervous system; this system of neurons mediates an array of cognit ...
. Multiple studies have demonstrated that rats will perform reinforced behaviors at the exclusion of all other behaviors. Experiments have shown rats will forgo food to the point of starvation in exchange for brain stimulation or intravenous
cocaine Cocaine (from , from , ultimately from Quechuan languages, Quechua: ''kúka'') is a central nervous system (CNS) stimulant mainly recreational drug use, used recreationally for its euphoria, euphoric effects. It is primarily obtained from t ...
when both food and stimulation are offered concurrently for a limited time each day. Rats will also cross electrified grids to press a lever, and they are willing to withstand higher levels of shock to obtain electrical stimulation than to obtain food.


Satiation

Satiation experiments in rats have revealed that BSR does not produce satiety. Olds demonstrated that this lack of satiation associated with BSR allows animals to self-stimulate to sheer exhaustion and that satiation is dependent on the location of the electrical stimulation. In a 48-hour satiation test, rats with
hypothalamic The hypothalamus () is a part of the brain that contains a number of small nuclei with a variety of functions. One of the most important functions is to link the nervous system to the endocrine system via the pituitary gland. The hypothalamus i ...
electrodes self-stimulated to exhaustion and showed no intrinsic satiation tendencies, whereas
telencephalic The cerebrum, telencephalon or endbrain is the largest part of the brain containing the cerebral cortex (of the two cerebral hemispheres), as well as several subcortical structures, including the hippocampus, basal ganglia, and olfactory bulb. In ...
electrodes showed radical slowing of self-stimulation after 4 to 8 hours. The insatiability of BSR is closely related to the strength of drive. While a natural reward, like food, is met with a feeling of being full (satiety), BSR does not have a comparable correlate. This allows for BSR to be experienced indefinitely, or in the case of ICSS, until exhaustion.


Addiction

Addiction is a chronic brain disorder consisting of compulsive drug-taking and seeking that is maintained despite detrimental effects on various aspects of life including health, relationships, and work. Laboratory procedures can establish compulsive self-administration habits of seeking and ingesting that qualify as addictive behaviors. Rodents and
non-human primates Primates are a diverse order of mammals. They are divided into the strepsirrhines, which include the lemurs, galagos, and lorisids, and the haplorhines, which include the tarsiers and the simians (monkeys and apes, the latter including huma ...
have been shown to work in a compulsive manner to receive intravenous injections of stimulants, and when access to the drugs is not limited, they will self-administer drugs to the point of severe weight loss and death. Similar to self-administration behavior, responding for intracranial brain stimulation has a highly compulsive component characteristic of an addicted state. BSR is hypothesized to be so effective in establishing compulsive habits due to its more direct activation of the reward pathway, bypassing transmission through sensory pathways in response to natural rewards. Delayed reinforcement following a response for BSR decreases how strongly this behavior is reinforced and to what extent it continues. A delay of one second, for example, between a lever-press and reward delivery (stimulation) can reduce response levels. BSR offers insights into the neural circuitry involved in reinforcement and compulsive behavior.


Anatomy of reward

Mapping and lesion studies on BSR were designed to determine the location of reward-relevant neurons as well as determine the signal pathways that are directly affected by brain stimulation. The site of intracranial self-stimulation leads to substantially different behavioral characteristics. Sites along the length of the
medial forebrain bundle The medial forebrain bundle (MFB), is a neural pathway containing axon, fibers from the basal olfactory regions, the periamygdaloid region and the septal nuclei, as well as fibers from brainstem regions, including the ventral tegmental area and nig ...
(MFB) through the lateral and posterior
hypothalamus The hypothalamus () is a part of the brain that contains a number of small nuclei with a variety of functions. One of the most important functions is to link the nervous system to the endocrine system via the pituitary gland. The hypothalamu ...
, the
ventral tegmental area The ventral tegmental area (VTA) (tegmentum is Latin for ''covering''), also known as the ventral tegmental area of Tsai, or simply ventral tegmentum, is a group of neurons located close to the midline on the floor of the midbrain. The VTA is the ...
(VTA), and into the
pons The pons (from Latin , "bridge") is part of the brainstem that in humans and other bipeds lies inferior to the midbrain, superior to the medulla oblongata and anterior to the cerebellum. The pons is also called the pons Varolii ("bridge of Va ...
are associated with the strongest reward effects of stimulation.


Lateral hypothalamus

The
lateral hypothalamus The lateral hypothalamus (LH), also called the lateral hypothalamic area (LHA), contains the primary orexinergic nucleus within the hypothalamus that widely projects throughout the nervous system; this system of neurons mediates an array of cognit ...
is a portion of the hypothalamus, and brain stimulation to this area at the level of the medial forebrain bundle produces the highest response rates and subsequently the highest reward potency in rodents. Lesions in this region or along its boundary cause a loss of positive drive-reward behaviors as well as all other operant drive behaviors.


Medial forebrain bundle

The
medial forebrain bundle The medial forebrain bundle (MFB), is a neural pathway containing axon, fibers from the basal olfactory regions, the periamygdaloid region and the septal nuclei, as well as fibers from brainstem regions, including the ventral tegmental area and nig ...
(MFB) is the location of the most frequently investigated brain stimulation reward sites, and it is composed of a complex bundle of
axons An axon (from Greek ἄξων ''áxōn'', axis), or nerve fiber (or nerve fibre: see American and British English spelling differences#-re, -er, spelling differences), is a long, slender projection of a nerve cell, or neuron, in vertebrates, th ...
projecting from the basal
olfactory The sense of smell, or olfaction, is the special sense through which smells (or odors) are perceived. The sense of smell has many functions, including detecting desirable foods, hazards, and pheromones, and plays a role in taste. In humans, it ...
regions and the
septal nuclei The septal area (medial olfactory area), consisting of the lateral septum and medial septum, is an area in the lower, posterior part of the medial surface of the frontal lobe, and refers to the nearby septum pellucidum. The septal nuclei are loca ...
. MFB is not the sole anatomical substrate responsible for reinforcing brain stimulation; however, it is the main tract for the ascending dopamine fibers, and it functions to relay information from the VTA to the
nucleus accumbens The nucleus accumbens (NAc or NAcc; also known as the accumbens nucleus, or formerly as the ''nucleus accumbens septi'', Latin for "nucleus adjacent to the septum") is a region in the basal forebrain rostral to the preoptic area of the hypotha ...
. The rewarding effect of MFB stimulation is mediated via the activation of the mesocorticolimbic dopamine system.


Mesolimbic pathway

The
mesolimbic pathway The mesolimbic pathway, sometimes referred to as the reward pathway, is a dopaminergic pathway in the brain. The pathway connects the ventral tegmental area in the midbrain to the ventral striatum of the basal ganglia in the forebrain. The ventral ...
connects the VTA to the
nucleus accumbens The nucleus accumbens (NAc or NAcc; also known as the accumbens nucleus, or formerly as the ''nucleus accumbens septi'', Latin for "nucleus adjacent to the septum") is a region in the basal forebrain rostral to the preoptic area of the hypotha ...
. The nucleus accumbens is located in the ventral
striatum The striatum, or corpus striatum (also called the striate nucleus), is a nucleus (a cluster of neurons) in the subcortical basal ganglia of the forebrain. The striatum is a critical component of the motor and reward systems; receives glutamate ...
and integrates information from cortical and limbic brain structures to mediate behaviors the reinforce reward. It is a major target for the dopaminergic projections from the VTA, a group of neurons located close to the midline on the floor of the
midbrain The midbrain or mesencephalon is the forward-most portion of the brainstem and is associated with vision, hearing, motor control, sleep and wakefulness, arousal (alertness), and temperature regulation. The name comes from the Greek ''mesos'', " ...
. The VTA is the origin of
dopaminergic Dopaminergic means "related to dopamine" (literally, "working on dopamine"), dopamine being a common neurotransmitter. Dopaminergic substances or actions increase dopamine-related activity in the brain. Dopaminergic brain pathways facilitate d ...
cell bodies that comprise the mesocorticolimbic dopamine system. BSR has been shown to result in the release of dopamine within the nucleus accumbens, which also occurs in response to natural rewards such as food or sex.


Indirect activation

Electrophysiological Electrophysiology (from Greek , ''ēlektron'', "amber" etymology of "electron"">Electron#Etymology">etymology of "electron" , ''physis'', "nature, origin"; and , ''-logia'') is the branch of physiology that studies the electrical properties of bi ...
data suggest stimulation of the MFB or VTA does not directly activate dopaminergic neurons in the mesolimbic reward pathway. These data suggest BSR is facilitated by initial excitation of descending,
myelinated Myelin is a lipid-rich material that surrounds nerve cell axons (the nervous system's "wires") to insulate them and increase the rate at which electrical impulses (called action potentials) are passed along the axon. The myelinated axon can be l ...
neurons, which then activate the ascending, unmyelinated neurons of the VTA. Excitatory,
cholinergic Cholinergic agents are compounds which mimic the action of acetylcholine and/or butyrylcholine. In general, the word "choline" describes the various quaternary ammonium salts containing the ''N'',''N'',''N''-trimethylethanolammonium cation. F ...
inputs to the VTA are thought to play a role in this indirect activation, but the neuroanatomical components of this circuit have yet to be fully characterized.


Intracranial self-stimulation (ICSS) procedures


Initial training

Since the initial demonstration of BSR by Olds and Milner, experiments in rodents record ICSS responding to quantify motivation to receive stimulation. Subjects undergo stereotaxic surgery to permanently implant either a monopolar or bipolar electrode to the desired brain region. Electrodes are connected to a stimulating apparatus at the time of the experiment. The first portion of an ICSS experiment involves training subjects to respond for stimulation using a fixed-ratio 1 (FR-1) reinforcement schedule (1 response = 1 reward). In experiments involving rats, subjects are trained to press a lever for stimulation, and the rate of lever-pressing is typically the
dependent variable Dependent and independent variables are variables in mathematical modeling, statistical modeling and experimental sciences. Dependent variables receive this name because, in an experiment, their values are studied under the supposition or demand ...
. In ICSS studies using mice, a response wheel is usually used instead of a lever, as mice do not consistently perform lever-pressing behaviors. Each quarter turn of the response wheel is recorded and rewarded with stimulation. The rewarding stimulus in BSR experiments is typically a train of short-duration pulses separated by interval pulses, which can be manipulated experimentally using the
independent variables Dependent and independent variables are variables in mathematical modeling, statistical modeling and experimental sciences. Dependent variables receive this name because, in an experiment, their values are studied under the supposition or demand ...
of stimulation amplitude, frequency, and pulse
duration Duration may refer to: * The amount of time elapsed between two events * Duration (music) – an amount of time or a particular time interval, often cited as one of the fundamental aspects of music * Duration (philosophy) – a theory of time and ...
.


Establishing minimum effective current

The amplitude (current) of stimulation determines the population of neurons being activated by the implanted electrode. In certain approaches, this is adjusted for every subject due to minor variability in electrode placement, and therefore a slightly different population of affected neurons. Following FR1 training, it is typical to establish a minimum, threshold current that produces sufficient levels of ICSS responding (about 40 responses per minute). This is called a discrete-trial current intensity procedure. Each discrete trial consists of non-contingent stimulation at a certain amplitude followed by a brief window during which the animal can respond for more stimulation. Effective currents for BSR elicit responding above a certain rate (3 out of 4 trials, for example). The lowest current the animal responds sufficiently to is deemed the minimum effective current. This is done at a constant frequency, typically at the higher end of the frequency range employed in ICSS studies (140–160 Hz). Within-subject study design is often implemented to help eliminate variability introduced by electrode placement. Between-subject study design requires rigorous
histologic Histology, also known as microscopic anatomy or microanatomy, is the branch of biology which studies the microscopic anatomy of biological tissues. Histology is the microscopic counterpart to gross anatomy, which looks at larger structures vis ...
verification of electrode placement to ensure consistency between experimental groups. Subjects with imperfect electrode placement require a higher simulation amplitude to activate the reward circuitry and produce ICSS responding. Subjects with ideal anatomical placement will respond at lower stimulation amplitudes. This corrective process is limited, however, since increasing the population of activated neurons can result in off-target activation of neighboring circuitry. This is often culminated in undesired motor side effects upon stimulation, due to the adjacency of the MFB to the
internal capsule The internal capsule is a white matter structure situated in the inferomedial part of each cerebral hemisphere of the brain. It carries information past the basal ganglia, separating the caudate nucleus and the thalamus from the putamen and the g ...
, a bundle of axons carrying descending motor information to the
brainstem The brainstem (or brain stem) is the posterior stalk-like part of the brain that connects the cerebrum with the spinal cord. In the human brain the brainstem is composed of the midbrain, the pons, and the medulla oblongata. The midbrain is cont ...
. Inadvertent stimulation of these axons can lead to motor output such as movement of the head or paw twitching.


Frequency-rate responding

At a constant minimum effective current, ICSS responding is recorded over a series of trials, which vary in stimulation frequency. Each trial consists of a short priming phase of non-contingent stimulation, a response phase where responses are recorded and rewarded with stimulation, and a short time-out phase where responses are not recorded and no stimulation is delivered. This is repeated for a series of 10-15 different ascending or descending frequencies, in 0.05 log-unit increments, which range anywhere from 20 to 200 Hz. While the amplitude of the stimulation influences which neurons are stimulated, the frequency of stimulation determines the firing rate induced in that neuronal population. Generally, increasing stimulation frequency increases the firing rate in the target population. This is associated with higher ICSS response rates, eventually reaching a maximum level at the maximum firing rate, limited by the refractory properties of neurons.


Other factors

The independent variables of stimulation train and pulse duration can also be varied to determine how each affects ICSS response rates. Longer train durations produce more vigorous responding up to a point, after which rate of responding varies inversely with train length. This is due to lever-pressing for additional stimulation before the previously earned train has finished. The reinforcement schedule can also be manipulated to determine how motivated an animal is to receive stimulation, reflected by how hard they are willing to work to earn it. This can be done by increasing the number of responses required to receive a reward (FR-2, FR-3, FR-4, etc.) or by implementing a progressive-ratio schedule, where the number of required responses continually increases. The number of required responses increases for each trial until the animal fails to reach the required number of responses. This is considered the "break-point" and is a good indication of motivation related to reward magnitude.


Curve-shift analysis

Stimulation intensity, pulse duration, or pulse frequency can be varied to determine dose-response functions ICSS responding using curve-shift analysis. This approach generally resembles traditional pharmacological dose-response curve where the frequency of stimulation, rather than the dose of a drug, is examined. This method allows for quantitative analysis of reward-modulating treatments on response rates in comparison to baseline conditions. Lower stimulation frequencies fail to sustain ICSS responding at a probability above chance. Response rates increase rapidly over a dynamic range of stimulation frequencies as the frequency increases, until a maximum response rate is reached. Changes in the rate of response over this range reflects changes in the magnitude of the reward. Rate-frequency, rate-intensity, or rate-duration functions make inferences about the potency and efficacy of stimulation, as well as elucidate how drugs alter the rewarding impact of stimulation. Curve-shift analysis is often used in pharmacological studies to compare baseline response rates to those following drug administration. The maximum response rate during baseline conditions is typically used to normalize data in a frequency-rate curve to a maximum control rate (MCR). More specifically, the number of responses for any given trial is divided by the highest number of responses recorded in a baseline condition trial, which is then multiplied by 100. In an experimental condition, if the MCR falls below 100% at the highest stimulation frequencies, it is thought to reflect an impacted capability or motivation to respond, potentially induced by a drug with sedative or aversive properties. Shifts above 100% of the MCR indicate improved ability or motivation to respond, potentially induced by a drug with rewarding or stimulant properties. Sensitivity of the neural circuitry to the rewarding properties of stimulation is assessed by analyzing left- or right-shifts in the M50, or the frequency at which 50% of the maximum number of responses was recorded. Reaching 50% of the MCR at a lower frequency is characteristic of a left-shift in the frequency-rate curve and sensitization of the reward circuitry to stimulation. An increase in the M50 indicates that a greater stimulation frequency was required to reach 50% of the MCR, and the reward circuitry has been desensitized by the experimental manipulation. Another way of analyzing the frequency-rate curve between control and experimental conditions is to do a linear regression through the ascending data points in a plot of raw data (which has not been normalized to the MCR). The point where y=0, or the x-intercept, is called the threshold frequency or theta zero (θ0). This is the frequency at which ICSS response rates are equal to 0 (and any frequency above this will theoretically elicit ICSS responding).


Modulation with drugs

Several major drug classes have been studied extensively in relation to ICSS behavior: monoaminergic drugs, opioids, cholinergic drugs, GABAergic drugs, as well as a small number of drugs from other classes. These studies generally compare ICSS responding at baseline and following drug administration. Typically, the frequency-rate approach is used to determine changes in the M50 or θ0. Drugs with increased addiction liability generally decrease the stimulation threshold for ICSS responding, while drugs with
aversive In psychology, aversives are unpleasant stimuli that induce changes in behavior via negative reinforcement or positive punishment. By applying an aversive immediately before or after a behavior the likelihood of the target behavior occurring in ...
properties generally increase the stimulation threshold to achieve ICSS responding. These studies provide insight into the specific neurochemical mechanisms involved in the facilitation of BSR, and how reward perception can be modulated by pharmacologically altering the activity of specific neurotransmitter systems. Pharmacological manipulation of these systems can have either a direct or indirect effect on the activity of the reward circuitry. Understanding drug-specific effects on ICSS response thresholds has helped elucidate how different neurotransmitter systems influence the reward circuitry by either potentiating or suppressing sensitivity to rewarding stimulation and influencing motivation to perform reward-associated behaviors. BSR and drugs of addiction produce their rewarding effects through shared neuroanatomical and neurochemical mechanisms. Studies using lesion, pharmacological, and anatomical mapping of the brain have revealed that many drugs of abuse (e.g.
amphetamine Amphetamine (contracted from alpha- methylphenethylamine) is a strong central nervous system (CNS) stimulant that is used in the treatment of attention deficit hyperactivity disorder (ADHD), narcolepsy, and obesity. It is also commonly used ...
,
cocaine Cocaine (from , from , ultimately from Quechuan languages, Quechua: ''kúka'') is a central nervous system (CNS) stimulant mainly recreational drug use, used recreationally for its euphoria, euphoric effects. It is primarily obtained from t ...
,
opioids Opioids are substances that act on opioid receptors to produce morphine-like effects. Medically they are primarily used for pain relief, including anesthesia. Other medical uses include suppression of diarrhea, replacement therapy for opioid use ...
,
nicotine Nicotine is a natural product, naturally produced alkaloid in the nightshade family of plants (most predominantly in tobacco and ''Duboisia hopwoodii'') and is widely used recreational drug use, recreationally as a stimulant and anxiolytic. As ...
, etc.) activate the reward circuitry of the MFB, which is similarly activated by stimulation to achieve BSR. The neuronal axons of the mesolimbic dopamine system, a key component of the reward circuitry, generally have high thresholds for stimulation. However, these thresholds can be increased or decreased by drug administration, influencing sensitivity to intracranial stimulation and ICSS behavior.


Monoaminergic drugs

The effects of drugs that alter neurotransmission of dopamine,
norepinephrine Norepinephrine (NE), also called noradrenaline (NA) or noradrenalin, is an organic chemical in the catecholamine family that functions in the brain and body as both a hormone and neurotransmitter. The name "noradrenaline" (from Latin '' ad'', ...
, and
serotonin Serotonin () or 5-hydroxytryptamine (5-HT) is a monoamine neurotransmitter. Its biological function is complex and multifaceted, modulating mood, cognition, reward, learning, memory, and numerous physiological processes such as vomiting and vas ...
have been studied extensively in relation to BSR. Neurochemical studies have shown that BSR results in the release of dopamine within the nucleus accumbens. This effect is generally potentiated following administration of drugs that themselves increase the amount of extracellular dopamine in the nucleus accumbens, such as
cocaine Cocaine (from , from , ultimately from Quechuan languages, Quechua: ''kúka'') is a central nervous system (CNS) stimulant mainly recreational drug use, used recreationally for its euphoria, euphoric effects. It is primarily obtained from t ...
, which inhibits re-uptake of dopamine to the intracellular space by blocking its transporter. Conversely, these levels are decreased and the rewarding properties of BSR are blocked following administration of drugs that antagonize dopamine receptors or reduce the amount of extracellular dopamine, by promoting either degradation or
re-uptake Reuptake is the reabsorption of a neurotransmitter by a neurotransmitter transporter located along the plasma membrane of an axon terminal (i.e., the pre-synaptic neuron at a synapse) or glial cell after it has performed its function of transmit ...
of the neurotransmitter. While dopamine is generally considered to be the main neurotransmitter implicated in the reward system, it is often not the only neurotransmitter affected by addictive, monoaminergic drugs. Importantly, the circuitry involved in BSR is multi-synaptic and not exclusively dopaminergic. This introduces potential for modulation by other neurotransmitter systems at different stages in the transmission of the reward signal. Additionally, drugs that affect monoamine transmission vary in their selectivity. For example, drugs with high selectivity for increasing dopamine and norepinephrine transmission relative to serotonin transmission tend to have highly addictive properties. Amphetamine and cocaine share this selectivity profile, and administration of these drugs generally results in a left-shift in M50 and θ0, indicating sensitization of the reward circuitry and high abuse potential. This characteristic leftward-shift of M50 in response to a moderate dose of cocaine is illustrated in a hypothetical data set in Figure 1. Note that the maximum response rate is reached at a lower frequency than it is at baseline, and there is a significant response rate at the lowest frequency, which did not produce responding under baseline conditions. Even following chronic administration of methamphetamine or cocaine, there is little to no tolerance to ICSS facilitation. After chronic treatment is stopped, however, there is a withdrawal-induced depression of ICSS responding, which can be reversed by re-administering the drug. Drugs with more balanced selectivity for dopamine/norepinephrine and serotonin transmission, such as 3,4-methylenedioxy-methamphetamine (
MDMA 3,4-Methylenedioxymethamphetamine (MDMA), commonly seen in Tablet (pharmacy), tablet form (ecstasy) and crystal form (molly or mandy), is a potent empathogen–entactogen with stimulant properties primarily used for Recreational dru ...
), tend to be less addictive, and they have mixed effects on ICSS responding depending on dose and stimulation frequency. Serotonin selective drugs, however, tend to result in either a lack of ICSS potentiation or depression of ICSS responding (a right-shift in frequency-rate curve), and these drugs are generally considered to be less addictive. One such example is fenfluramine, which was previously marketed as an appetite suppressant. Dopamine antagonists generally result in the depression of ICSS responding and a rightward-shift in the frequency-rate curve. This suggests decreased BSR and possibly increased aversive properties of the stimulation. Following chronic treatment with a dopamine antagonist, there is withdrawal-induced facilitation of ICSS, the opposite effect of what is observed following chronic treatment with stimulants.


Opioids

Drugs that act on the
opioid Opioids are substances that act on opioid receptors to produce morphine-like effects. Medically they are primarily used for pain relief, including anesthesia. Other medical uses include suppression of diarrhea, replacement therapy for opioid us ...
system generally vary in selectivity for the mu (μ), delta (δ), and kappa (κ) opioid receptors. Their addictive properties are highly dependent on these selectivities. Generally speaking, high potency mu-opioid receptor (MOR) agonists have high abuse potential, while kappa-opioid receptor (KOR) agonists generally produce a dysphoric state. Morphine, a MOR agonist, was one of the earliest studied drugs at the advent of ICSS and BSR. High potency MOR agonists like morphine have a somewhat varied effect on ICSS responding despite having high abuse potential, resulting in both potentiation and depression. The effect these drugs have on ICSS responding has been found to be highly dependent on dose, pretreatment time, and previous opioid exposure. Various studies on the effect of MOR-selective drugs including morphine, heroin, fentanyl, methadone, and hydrocodone have found mixed effects on ICSS responding. Low doses of these drugs have been found to elicit weak facilitation of ICSS, while high doses result in a biphasic ICSS profile, consisting of a higher threshold for ICSS at lower frequencies followed by ICSS potentiation at higher frequencies. Upon chronic administration of high-potency MOR agonists at low doses, there is no tolerance to ICSS facilitation. Opioid receptor antagonists, such as
naloxone Naloxone, sold under the brand names Narcan (4 mg) and Kloxxado (8 mg) among others, is a medication used to reverse or reduce the effects of opioids. It is commonly used to counter decreased breathing in opioid overdose. Effects begin within ...
, can reverse the effects of both opioid receptor agonists on ICSS responding and the potentiating effects of psychostimulants like methamphetamine. Naloxone, which is a competitive antagonist of all opioid receptor sub-types, does not influence ICSS responding when administered on its own. KOR agonism, typically associated with dysphoric states, more consistently results in a depression of ICSS responding. The KOR agonist salvinorin-A, for example, causes an overall decrease in ICSS response rates at lower stimulation frequencies. Repeated administration does not produce tolerance to ICSS depression. The effects of delta opioid receptor (DOR) agonists/antagonists on ICSS are less clear. One DOR agonist, SNC80, has been found to cause ICSS depression, but there is counter-evidence suggesting some delta agonists might have weak ICSS facilitation properties.


Cholinergic drugs

Cholinergic drugs have been less extensively studied than monoamines and opioids. The most commonly studied cholinergic drug is
nicotine Nicotine is a natural product, naturally produced alkaloid in the nightshade family of plants (most predominantly in tobacco and ''Duboisia hopwoodii'') and is widely used recreational drug use, recreationally as a stimulant and anxiolytic. As ...
, the highly-addictive, psychoactive substance in cigarettes. Nicotine is an agonist of
nicotinic acetylcholine receptor Nicotinic acetylcholine receptors, or nAChRs, are receptor polypeptides that respond to the neurotransmitter acetylcholine. Nicotinic receptors also respond to drugs such as the agonist nicotine. They are found in the central and peripheral ne ...
s (nAchRs), which are ligand-gated ion channels. The addictive properties of nicotine have been found to be associated with agonism specifically of the α4β2 sub-type of nicotinic receptors. Many studies have confirmed that low doses of nicotine result in ICSS facilitation, while higher doses result in ICSS depression. Chronic treatment with nicotine does not result in tolerance to ICSS facilitation at low doses, but does result in tolerance to the depressive effects of high doses. Withdrawal-induced depression of ICSS facilitation at low doses is also observed, as in MOR agonists and monoamine stimulants. The effects of nicotine treatment on ICSS response thresholds and maximum response rates are not as significant as they are in the case of many addictive MOR agonists and monoamine stimulants.


GABAergic drugs

GABAergic transmission is inhibitory, and the two main receptors for GABA are GABAA and GABAB. Drugs that act on GABAA receptors, which are ligand-gated ion channels, are more widely studied, as they generally produce more robust effects on
sedation Sedation is the reduction of irritability or agitation by administration of sedative drugs, generally to facilitate a medical procedure or diagnostic procedure. Examples of drugs which can be used for sedation include isoflurane, diethyl ether, ...
and
anxiety Anxiety is an emotion which is characterized by an unpleasant state of inner turmoil and includes feelings of dread over anticipated events. Anxiety is different than fear in that the former is defined as the anticipation of a future threat wh ...
, and they are commonly prescribed for therapeutic uses. Several of these drugs have addictive properties, including several
benzodiazepines Benzodiazepines (BZD, BDZ, BZs), sometimes called "benzos", are a class of depressant drugs whose core chemical structure is the fusion of a benzene ring and a diazepine ring. They are prescribed to treat conditions such as anxiety disorders, i ...
and
barbiturate Barbiturates are a class of depressant drugs that are chemically derived from barbituric acid. They are effective when used medically as anxiolytics, hypnotics, and anticonvulsants, but have physical and psychological addiction potential as we ...
s. Low doses of these drugs generally result in ICSS facilitation, while higher doses can result in depression of ICSS and an overall decrease in the maximum response rate. The latter is likely related to an impaired ability to respond due to the sedative and hypnotic properties of these drugs. Ethanol influences GABA receptor activity, and has been found to moderately facilitate ICSS, despite older publications suggesting these findings are inconsistent. GABAB receptor agonists and positive allosteric modulators have been found to result in ICSS depression and have been found to inhibit the reinforcing effects of several drugs, including cocaine, methamphetamine, and nicotine, reversing the ICSS facilitation these drugs typically cause.


Clinical and pre-clinical evidence

Mechanisms of BSR offer a tool that provides insight into the way the brain governs behavior through motivation and reinforcement, especially in regard to addictive and compulsive behaviors. ICSS studies of BSR have proven to be a robust measure of reward sensitivity, and have potential to help assess the abuse liability of various future therapeutics. Additionally, ICSS studies have potential to be used to gauge how reward sensitivity is affected by genetic factors associated with addictive disorders. Drugs found to prevent ICSS facilitation have potential to be developed and therapeutically implemented to reduce the risk of addictive disorders in a clinical setting.


See also

*
Deep brain stimulation Deep brain stimulation (DBS) is a neurosurgical procedure involving the placement of a medical device called a neurostimulator, which sends electrical impulses, through implanted electrodes, to specific targets in the brain (the brain nucleu ...
*
Reward system The reward system (the mesocorticolimbic circuit) is a group of neural structures responsible for incentive salience (i.e., "wanting"; desire or craving for a reward and motivation), associative learning (primarily positive reinforcement and class ...
*
Affective neuroscience Affective neuroscience is the study of how the brain processes emotions. This field combines neuroscience with the psychological study of personality, emotion, and mood. The basis of emotions and what emotions are remains an issue of debate withi ...
*
Addiction Addiction is a neuropsychological disorder characterized by a persistent and intense urge to engage in certain behaviors, one of which is the usage of a drug, despite substantial harm and other negative consequences. Repetitive drug use o ...


References


External links


Brain Stimulation: Can Magnetic or Electrical Pulses Help You?
Targeting Misbehaving Brain Circuitry with Therapies like ECT, DBS, and TMS
Deep Brain Stimulation
Neurosurgical Treatments Using Deep Brain Stimulation

Drugs, Brain, Behavior- The Science of Addiction {{DEFAULTSORT:Brain Stimulation Reward Perception Addiction