Professional Documents
Culture Documents
1
Get to know my students
• Is the course helping you to become a pediatric psychiatrist?
• What literature do you love?
• How is your brain rewired when playing video games?
2
Lecture 8 outline
Motivated and habitual behaviours, and falling in love
1. Homeostasis and goal directed behaviours
2. Effector Systems for goal directed and habit directed behaviours
3. How are goal directed behaviours shaped, and habits formed?
4. The role of dopamine in goal directed and habit directed behaviours (the error predictor)
5. Dopamine and the pair bond
6. Oxytocin and vasopressin and the pair bond
7. The partner engram associated with the reward system
Great Resources to Prepare
In Class Team UP! Activity based on the following video:
https://play.library.utoronto.ca/bjlgOSnj3FO6Links to an external site.
And the highlighted sections of this reading.
Young Wang_2004_The neurobiology of pair bonding 2019.pdf
The video and reading are required readings for the course and are testable.
3
The active maintenance of a relatively Homeostasis
constant internal environment is called
homeostasis. Constancy of the internal
environment is the basis of the freedom of
action we and other animals enjoy because
it partially decouples our physiology from
immediate external conditions and greatly
extends the range of available habitats. Stimulates
goal directed
As the internal environment moves out of behaviours
balance (e.g. low energy, low water),
behavioural effectors are stimulated to
trigger goal directed behaviours (return to
balance).
5
Some Goal Directed Behaviours
6
The human version of foraging or random exploration
7
Goal directed behaviours are regulated – homeostasis
Some states (e.g. hunger, thirst,
There behaviours are driven by motivational states. temp) are regulated
These can be internal (e.g.)
• Hunger
Example homeostatic
• Thirst
regulation feeding behviour
• Temperature sensors
• Sexual arousal
• Curiosity to explore
These can be external cues (e.g.) Satiety = Hunger =
• Sight of food or water No Goal directed
behaviour Behaviour
• Time of day
8
Other goal directed behaviours are non-regulated but
homeostasis-like
There behaviours are driven by motivational states. Example: Exploring or
These can be internal (e.g.) sexual behaviour
• Hunger
• Thirst
• Temperature sensors
• Sexual arousal
• Curiosity to explore “Satiety” “In the Mood”
These can be external cues (e.g.)
Possible
• Sight of food or water, or potential mate Possible
mechanism mechanism:
• Time of day, seasonal Higher Dopamine Low Dopamine
9
Conserved motivational states/behaviours
https://www.youtube.com/watch?v=MixNh9L7G5M
Almost 100 years ago, Cannon’s classic research revealed that motivation states are highly conserved and trigger greatly overlapping
behaviours. E.g “Hangry” phenomenon (MacCormack and Lindquist, 2018). Another startling example of this: controversial observation of
1,000+ judges hearing parole decisions in Israel—the decisions at the beginning of the day started 65% positive, steadily plummeting to less
than 10% right before a meal break, only to jump back up to 65% after the meal (Danziger et al., 2011).
10
https://tyelab.org/wp-content/uploads/tyereview2018.pdf
https://tinyurl.com/hmb200qa
11
Lecture 8 outline
Motivated and habitual behaviours, and falling in love
1. Homeostasis and goal directed behaviours
2. Effector Systems for goal directed and habit directed behaviours
3. How are goal directed behaviours shaped, and habits formed?
4. The role of dopamine in goal directed and habit directed behaviours (the error predictor)
5. Dopamine and the pair bond
6. Oxytocin and vasopressin and the pair bond
7. The partner engram associated with the reward system
Great Resources to Prepare
In Class Team UP! Activity based on the following video:
https://play.library.utoronto.ca/bjlgOSnj3FO6Links to an external site.
And the highlighted sections of this reading.
Young Wang_2004_The neurobiology of pair bonding 2019.pdf
The video and reading are required readings for the course and are testable.
12
Effector systems for goal directed behaviours
Motivational Similar concept (and greatly overlap brain regions) for goal directed behaviours
state or cues
Frontal Cortex
Goal directed behaviours
Goal directed behavioural effectors
Ventral Tegmental Area Amygdala
Substantia Nigra Dorsolateral Striatum Hypothalamus (neural and hormonal)
Dorsomedial Striatum AND
Nucleus Accumbens (Ventral Striatum) Brainstem circuits
(Ventral Pallidum)
13
Habit memory systems form from cue associated goal
directed behaviours
N N
W E W E
S S
Recall: Starts as goal directed behaviour (foraging)…and then became a habit based behaviour.
RIGHT: (Notice how powerful the habit memory is: the animal does not notice a different starting location
and most still turned left)
Effector systems for goal directed and habit behaviours
Amygdala (BLA, CEA)
Dorsolateral Striatum
The Frontal Cortex Dorsomedial Striatum
Blue structures are involved in Nucleus Accumbens (Ventral Striatum)
input can modulate
motivational state directed action (Ventral Pallidum)
the outputs
Motivational
state or cues
Hypothalamus
Blue structures are involved in Brainstem mediated
motivational state directed action behaviours
BOTH behaviour systems involve
NO
Dopamine signaling GO
GO
https://www-sciencedirect-com.myaccess.library.utoronto.ca/science/article/pii/S0197018618306776#fig2 15
https://tinyurl.com/hmb200qa
16
Lecture 8 outline
Motivated and habitual behaviours, and falling in love
1. Homeostasis and goal directed behaviours
2. Effector Systems for goal directed and habit directed behaviours
3. How are goal directed behaviours shaped, and habits formed?
4. The role of dopamine in goal directed and habit directed behaviours (the error predictor)
5. Dopamine and the pair bond
6. Oxytocin and vasopressin and the pair bond
7. The partner engram associated with the reward system
Great Resources to Prepare
In Class Team UP! Activity based on the following video:
https://play.library.utoronto.ca/bjlgOSnj3FO6Links to an external site.
And the highlighted sections of this reading.
Young Wang_2004_The neurobiology of pair bonding 2019.pdf
The video and reading are required readings for the course and are testable.
17
Operant conditioning
Consequences influence Behaviours
Classical conditioning
Cues trigger reflexes
Behaviour Consequence
Nose Poke I got a treat
Behaviour
Fear
https://www.youtube.com/watch?v=WEWJH-W38ZQ
Operant Conditioning – it feels good so do it again
https://www.youtube.com/watch?v=WEWJH-W38ZQ 19
Classical conditioning Operant conditioning
Amygdala
Fear
Behaviour Consequence
Nose Poke I got a treat
Dopamine
reward
system
In the classical conditioning, the representation of a CUE (very valuable – it is a predictor) with the US
overlaps in time. The association can be easily explained through associativity principle, in which a response
to a neutral stimulus becomes strong (both at the neuronal and behavioural levels) due to temporal overlap
between the two stimuli. Note that the classical conditioning is passive. The situation and consequence happen
to the rat. The rat can form the association even without explicit awareness.
However, to survive, the animal must act and behave (e.g., find food, mate, shelter, protect young, escape
predators). In the operant conditioning, the rat is an active participant. It must act towards reaching a goal
and to learn the consequence of its behaviour.
Dopamine signals through the goal directed pathway likely strengthens that behavioural ouput. It is still
dependent on motivational state (ie. when the animal isn’t hungry, it will nose poke less)
Operant conditioning
Consequences influence Behaviours
AND
Classical conditioning like phenomenon can also occur:
Dopamine (the reward) may ALSO strengthen the habit pathway (the CUE becomes like a CS,
with the dopamine signal acting like the US to strengthen that synapse).
This habit pathway is LESS dependent on behavioural state, and more simply CUE dependent
Everyday examples – operant conditioning
Operant conditioning: the consequence affects
the frequency of the behaviour that preceeded it.
Reward
I will walk in
more often,
especially when
I’m hungry
Operant conditioning increases the specific rewarded goal
directed behaviour I walk in I will walk in
and order more often,
fries especially when
I’m hungry
GO
E.g. Hunger
Reward
I will walk in
Classical conditioning – like more often,
especially when
The “CUE” becomes like a CS I’m hungry
to trigger the behaviour
Increase in the specific goal directed behaviour AND habit
I’m hungry, I
THE SIGN!!
walk in and
I’m walking in!
order fries
E.g. Hunger
GO
25
Reward in the brain
The Amygdala
Recent studies have demonstrated that the amygdala (which we know plays a role in “Defensive” behaviours –
through emotional/stress processing by classical conditioning) ALSO plays a role in reward based behaviours.
Neurons in the basolateral amygdala (BLA) respond to both rewarding and aversive stimuli, and are connected to
output systems for both defensive (through CeA) and appetitive (through NAc/striatum) behaviours.
Neurons with positive and negative valence seem to be intermixed withing the BLA. However, some studies have
demonstrated that activation of the BLA neurons whose axons are in the central amygdala result in defensive
behaviour. Activation of the BLA neurons that project to the nucleus accumbens biases animal towards an
appetitive response.
Reward in the brain
The Nucleus Accumbens
And Striatum
Hi dopamine stimulates behaviour
The dopaminergic system in the brain is highly complex. Many debates about
its function remain. But there is no doubt that is plays the key role in motivated
learning and reward representation.
In one pathway, dopamine signals “reward”, and lack of dopamine might lead
to activation of those behaviours, analogous to “empty stomach”.
29
Dopamine signals reward
As predicted
Greater
Prediction error
Prediction error
What is the likely DA signalling in the nucleus accumbens when you see the logo and
eat the fries (increase, decrease, no change)?
DA signalling
Time
First time
Now to the present day. You’ve been going to McDonald’s so many times!
You arrive, see the logo, eat the fries.
DA signalling
Time
100th time
One day you come to your local McDonald’s. You are regular there. The attendant
decides that as a reward you should be getting 2 for the prices of 1!
DA signalling
Time
2 for 1!!!
You keep coming and each time the kind attendant still serves you double…
Time
100th time
2 for 1
Next day you walk in, the kind attendant no longer works at McDonald’s.
The new attendant gives you just a regular serving.
DA signalling
Time
First time
back only 1
You keep going in, and only get a regular serving each time.
DA signalling
Time
100th time
only 1
You arrive at McDonalds. The attendant informs you that the fry machine is broken.
No fries today.
DA signalling
Time
Broken!
You’ve been coming here every day for the past two weeks and every time you hear
“the fry machine is broken”. Still no fries.
DA signalling
Time
15th time
Broken!
Dopaminergic signalling
Response to reward
https://www.youtube.com/watch?v=axrywDP9Ii0 42
Effector systems for motivated behaviours
Behavioural pathways include
The Frontal Cortex • motivational state directed
input can modulate • Habit memory system dependent
The reward
the outputs
GO
Conditioned Stimuli
(individual stimuli or
contexts)
Thalamus, sensory
The reward cortices,
hippocampus/
memory systems NO
GO
43
Supplemental: The brain is more complex than that :(
https://www.sciencedirect.com/science/article/pii/B9780128022061000350?via%3Dihub 44
https://tinyurl.com/hmb200qa
45
LEFT: Images of NASA’s Perseverance and its photo of the Mars’
terrain on sol 18 after landing.
RIGHT: One of the first images that appeared on the web after the
Perseverance's landing.
49
How do we fall in love?
Step 5
Step 2 Other Group members fill in Group
Click GO number and click JOIN Group
TO TOOL (DO NOT CLICK Create New Group)
Step 6: DRIVER SELECTS Q1 to begin – Click Submit when you are done
Why do some species pair bond and other do not?
Prairie voles and meadow/montane voles do not appear distinct but they have several key
behavioural differences which makes their goals and motivations dramatically different.
Prairie voles form monogamous, long lasting bonds. Both male and female contribute to
raising the young. Meadow/montane voles spend most of their lives solitary. Only females
participate in caring for the young.
58
Oxytocin
Parental behaviour, empathy, social bonding, individual
discrimination, mother-infant bonding
NOTE: Most non-pair bonding species retain similar maternal/paternal infant bonding behaviours
Vasopressin
Social recognition, territorial marking,
aggression, mate-guarding
63
The partner engram and the pair bond
Pair bonding forms when
Partner engram The partner engram becomes CSs
for social affiliation
(through the VP)
and become rewarding themselves
Pro-social outputs
Social recognition is crucial for pair bonding. Olfactory cues are critical for social recognition in many mammalian species (even
humans). Olfactory bulb and Anterior olfactory nucleus (AON) express OXTR, necessary for social recognition. Amygdala forms social
traces. Hippocampus forms a social engram for the partner.
In all species, dopamine reward signals reinforce mating.
In pair bonding species, the partner engram is activated at the same time as DA reward system. Partner engram becomes rewarding
and this leads to intense pro-social behaviour toward the partner.
Also, partner engram inputs to the ventral pallidum are activated at the same time as reward inputs. Associative plasticity strengthens that
connection and the partner engram comes to continuously activates the VP over long periods of time creating an enduring pair bond since
motor output from the VP is pro-social behaviours.
https://www-nature-com.myaccess.library.utoronto.ca/articles/s41583-018-0072-6/figures/2
The simple view
Dopamine Dopamine
+
OXT/AVP
The reward system is strongly activated in response to mating in monogamous and non-monogamous
species. In non-monogamous species mating does not lead to pair bonding while in monogamous
species mating facilitates pair-bonding (but is not necessary).
In monogamous species, pair bonding involves a specific interaction or overlap of the reward system
with the partner recognition system (operant conditioning). A partner (the social engram) comes to
evoke rewarding feelings (by classical conditioning) and evoke pro-social behaviour (through the VP) and
attraction over long period of time. Pair bonding may be thought of as a conditioned partner preference.
The “Red Car” partner engram?
66
Pair Bonding and Love - summary
We propose that pair bond formation is essentially the result of neural plasticity that links
the neural encoding of partner cues with the brain’s reward system such that a partner
becomes persistently and inherently reinforced, leading to selective affiliative behaviour.
We propose that positive reinforcement facilitates the formation of a pair bond, while
negative reinforcement plays a role in maintaining the bond.
What about humans?
We propose that pair bonding is the evolutionary antecedent of romantic love and that the
pair bond is an essential element of romantic love. The pair bond is the innate,
subconscious motivating force forging a strong attraction between partners. Romantic love
is the emergent property of the integration of the pair bond mechanisms described here…
Larry Young, 2018
You don't love someone for their looks, or their clothes, or for their fancy car, but because they sing a song only
you can hear. Oscar Wilde
https://www-nature-com.myaccess.library.utoronto.ca/articles/s41583-018-0072-6#Fig2 67
https://tinyurl.com/hmb200qa
68