mood and value with: Dr. EranEldar, MD, PhD Hebrew University · 2018-05-14 · The interaction...
15
The interaction between mood and value Yael Niv ([email protected]) Psychology Department & Princeton Neuroscience Institute, co-director CCNP with: Dr. Eran Eldar, MD, PhD Hebrew University *No conflicts of interest to declare What is Mood? Can we define it formally (mathematically)? How does mood interact with valuation of reward? Why do we have moods? (a just-so story)
Transcript of mood and value with: Dr. EranEldar, MD, PhD Hebrew University · 2018-05-14 · The interaction...
Theinteractionbetweenmoodandvalue
YaelNiv ([email protected])PsychologyDepartment&PrincetonNeuroscienceInstitute,co-directorCCNP
with:Dr.Eran Eldar,MD,PhD
HebrewUniversity
*Noconflictsofinteresttodeclare
� WhatisMood?Canwedefine itformally(mathematically)?� Howdoesmoodinteractwithvaluationofreward?� Why dowehavemoods?(ajust-sostory)
reward
prediction error
Eldar &Niv,2015
game 1
!!
!
/$7
wheel of fortunegame 1
game 2wheel of fortunegame 1
!!
!
–1
0
1
moo
d
12 Game 1 2
lost$7won$7
**
(Eldar &Niv,NatComm,2015)
test
?
?
?
–0.5
0
0.5
highemotionalinstability
lowemotionalinstability
testch
oices
won$7lost$7
?
*
highemotionalinstability
lowemotionalinstability
*
(Eldar &Niv,NatComm,2015)
–1.0
–0.5
0
0.5
highemotionalinstability
lowemotionalinstability
Respon
seto
rewardin
2ndminus1
stgame
won$7lost$7
?
**
Z=-6
Y=8
‘reward’minus‘noreward’
p<10-4 uncorrected
(Eldar &Niv,NatComm,2015)
formalizingmood:thefamousstoryofdopamine
� Phasicsignalsatthetimeofrewardcorrespondtopredictionerrors:
� ReinforcementlearningPredictionerrorscanbeusedtolearnvalues:HowmuchrewarddoIexpectgiventhecurrentstimulus?
� Learnedvaluescanhelpdecisionmaking(pursuestimuliassociatedwithmorereward)
Schultz,Dayan&Montague1997
!"#$ = !&'( + * + − !&'(
./ = + − !
!"#$ = !&'( + * +0 − !&'(
(Eldar &Niv,NatComm,2015)
reward
mood-1 +1
X
1 = 2
+0 = 23 4 += 2+
+0 = 253 4 += 0.5+
+0 = 19 4 + subjectivereward
: ∈ −1,1 mood(fluctuates)
1 > 0 ~1 Individualdifferenceparameter,mediatesmoodbiasm
oodbiases
percep
tionofre
ward
formalizingmood:
0
highermood
↑ biasedperception
positivesurprises
lowermood
↓ biasedperception
negativesurprises
overlyhighexpectations
overlylowexpectations
(Eldar etal.,TICS,2016)
positivefeedbackbreedsinstability
+0 = 19 4 + subjectivereward
: ∈ −1,1 mood(fluctuates)
1 > 0 ~1 Individualdifferenceparameter,mediatesmoodbiasm
oodbiases
percep
tionofre
ward
(Eldar &Niv,NatComm,2015)
reward
mood-1 +1
X
1 = 2+0 = (
3A)534 +
= 2+
+0 = (3A)34 +
= 0.5+ 1 = 12C
formalizingmood:
!"#$ = !&'( + * +0 − !&'(
(Eldar &Niv,NatComm,2015)
reward
+0 = 19 4 + subjectivereward
: ∈ −1,1 mood(fluctuates)
1 > 0 ~1 Individualdifferenceparameter,mediatesmoodbiasm
oodbiases
percep
tionofre
ward
unexpe
cted
rewards
affectm
ood
ℎ"#$ = ℎ&'( + *E ./ − ℎ&'( trackhistoricPE
: = tanh(ℎ) (squashto[-1,1])
formalizingmood:
!"#$ = !&'( + * +0 − !&'(
0.1
1
10
1.5 2.5 3.5
Moo
d bi
as
acco
rdin
g to
mod
el (f
)
emotional instability trait
r =0.30,p<0.05
(Eldar &Niv,NatComm,2015)
0.1
1
10
-1.5 0 1.5
moo
d bi
as
acco
rdin
g to
mod
el (f
)
striatal PE attributable to mood
r =0.43,p<0.05
Z=-6
Y=8
striatalROI
(Eldar &Niv,NatComm,2015)
–5
0
5
10
15
0 100 200 300
iterationpredictionerrorexpectationmood
lowemotionalinstabilitysubjectparameters
–5
0
5
10
15
0 100 200 300
iteration
highemotionalinstabilitysubjectparameters
theoreticalconsequencesformoodinstability:positivefeedbackisdestabilizing
(Eldar &Niv,NatComm,2015)
so…whydowehaveamoodbias?
?
(Eldar etal.,TICS,2016)
!3 !A !J !K
+2 +3 +M+1
………
! ← ! + * + − !
Observed
Hidden
PredictionError
(Eldar etal.,TICS,2016)
correlationbetweensources
?
(Eldar etal.,TICS,2016)
Observed
Hidden
:3 :A :J :K
!3O !A
O !JO !K
O
+2 +3 +M+1
………
………
!O ← !O + * 1 4 :PPQ + + − !O
:PPQ ← :PPQ + *9 ./ −:PPQ
(Eldar etal.,TICS,2016)
??
?
(Eldar etal.,TICS,2016)
!O ← !O + * 1 4 :PPQ + + − !O
Observed
Hiddenv1 v2 v3 vt
r2 r3 rtr1
………v1 v2 v3 vt
r2 r3 rtr1
………!3O !A
O !JO !K
O
+2 +3 +M+1
………
R3 RA RJ RK
:PPQ ← :PPQ + *9 ./ −:PPQ
(Eldar etal.,TICS,2016)
Base model (RL)
Asymmetric learning rates
Mood affects learning rate asymmetry
Mood biases value multiplicatively
Mood biases value additively
Mean predicted probability of choice
better fit
subjectivereward
prediction error
expectation
decision reward
momentum-biasedreinforcementlearning
prediction error signals in striatum
decision biases mood changes
Implications for: - Cyclothymia- Bipolar disorder- Borderline
personality disorder- Depression
reward
� WhatisMood?Canwedefine itmathematically?� Howdoesmoodinteractwithreward?
Eran Eldar,MD,PhD
Ifyouareinthearea,joinourcommunity!ccnp.princeton.edu
