[DISC2013] Mood and Weather: Feeling the Heat?

25
Mood and Weather: Feeling the Heat? Kunwoo Park 1 , Seonggyu Lee 1 , Eunae Kim 1 , Minjee Park 2 , Juyong Park 3 , Meeyoung Cha 3 Division of Web Science and Technology 1 , Department of Computer Science 2 , Graduate School of Culture Technology 3 Korea Advanced Institute of Science and Technology (KAIST) 2013. 12. 12. DISC 2013 1

description

Presented at 2013/12/12 (DISC 2013)

Transcript of [DISC2013] Mood and Weather: Feeling the Heat?

Page 1: [DISC2013] Mood and Weather: Feeling the Heat?

Mood and Weather: Feeling the Heat?

Kunwoo Park1, Seonggyu Lee1, Eunae Kim1, Minjee Park2, Juyong Park3, Meeyoung Cha3

Division of Web Science and Technology1, Department of Computer Science2, Graduate School of Culture Technology3

Korea Advanced Institute of Science and Technology (KAIST)

2013. 12. 12. DISC 2013 1

Page 2: [DISC2013] Mood and Weather: Feeling the Heat?

Who are we?

2013. 12. 12. Mood and Weather: Feeling the Heat? 2

• Korea Advanced Institute of Science and Technology• Located in Daejeon (not Daegu)• Natural Science and Engineering oriented

• MIT in Korea

We are here

Page 3: [DISC2013] Mood and Weather: Feeling the Heat?

Who are we?

2013. 12. 12. Mood and Weather: Feeling the Heat? 3

• Division of Web Science and Technology• Understanding and Developing the Web

• human-centered web exploration

• Graduate School of Culture Technology• Social Computing Lab

• Understanding online social networks and social media from diverse perspectives

Page 4: [DISC2013] Mood and Weather: Feeling the Heat?

Background

2013. 12. 12. Mood and Weather: Feeling the Heat? 4

THIS… is American Idol!!!!

A mixed of raining and sunshine.

Just replaced the wheels on my

2nd car :-)

Back to work!Holla at ya’ll

later!

Page 5: [DISC2013] Mood and Weather: Feeling the Heat?

Research Potentials

• We can observe people’s actions and words on a significant scale [Lazer et al. Science 2009]

• It can function as one giant laboratory

• Potentials of social media• reading people’s mind and thinking

ex> predicting election [Tumasjan et al. ICWSM 2010]

• understanding how social mechanism works

ex> how social convention emerges [Kooti et al. ICWSM 2013]

2013. 12. 12. Mood and Weather: Feeling the Heat? 5

Page 6: [DISC2013] Mood and Weather: Feeling the Heat?

2013. 12. 12. 6Mood and Weather: Feeling the Heat?

Theory on Social Science

Data-DrivenComputational Social Science

Big data generated by human

Understanding human

behaviors and social networks

Page 7: [DISC2013] Mood and Weather: Feeling the Heat?

How to get data??

• Most of services provide ways to get data• Can use enormous size of data by writing a programming code

• Help computer scientist start to work on computational social science

2013. 12. 12. Mood and Weather: Feeling the Heat? 7

Page 8: [DISC2013] Mood and Weather: Feeling the Heat?

2013. 12. 12. Mood and Weather: Feeling the Heat? 8

Page 9: [DISC2013] Mood and Weather: Feeling the Heat?

Previous works: weather and mood

• Correlation of weather and mood [Howarth and Hoffman 1984; Preti 1998]

• There are individual differences in how weather affects mood [Klimsta et al. 2011]

• Some of us cannot stand rain

• When we feel happy with sunny weather, others are not happy

2013. 12. 12. Mood and Weather: Feeling the Heat? 9

source: http://iconpng.comhttp://iconarchive.com

Page 10: [DISC2013] Mood and Weather: Feeling the Heat?

Limitations on existing works

• Using small number of samples

• Analysis limited to specific regions

• Relying on questionnaire surveys or interviews

2013. 12. 12. Mood and Weather: Feeling the Heat? 10

Involving sampling biases andhard to capture differences by region

Page 11: [DISC2013] Mood and Weather: Feeling the Heat?

2013. 12. 12. Mood and Weather: Feeling the Heat? 11

Page 12: [DISC2013] Mood and Weather: Feeling the Heat?

Previous works using Twitter

• How weather affects changes in tweeting rates [Kiciman, ICWSM 2012]

• Mood is indeed affected by weather [Hannak et al. ICWSM 2012]

• Limited to twenty metropolitan areas

2013. 12. 12. Mood and Weather: Feeling the Heat? 12

source: http://goo.gl/ZksQ4d source: http://goo.gl/gn6ENM

Page 13: [DISC2013] Mood and Weather: Feeling the Heat?

Twitter dataset

• Period: April, 2009

• Entire tweets of U.S.

• Location of users

• Size• 38.1 million tweets

• 3 million users

2013. 12. 12. Mood and Weather: Feeling the Heat? 13

Page 14: [DISC2013] Mood and Weather: Feeling the Heat?

Twitter crawling

• Crawling (or called “spidering”) using Twitter API

• Twitter provides API (Application Programming Interface)• anyone in Twitter can use

• it indicates all of you can gather Twitter data

2013. 12. 12. Mood and Weather: Feeling the Heat? 14

Page 15: [DISC2013] Mood and Weather: Feeling the Heat?

Make a program gathering data

2013. 12. 12. Mood and Weather: Feeling the Heat? 15

from twitter import *

user = ”disc2013"

twitter = Twitter()

results = twitter.statuses.user_timeline(screen_name = user)

for status in results:print "(%s) %s" % (status["created_at"], status["text"])

With a very few line of codes,you can get Twitter data for your research!

Page 16: [DISC2013] Mood and Weather: Feeling the Heat?

Sentiment Analysis

• Sentiment analysis (or opinion mining) aims to determine the attitude of a speaker or a writer with respect to some topic or the overall contextual polarity of a document(source: Wikipedia)

• Categories• measuring polarity

• ex> I am very happy to attend DISC 2013 !!!! positive

• measuring polarity scale of sentiment across different sentiment dimensions

• ex> I am very happy to attend DISC 2013 !!!! positive: 4, negative: 0

• in this task, we utilized this way

2013. 12. 12. Mood and Weather: Feeling the Heat? 16

Page 17: [DISC2013] Mood and Weather: Feeling the Heat?

Sentiment analysis using LIWC

• LIWC (Linguistic Inquiry and Word Count)• http://www.liwc.net

• 32 behavioral and psychological dimensions

• We can conduct sentiment analysis using 2 of them (positive / negative)

• Method• Input: aggregated tweet written in a state of a day

• Output: value of positive and negative affect

2013. 12. 12. Mood and Weather: Feeling the Heat? 17

Positive score: 4.59Negative score: 2.23

Page 18: [DISC2013] Mood and Weather: Feeling the Heat?

Example: sentiment analysis of 4/1 in NY

2013. 12. 12. Mood and Weather: Feeling the Heat? 18

NY_1.txt

Filename … humans affect posemo negemo ..

NY_1.txt … 0.7 6.77 4.59 2.23 …

NY_1.xls

Page 19: [DISC2013] Mood and Weather: Feeling the Heat?

Weather dataset

• Period: April, 2009

• Source: http://www.wunderground.com

• Using web crawling

• Gathering weather information of each day across states

2013. 12. 12. Mood and Weather: Feeling the Heat? 19

Page 20: [DISC2013] Mood and Weather: Feeling the Heat?

Web crawling

• Read HTML codes and pick information that we want

2013. 12. 12. Mood and Weather: Feeling the Heat? 20

Page 21: [DISC2013] Mood and Weather: Feeling the Heat?

See the relationship

• Correlations between sentiment and weather variables

2013. 12. 12. Mood and Weather: Feeling the Heat? 21

Twitter sentiments Weather variables

Page 22: [DISC2013] Mood and Weather: Feeling the Heat?

Correlation of temperature and positive affects

• Generally, there is correlation between positive affect and temperature across states (average of r =0.14)

• Some states are showing negative correlations

2013. 12. 12. Mood and Weather: Feeling the Heat? 22

Page 23: [DISC2013] Mood and Weather: Feeling the Heat?

Correlation of temperature and positive affects

• Generally, there is correlation between positive affect and temperature across states (average of r =0.14)

• Some states are showing negative correlations

2013. 12. 12. Mood and Weather: Feeling the Heat? 23

There is positive correlation between temperature and positive affectsBut, it depends on where they live

Page 24: [DISC2013] Mood and Weather: Feeling the Heat?

Conclusion

• Used social media data to compare w/ environmental data - Wunderground.com vs. Twitter.com

• Identified notable relationship between the mood and weather• how weather affects mood varies across region

• The notion of ‘good’ weather can be different against each state

• Arizonans preferred humid days and Hawaiians preferred low atmospheric pressures

• Future works• Understanding cultural and economic factors by examining wide geographical regions

2013. 12. 12. Mood and Weather: Feeling the Heat? 24

Page 25: [DISC2013] Mood and Weather: Feeling the Heat?

2013. 12. 12. Mood and Weather: Feeling the Heat? 25

Kunwoo ParkM.S. candidate

Social Computing Lab

E-mail: kw.park at kaist.ac.krTwitter: @words_life

This work was presented as a poster in the International AAAI Conference on Weblogs and Social Media (ICWSM), 2013 in Boston, US.